TY - JOUR
T1 - Collaborative algorithms that combine AI with IoT towards monitoring and control system
AU - Zhang, Tao
AU - Zhao, Yan
AU - Jia, Wenjing
AU - Chen, Mu Yen
N1 - Funding Information:
This work is supported by the National Natural Science Foundation of China (NO. 61702226 ); the 111 Project, China ( B12018 ); open Fund of Jiangsu Key Laboratory of Image and Video Understanding for Social Safety, Nanjing University of Science and Technology, Nanjing ( J2021-7 ).
Publisher Copyright:
© 2021 Elsevier B.V.
PY - 2021/12
Y1 - 2021/12
N2 - Recently, a new IoT structure known as the Artificial Intelligence of Things (AIoT) comes into play. Crowd counting is a promising field in data analysis of AIoT, however, due to poor transparency and high data security risks, developing a novel network architecture that can precisely elevate the counting of heavy crowd is extremely difficult. In addition, the fusion of IoT and AI also poses several challenges. The focus of this work is on the effective design of IoT framework and deep learning algorithm towards security of smart city. The system can be used to estimate the crowd traffic in public places, and can prevent the occurrence of congestion, stampede and other accidents, such as stations, airports, large-scale exhibitions, tourist attractions and other places. The constructed system contains video collection, upload and display as well as data analysis and early warning operation at the embedded device end, and automatically tracks densely crowd areas by controlling the video monitoring device. Moreover, the cloud platform can be controlled through the network. Our proposed algorithms are composed of two main aspects, i.e., division and focus. Firstly, we propose a novel density-adaptive Gaussian kernel to elevate the quality of density maps. Then, we propose a module based on conditional random fields for feature fusion. Finally, we propose a block segmentation module to predict our segmentation results and extract the context-aware information in segmentation stage. Experiments on our captured data, the Shanghai Tech, UCF_CC_50 and UCF_QNRF datasets demonstrate that our solution has obtained better performance and lower count errors over the state of the art.
AB - Recently, a new IoT structure known as the Artificial Intelligence of Things (AIoT) comes into play. Crowd counting is a promising field in data analysis of AIoT, however, due to poor transparency and high data security risks, developing a novel network architecture that can precisely elevate the counting of heavy crowd is extremely difficult. In addition, the fusion of IoT and AI also poses several challenges. The focus of this work is on the effective design of IoT framework and deep learning algorithm towards security of smart city. The system can be used to estimate the crowd traffic in public places, and can prevent the occurrence of congestion, stampede and other accidents, such as stations, airports, large-scale exhibitions, tourist attractions and other places. The constructed system contains video collection, upload and display as well as data analysis and early warning operation at the embedded device end, and automatically tracks densely crowd areas by controlling the video monitoring device. Moreover, the cloud platform can be controlled through the network. Our proposed algorithms are composed of two main aspects, i.e., division and focus. Firstly, we propose a novel density-adaptive Gaussian kernel to elevate the quality of density maps. Then, we propose a module based on conditional random fields for feature fusion. Finally, we propose a block segmentation module to predict our segmentation results and extract the context-aware information in segmentation stage. Experiments on our captured data, the Shanghai Tech, UCF_CC_50 and UCF_QNRF datasets demonstrate that our solution has obtained better performance and lower count errors over the state of the art.
UR - http://www.scopus.com/inward/record.url?scp=85111899245&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85111899245&partnerID=8YFLogxK
U2 - 10.1016/j.future.2021.07.008
DO - 10.1016/j.future.2021.07.008
M3 - Article
AN - SCOPUS:85111899245
SN - 0167-739X
VL - 125
SP - 677
EP - 686
JO - Future Generation Computer Systems
JF - Future Generation Computer Systems
ER -