[1]邓雨婷,胡卓玮,胡一奇.万维网环境下涉灾信息数据采集方法研究[J].自然灾害学报,2022,31(05):031-36.[doi:10.13577/j.jnd.2022.0504]
 DENG Yuting,HU Zhuowei,HU Yiqi.Study on a disaster information data acquisition method in World Wide Web environment[J].,2022,31(05):031-36.[doi:10.13577/j.jnd.2022.0504]
点击复制

万维网环境下涉灾信息数据采集方法研究
分享到:

《自然灾害学报》[ISSN:/CN:23-1324/X]

卷:
31
期数:
2022年05期
页码:
031-36
栏目:
出版日期:
2022-10-28

文章信息/Info

Title:
Study on a disaster information data acquisition method in World Wide Web environment
作者:
邓雨婷123 胡卓玮123 胡一奇123
1. 首都师范大学 资源环境与旅游学院, 北京 100048;
2. 首都师范大学 资源环境与地理信息系统北京市重点实验室, 北京 100048;
3. 首都师范大学 城市环境过程与数字模拟国家重点实验室培育基地, 北京 100048
Author(s):
DENG Yuting123 HU Zhuowei123 HU Yiqi123
1. College of Resources Environment and Tourism, Capital Normal University, Beijing 100048, China;
2. Beijing Key Laboratory of Resource Environment and Geographic Information System, Capital Normal University, Beijing 100048, China;
3. State Key Laboratory Incubation Base of Urban Environmental Processes and Digital Simulation, Capital Normal University, Beijing 100048, China
关键词:
涉灾信息数据数据采集多源数据网络爬虫防灾减灾
Keywords:
disaster information datadata acquisitionmulti-source dataweb crawlerdisaster prevention and mitigation
分类号:
TP391.1;X43
DOI:
10.13577/j.jnd.2022.0504
摘要:
随着自然灾害应急管理信息化的发展,越来越多的国家部门、行业单位、社会机构以万维网为载体提供涉灾信息数据服务。针对万维网上的涉灾信息数据分布零散和不易提取的问题,文中提出了一种涉灾信息数据采集方法,将全量采集和增量采集相结合以获取历史数据和实时数据,并整合动态页面获取技术和模拟登录技术以适用于多种网页类型。对综合性较强的网站设计了信息主题相关性判断方法,以便更准确地提取涉灾信息。通过实验,该方法能较好实现涉灾数据和涉灾信息的获取,为防灾减灾、应急管理提供数据支持。
Abstract:
With the development of natural disaster emergency management information,more and more national departments,industrial units and social institutions provide disaster-related information and data services with the World Wide Web as the carrier. Aiming at the problems of scattered distribution and difficult extraction of disaster information data on the World Wide Web,this paper proposes a disaster information data aquisition method,which combines full acquisition and incremental acquisition technology to collect historical data and real-time data,and integrates dynamic page acquisition technology and simulated login technology to apply to a variety of web pages. This article designs a method for judging the relevance of information topics for comprehensive websites,in order to extract disaster-related information more accurately. Through experiments,this method can achieve data integration and information integration better,and provide data support for disaster prevention,mitigation,and emergency management.

参考文献/References:

[1] 张宝军,马玉玲,李仪. 我国自然灾害分类的标准化[J]. 自然灾害学报,2013,22(5):8-12. ZHANG Baojun,MA Yuling,LI Yi. Standardization of natural disaster classification in China[J]. Journal of Natural Disasters,2013,22(5):8-12.(in Chinese)
[2] KAYI A,ERDOGAN M,YILMAZ A. The role of national and international geospatial data sources in the management of natural disasters[J]. The International Archives of the Photogrammetry,Remote Sensing and Spatial Information Sciences,2014,XL-8:47-51.
[3] 张春山,吴满路,张业成. 地质灾害风险评价方法及展望[J]. 自然灾害学报,2003,12(1):96-102. ZHANG Chunshan,WU Manlu,ZHANG Yecheng. Method and prospect of geological disaster risk assessment[J]. Journal of Natural Disasters, 2003,12(1):96-102.(in Chinese)
[4] 王艳杰,王卷乐,卜坤. 灾害数据管理技术与平台进展及其面临的需求研究[J]. 灾害学,2019,34(2):205-210. WANG Yanjie,WANG Juanle,BU Kun. Research on disaster data management technology and platform progress and the demand it faces[J]. Journal of Catastrophology,2019,34(2):205-210.(in Chinese)
[5] 韦天仙,张军,张时忠. 基于三维GIS的地质灾害信息查询统计系统设计与实现[J]. 自然灾害学报,2014,23(5):38-44. WEI Tianxian,ZHANG Jun,ZHANG Shizhong. Design and implementaion of geological disaster information inquiry and statistics system based on 3D GIS[J]. Journal of Natural Disasters,2014,23(5):38-44.(in Chinese)
[6] (印)昂米沙·冈迪察(Unmesh Gundecha)著. 金鑫, 熊志男译. Selenium自动化测试:基于Python语言[M]. 北京:人民邮电出版社, 2018:15-28.[India]Unmesh Gundecha. JIN Xin,XIONG Zhinan,translator. Selenium Automated Testing Based on Python[M]. Beijing:Posts & Telecom Press,2018:15-28.(in Chinese)

备注/Memo

备注/Memo:
收稿日期:2021-5-7;改回日期:2022-1-9。
基金项目:国家重点研发计划项目(2018YFC1508902, 2017YFC0506501)
作者简介:邓雨婷(1997-),女,硕士研究生,主要从事灾害数据管理研究.E-mail:864776798@qq.com
通讯作者:胡卓玮(1979-),男,教授,博士,主要从事地理信息系统算法与模型研究.E-mail:huzhuowei@cnu.edu.cn
更新日期/Last Update: 1900-01-01