Data cleaning method of ADS-B historical flight trajectories

WANG Bing

doi:10.19818/j.cnki.1671-1637.2020.04.018

Volume 20 Issue 4

Turn off MathJax

Article Contents

Article Navigation > Journal of Traffic and Transportation Engineering > 2020 > 20(4): 217-226

WANG Bing. Data cleaning method of ADS-B historical flight trajectories[J]. Journal of Traffic and Transportation Engineering, 2020, 20(4): 217-226. doi: 10.19818/j.cnki.1671-1637.2020.04.018

Citation:

WANG Bing. Data cleaning method of ADS-B historical flight trajectories[J]. Journal of Traffic and Transportation Engineering, 2020, 20(4): 217-226. doi: 10.19818/j.cnki.1671-1637.2020.04.018

WANG Bing. Data cleaning method of ADS-B historical flight trajectories[J]. Journal of Traffic and Transportation Engineering, 2020, 20(4): 217-226. doi: 10.19818/j.cnki.1671-1637.2020.04.018

Citation:

WANG Bing. Data cleaning method of ADS-B historical flight trajectories[J]. Journal of Traffic and Transportation Engineering, 2020, 20(4): 217-226. doi: 10.19818/j.cnki.1671-1637.2020.04.018

PDF( 765 KB)

Data cleaning method of ADS-B historical flight trajectories

doi: 10.19818/j.cnki.1671-1637.2020.04.018

WANG Bing¹

1.
College of Civil Aviation/College of Flight, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, Jiangsu, China
2.
National Key Laboratory of Air Traffic Flow Management, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, Jiangsu, China

Funds:

National Natural Science Foundation of China 61903187

More Information

Author Bio:
WANG Bing(1979-), male, lecturer, PhD, evanwb@163.com
Received Date: 2020-02-02
Publish Date: 2020-04-25

Abstract

Abstract

To effectively solve the various field data anomalies in the automatic dependent surveillance-broadcast(ADS-B) historical flight trajectories affected by the ground station distribution breadth, terrain blocking, electromagnetic interference and so on, an ADS-B data cleaning method was established, and implemented by four steps, such as determining the cleaning object, deleting the duplication of field, cleaning the abnormal point and correcting the time stamp. According to the existing sample ADS-B historical data, the track model was established and the validity was analyzed. The fields such as the time stamp, longitude, latitude, pressure altitude and ground speed were defined as the characteristic fields and cleaning objects. The time stamp, longitude and latitude of ADS-B track point sequence were deduplicated to delete the adjacent track points with repeated data. The outliers of characteristic fields were located through the method based on the density-based spatial clustering of applications with noise(DBSCAN) to improve the cleaning efficiency, detect and correct the abnormality. To make the change of track point state conform to the particle kinematic law, the time stamp was corrected by the field data of longitude, latitude, pressure altitude and ground speed of ADS-B track points, and the extended modified time stamp field was saved. Research result shows that 97.58% of the abnormal track points in the 516 sample flights are effectively identified and cleaned. The cleaned track point state changes more smoothly. The total flight duration before and after correction varies between 10-600 s. The correction effect of time stamp mainly depends on the accuracy of ground speed. The corrected time stamp should be selectively used according to the data characteristics of sample track in practical engineering applications. The established cleaning method of ADS-B data can provide a preliminary data processing platform for the trajectory analysis, evaluation and computing in civil aviation engineering projects.
- air traffic,
- ADS-B flight trajectory,
- data cleaning,
- DBSCAN method,
- local traversal,
- time stamp correction

FullText(HTML)

References(30)

References

[1]	ICAO. ADS-B implementation and operations guidance document (Edition 7.0)[R]. Chicago: ICAO, 2014.
[2]	ALI B S. System specifications for developing an automatic dependent surveillance-broadcast (ADS-B) monitoring system[J]. International Journal of Critical Infrastructure Protection, 2016, 15: 40-46. doi: 10.1016/j.ijcip.2016.06.004
[3]	SEMKE W, ALLEN N, TABASSUM A, et al. Analysis of radar and ADS-B influences on aircraft detect and avoid (DAA) systems[J]. Aerospace, 2017, 49(4): 1-14.
[4]	ALI B S, SCHUSTER W, OCHIENG W Y. Evaluation of the capability of automatic dependent surveillance broadcast to meet the requirements of future airborne surveillance applications[J]. The Journal of Navigation, 2017, 70: 49-66. doi: 10.1017/S0373463316000412
[5]	ENEA G, PORRETTA M. A comparison of 4D-trajectory operations envisioned for NextGen and SESAR, some preliminary findings[C]//ICAS. 28th International Congress of the Aeronautical Science. Brisbane: ICAS, 2012: 1-14.
[6]	STROHMEIER M, SCHÄER M, LENDERS V, et al. Realities and challenges of NextGen air traffic management: the case of ADS-B[J]. IEEE Communications Magazine, 2014, 52(5): 111-118. doi: 10.1109/MCOM.2014.6815901
[7]	BAEK J, BYON Y J, HABLEEL E, et al. Making air traffic surveillance more reliable: a new authentication framework for automatic dependent surveillance-broadcast (ADS-B) based on online/offline identity-based signature[J]. Security and Communication Networks, 2015, 8: 740-750. doi: 10.1002/sec.1021
[8]	康南, 刘永刚. ADS-B技术在我国的应用和发展[J]. 中国民用航空, 2011, 131: 36-38. https://www.cnki.com.cn/Article/CJFDTOTAL-MHJJ201111016.htm KANG Nan, LIU Yong-gang. Application and development of ADS-B technology in China[J]. China Civil Aviation, 2011, 131: 36-38. (in Chinese). https://www.cnki.com.cn/Article/CJFDTOTAL-MHJJ201111016.htm
[9]	孙立新, 陈亚青, 刘国毅. ADS-B空管监视系统误差分析与研究[J]. 武汉理工大学学报(交通科学与工程版), 2011, 35(4): 798-801. doi: 10.3963/j.issn.1006-2823.2011.04.035 SUN Li-xin, CHEN Ya-qing, LIU Guo-yi. Error analysis of ADS-B surveillance system in ATC[J]. Journal of Wuhan University of Technology (Transportation Science and Engineering), 2011, 35(4): 798-801. (in Chinese). doi: 10.3963/j.issn.1006-2823.2011.04.035
[10]	王琦. 基于ADS-B的飞行航迹获取研究与实现[D]. 长春: 吉林大学, 2015. WANG Qi. Study and implement of flight track based on ADS-B[D]. Changchun: Jinlin University, 2015. (in Chinese).
[11]	PURTON L, ABBASS H, ALAM S. Identification of ADS-B system vulnerabilities and threats[C]//PATREC. Australasian Transport Research Forum 2010 Proceedings. Canberra: PATREC, 2010: 1-16.
[12]	MANESH M R, KAABOUCH N. Analysis of vulnerabilities, attacks, countermeasures and overall risk of the automatic dependent surveillance-broadcast (ADS-B) system[J]. International Journal of Critical Infrastructure Protection, 2017, 19: 16-31. doi: 10.1016/j.ijcip.2017.10.002
[13]	RAJEE O. Safety analysis of automatic dependent surveillance-broadcast (ADS-B) system[J]. International Journal of Aerospace and Mechanical Engineering, 2018, 5(2): 9-18.
[14]	TABASSUM A, ALLEN N, SEMKE W. ADS-B message contents evaluation and breakdown of anomalies[C]//IEEE. 2017 IEEE/AIAA 36th Digital Avionics Systems Conference (DASC). New York: IEEE, 2017: 1-8.
[15]	TABASSUM A, SEMKE W. UAT ADS-B data anomalies and the effect of flight parameters on dropout occurrences[J]. Data, 2018, 3(2): 1-21. doi: 10.29147/dat.v3i2.84
[16]	ALI B S, TAIB N A. A study on geometric and barometric altitude data in automatic dependent surveillance broadcast (ADS-B) messages[J]. The Journal of Navigation, 2019, 72: 1140-1158. doi: 10.1017/S0373463319000201
[17]	邹杰. 基于数据挖掘的数据清洗及其评估模型的研究[D]. 北京: 北京邮电大学, 2017. ZOU Jie. Research on data cleaning and model evaluation based on data mining[D]. Beijing: Beijing University of Posts and Telecommunications, 2017. (in Chinese).
[18]	ALI B S, SCHUSTER W, OCHIENG W, et al. Analysis of anomalies in ADS-B and its GPS data[J]. GPS Solut, 2016, 20: 429-438. doi: 10.1007/s10291-015-0453-5
[19]	ALI B S, SCHUSTER W, OCHIENG W, et al. Framework for ADS-B performance assessment: the London TMA case study[J]. Navigation: Journal of the Institute of Navigation, 2014, 61(1): 39-52. doi: 10.1002/navi.53
[20]	王子龙. ADS-B监视数据质量分析[D]. 广汉: 中国民用航空飞行学院, 2013. WANG Zi-long. The analysis of ADS-B surveillance data quality[D]. Guanghan: Civil Aviation Flight University of China, 2013. (in Chinese).
[21]	曹娜. 基于海量实测的ADS-B数据质量分析[D]. 天津: 中国民航大学, 2017. CAO Na. Quality analysis on ADS-B massive real data[D]. Tianjin: Civil Aviation University of China, 2017. (in Chinese).
[22]	马玉猛, 张循利. 基于1090ES数据链的ADS-B数据质量分析[J]. 滨州学院学报, 2018, 34(2): 5-8. https://www.cnki.com.cn/Article/CJFDTOTAL-BZSX201802001.htm MA Yu-meng, ZHANG Xun-li. The analysis of ADS-B data quality based on 1090ES data chain[J]. Journal of Binzhou University, 2018, 34(2): 5-8. (in Chinese). https://www.cnki.com.cn/Article/CJFDTOTAL-BZSX201802001.htm
[23]	ESTER M, KRIEGEL H P, SANDER J, et al. A density-based algorithm for discovering clusters in large spatial databases with noise[C]∥AIAA. Proceedings of the Second International Conference on Knowledge Discovery and Data Mining. Menlo Park: AIAA Press, 1996: 226-231.
[24]	徐晓晗, 谢云开, 李亚军. 大地主题解算实用算法[J]. 科学技术与工程, 2012, 12(9): 2062-2068. doi: 10.3969/j.issn.1671-1815.2012.09.017 XU Xiao-han, XIE Yun-kai, LI Ya-jun. A practical algorithm for solution of geodetic problem[J]. Science Technology and Engineering, 2012, 12(9): 2062-2068. (in Chinese). doi: 10.3969/j.issn.1671-1815.2012.09.017
[25]	高强, 张凤荔, 王瑞锦, 等. 轨迹大数据: 数据处理关键技术研究综述[J]. 软件学报, 2017, 28(4): 959-992. https://www.cnki.com.cn/Article/CJFDTOTAL-RJXB201704015.htm GAO Qiang, ZHANG Feng-li, WANG Rui-jin, et al. Trajectory big data: a review of key technologies in data processing[J]. Journal of Software, 2017, 28(4): 959-992. (in Chinese). https://www.cnki.com.cn/Article/CJFDTOTAL-RJXB201704015.htm
[26]	邹杰, 李书芳. 基于密度的数据清洗方法研究与评估[J]. 电子元器件与信息技术, 2017, 1(1): 50-58. https://www.cnki.com.cn/Article/CJFDTOTAL-DYXU201701009.htm ZOU Jie, LI Shu-fang. Density-based data cleaning method research and evaluation[J]. Electronic Components and Information Technology, 2017, 1(1): 50-58. (in Chinese). https://www.cnki.com.cn/Article/CJFDTOTAL-DYXU201701009.htm
[27]	唐鹏. 基于ADS-B数据监视性能评估技术研究[D]. 天津: 中国民航大学, 2015. TANG Peng. Research on evaluation techniques of surveillance performance based on ADS-B data[D]. Tianjin: Civil Aviation University of China, 2015. (in Chinese).
[28]	刘芳. 基于Hadoop的ADS-B数据组织与分析关键技术[D]. 天津: 中国民航大学, 2018. LIU Fang. The key technology of ADS-B data organization and analysis based on Hadoop[D]. Tianjin: Civil Aviation University of China, 2018. (in Chinese).
[29]	EUROCONTROL. User manual for the base of aircraft data (BADA) revision 3.11[R]. Bruxelles: EUROCONTROL, 2013.
[30]	DA SILVA J L R, BRANCALION J F B, FERNANDES D. Data fusion techniques applied to scenarios including ADS-B and radar sensors for air traffic control[C]//IEEE. 12th International Conference on Information Fusion. New York: IEEE, 2009: 1481-1488.

Relative Articles

Supplements(0)

Cited By

Proportional views

Proportional views

通讯作者: 陈斌, bchen63@163.com

1.
沈阳化工大学材料科学与工程学院沈阳 110142

Get Citation

PDF

XML

Article Metrics

Article views (1110) PDF downloads(689)

Data cleaning method of ADS-B historical flight trajectories

doi: 10.19818/j.cnki.1671-1637.2020.04.018

Abstract

References

Proportional views

Catalog

通讯作者: 陈斌, bchen63@163.com

Article Metrics

Proportional views

Related

Data cleaning method of ADS-B historical flight trajectories

doi: 10.19818/j.cnki.1671-1637.2020.04.018

Abstract

References

Proportional views

Catalog

通讯作者: 陈斌, bchen63@163.com

Article Metrics

Proportional views

Related

Export File

Citation

Format

Content