留言板

尊敬的读者、作者、审稿人, 关于本刊的投稿、审稿、编辑和出版的任何问题, 您可以本页添加留言。我们将尽快给您答复。谢谢您的支持!

姓名
邮箱
手机号码
标题
留言内容
验证码

基于单目视觉的水面船舶多目标定位方法

柳晨光 初秀民 谢朔 王乐

柳晨光, 初秀民, 谢朔, 王乐. 基于单目视觉的水面船舶多目标定位方法[J]. 交通运输工程学报, 2015, 15(5): 91-100. doi: 10.19818/j.cnki.1671-1637.2015.05.012
引用本文: 柳晨光, 初秀民, 谢朔, 王乐. 基于单目视觉的水面船舶多目标定位方法[J]. 交通运输工程学报, 2015, 15(5): 91-100. doi: 10.19818/j.cnki.1671-1637.2015.05.012
LIU Chen-guang, CHU Xiu-min, XIE Shuo, WANG Le. Multi-target locating method of surface ship based on monocular vision[J]. Journal of Traffic and Transportation Engineering, 2015, 15(5): 91-100. doi: 10.19818/j.cnki.1671-1637.2015.05.012
Citation: LIU Chen-guang, CHU Xiu-min, XIE Shuo, WANG Le. Multi-target locating method of surface ship based on monocular vision[J]. Journal of Traffic and Transportation Engineering, 2015, 15(5): 91-100. doi: 10.19818/j.cnki.1671-1637.2015.05.012

基于单目视觉的水面船舶多目标定位方法

doi: 10.19818/j.cnki.1671-1637.2015.05.012
基金项目: 

国家自然科学基金项目 61273234

国家自然科学基金项目 51479155

交通运输部信息化技术研究项目 2013-364-548-200

湖北省自然科学基金项目 2013CFA007

详细信息
    作者简介:

    柳晨光(1988-), 男, 江西九江人, 武汉理工大学工学博士研究生, 从事船舶智能化与运动控制研究

    初秀民(1969-), 男, 吉林通化人, 武汉理工大学研究员, 工学博士

  • 中图分类号: U675.7

Multi-target locating method of surface ship based on monocular vision

More Information
  • 摘要: 针对水面船舶的多目标实时定位, 提出了一种定位和运动参数求解算法, 采用固定位置和视角的单目摄像机采集船舶图像, 对采集的图像进行高斯滤波和图像畸变校正, 提出了基于船舶颜色、尺寸与运动学特征同时识别多个船舶目标(每个船舶目标独立识别)的方法, 构建了图像坐标与真实环境坐标的转换模型与实时航速、航向和轨迹的计算模型, 在水池环境下搭建了实时定位系统, 开发了实时定位程序, 并验证了定位方法的定位精度和轨迹跟踪性能。验证结果表明: 在存在外界干扰的情况下, 定位算法能实现对2艘船舶的精确识别; 修正前坐标点横、纵坐标平均误差分别为0.058、0.209m, 修正后分别为0.038、0.124m;摄像机定位数据更新频率为8 Hz, 满足船舶控制需要; 算法能实现对船舶位置、航速和航向的准确、实时计算, 轨迹平滑且未出现异常点。

     

  • 图  1  高斯滤波前后效果对比

    Figure  1.  Effects comparison before and after Gaussian filtering

    图  2  摄像机标定结果

    Figure  2.  Camera calibration result

    图  3  摄像机镜头畸变校正前后效果对比

    Figure  3.  Effect comparison before and after distortion correction of camera lens

    图  4  原图像

    Figure  4.  Original image

    图  5  红色通道图像

    Figure  5.  Red channel image

    图  6  二值化图像

    Figure  6.  Binary image

    图  7  轮廓识别图像

    Figure  7.  Contour recognition image

    图  8  对焦平面与世界坐标系转换关系

    Figure  8.  Transform relationship between focal plane and world coordinate system

    图  9  对焦平面与水域关系

    Figure  9.  Relationship between focal plane and water space

    图  10  摄像机小孔成像原理

    Figure  10.  Pinhole imaging principle of camera

    图  11  船舶运动状态计算

    Figure  11.  Calculation of ship motion state

    图  12  程序主界面

    Figure  12.  Main interface of program

    图  13  摄像机位置

    Figure  13.  Position of camera

    图  14  激光测距仪测量方法

    Figure  14.  Measuring method of laser range finder

    图  15  摄像机定位试验结果

    Figure  15.  Experimental results of camera locating

    图  16  轨迹曲线

    Figure  16.  Trajectory curves

    图  17  航向角变化曲线

    Figure  17.  Changing curves of course angles

    表  1  测量结果

    Table  1.   Measuring result

  • [1] CACCIA M, BIBULI M, BONO R, et al. Basic navigation, guidance and control of an unmanned surface vehicle[J]. Autonomous Robots, 2008, 25(4): 349-365. doi: 10.1007/s10514-008-9100-0
    [2] 周娜. 基于单目视觉的摄像机定位技术研究[D]. 南京: 南京航空航天大学, 2007.

    ZHOU Na. Research on camera location based on monocular vision[D]. Nanjing: Nanjing University of Aeronautics and Astronautics, 2007. (in Chinese)
    [3] 刘江, 蔡伯根, 王云鹏. 基于GNSS/ DSRC融合的协同车辆定位方法[J]. 交通运输工程学报, 2014, 14(4): 116-126. http://transport.chd.edu.cn/article/id/201404014

    LIU Jiang, CAI Bai-gen, WANG Yun-peng. Cooperative vehicle positioning method based on GNSS/DSRC fusion[J]. Journal of Traffic and Transportation Engineering, 2014, 14(4): 116-126. (in Chinese) http://transport.chd.edu.cn/article/id/201404014
    [4] 李明月. 高精度捷联式惯性导航系统校准与补偿方法研究[D]. 哈尔滨: 哈尔滨工程大学, 2012.

    LI Ming-yue. The research of calibration and compensation methods for high precision strapdown inertial navigation system[D]. Harbin: Harbin Engineering University, 2012. (in Chinese)
    [5] 孟浩, 程康. 基于SIFT特征点的双目视觉定位[J]. 哈尔滨工程大学学报, 2009, 30(6): 649-652, 675. doi: 10.3969/j.issn.1006-7043.2009.06.011

    MENG Hao, CHENG Kang. Object location technique for binocular stereo vision based on scale invariant feature transform feature points[J]. Journal of Harbin Engineering University, 2009, 30(6): 649-652, 675. (in Chinese) doi: 10.3969/j.issn.1006-7043.2009.06.011
    [6] 曹凤萍, 王荣本, 张亮修. 基于双目立体视觉的月球车三维定位算法[J]. 交通信息与安全, 2012, 30(4): 28-33. doi: 10.3963/j.issn.1674-4861.2012.04.007

    CAO Feng-ping, WANG Rong-ben, ZHANG Liang-xiu. A three-dimensional localization algorithm of lunar rover based on binocular vision[J]. Journal of Transport Information and Safety, 2012, 30(4): 28-33. (in Chinese) doi: 10.3963/j.issn.1674-4861.2012.04.007
    [7] 李荣明, 芦利斌, 金国栋. 单目视觉定位方法研究综述[J]. 现代计算机, 2011, 28(11): 9-12. doi: 10.3969/j.issn.1007-1423-B.2011.11.003

    LI Rong-ming, LU Li-bin, JIN Guo-dong. Research overview of location method for monocular vision[J]. Modern Computer, 2011, 28(11): 9-12. (in Chinese) doi: 10.3969/j.issn.1007-1423-B.2011.11.003
    [8] 刘洪伟. 基于单目视觉的移动机器人目标识别与定位[D]. 济南: 山东大学, 2011.

    LIU Hong-wei. Mobile robot object recognition and localization based on monocular vision[D]. Jinan: Shandong University, 2011. (in Chinese)
    [9] 张治国. 基于单目视觉的定位系统研究[D]. 武汉: 华中科技大学, 2009.

    ZHANG Zhi-guo. Research on locating system based on monocular vision[D]. Wuhan: Huazhong University of Science and Technology, 2009. (in Chinese)
    [10] HUNTSBERGER T, AGHAZARIAN H, HOWARD A, et al. Stereo vision-based navigation for autonomous surface vessels[J]. Journal of Field Robotics, 2011, 28(1): 3-18. doi: 10.1002/rob.20380
    [11] MA Yue, HU Ying, BI Feng-long. Tracking and position study for unmanned semi-submersible vessel based on stereo vision[C]∥IEEE. 4th International Conference on Digital Manufacturing and Automation. New York: IEEE, 2013: 1618-1621.
    [12] ASHRAFIUON H, MUSKE K R, MCNINCH L C, et al. Sliding-mode tracking control of surface vessels[J]. IEEE Transactions on Industrial Electronics, 2008, 55(11): 4004-4012. doi: 10.1109/TIE.2008.2005933
    [13] 王健, 王孝通, 徐晓刚. 基于单目机器视觉的船舶测距定位原理研究[J]. 中国航海, 2005, 28(3): 8-10, 14. doi: 10.3969/j.issn.1000-4653.2005.03.002

    WANG Jian, WANG Xiao-tong, XU Xiao-gang. Study of ship locating principle by measuring distance based on the monocular camera machine vision[J]. Navigation of China, 2005, 28(3): 8-10, 14. (in Chinese) doi: 10.3969/j.issn.1000-4653.2005.03.002
    [14] 王强锋. 利用单目视觉测量技术研究船桥撞击运动[D]. 宁波: 宁波大学, 2012.

    WANG Qiang-feng. Studying on the ship movement during ship-bridge collision with monocular vision measuring[D]. Ningbo: Ningbo University, 2012. (in Chinese)
    [15] LU Jian-guo, CAI A, LI Li-li. A detection-aided multi-target tracking algorithm[C]∥IEEE. 2010 International Conference on Machine Vision and Human-Machine Interface. New York: IEEE, 2010: 580-583.
    [16] HEATH K, GUIBAS L. Multi-person tracking from sparse 3D trajectories in a camera sensor network[C]∥IEEE. 2nd ACM/IEEE International Conference on Distributed Smart Cameras. New York: IEEE, 2008: 1-9.
    [17] 梁敏. 基于粒子滤波的多目标跟踪算法研究[D]. 西安: 西安电子科技大学, 2010.

    LIANG Min. Study of multi-target tracking algorithm based on particle filter[D]. Xi'an: Xidian University, 2010. (in Chinese)
    [18] 王文远. 基于图像信噪比选择优化高斯滤波尺度[J]. 电子与信息学报, 2009, 31(10): 2483-2487. https://www.cnki.com.cn/Article/CJFDTOTAL-DZYX200910039.htm

    WANG Wen-yuan. Selecting the optimal Gaussian filtering scale via the SNR of image[J]. Journal of Electronics and Information Technology, 2009, 31(10): 2483-2487. (in Chinese) https://www.cnki.com.cn/Article/CJFDTOTAL-DZYX200910039.htm
    [19] 熊显名, 任娟娟. 黑白棋盘格中的角点提取算法的研究[J]. 微型机与应用, 2014, 33(9): 66-69. doi: 10.3969/j.issn.1674-7720.2014.09.021

    XIONG Xian-ming, REN Juan-juan. Research of corner detection algorithm in the black and white checkerboard[J]. Microcomputer and Its Applications, 2014, 33(9): 66-69. (in Chinese) doi: 10.3969/j.issn.1674-7720.2014.09.021
    [20] TIAN L F, SLAUGHTER D C. Environmentally adaptive segmentation algorithm for outdoor image segmentation[J]. Computers and Electronics in Agriculture, 1998, 21(3): 153-168. doi: 10.1016/S0168-1699(98)00037-4
    [21] 刘娅静, 杨帆, 浦昭邦. 基于颜色特征的杂草图像分割技术研究[J]. 微计算机信息, 2007, 23(18): 269-271. doi: 10.3969/j.issn.1008-0570.2007.18.106

    LIU Ya-jing, YANG Fan, PU Zhao-bang. Research on segmentation of field weed image based on color feature[J]. Microcomputer Information, 2007, 23(18): 269-271. (in Chinese) doi: 10.3969/j.issn.1008-0570.2007.18.106
    [22] 张晓娜, 何仁, 陈士安, 等. 基于主动学习AdaBoost算法与颜色特征的车牌定位[J]. 交通运输工程学报, 2013, 13(1): 121-126. http://transport.chd.edu.cn/article/id/201301018

    ZHANG Xiao-na, HE Ren, CHEN Shi-an, et al. Vehicle license plate location using active learning AdaBoost algorithm and color feature[J]. Journal of Traffic and Transportation Engineering, 2013, 13(1): 121-126. (in Chinese) http://transport.chd.edu.cn/article/id/201301018
    [23] 张文娟. 桥区船舶航行风险预警系统研究[D]. 武汉: 武汉理工大学, 2013.

    ZHANG Wen-juan. Early warning system for ship navigation risk in bridge waterways[D]. Wuhan: Wuhan University of Technology, 2013. (in Chinese)
  • 加载中
图(17) / 表(1)
计量
  • 文章访问数:  671
  • HTML全文浏览量:  157
  • PDF下载量:  1377
  • 被引次数: 0
出版历程
  • 收稿日期:  2015-05-21
  • 刊出日期:  2015-10-25

目录

    /

    返回文章
    返回