基于AR的高压铁塔验收无人机交互技术研究*

PDF(1498 KB)

集成电路与嵌入式系统 ›› 2023, Vol. 23 ›› Issue (6) : 57-60.

新器件新技术

基于AR的高压铁塔验收无人机交互技术研究^*

张四江¹, 李正发¹, 黄林柯¹, 王争辉², 张东升²

作者信息 +

Research on UAV Interactive Technology of High-voltage Tower Acceptance Based on AR Technology

Zhang Sijiang¹, Li Zhengfa¹, Huang Linke¹, Wang Zhenghui², Zhang Dongsheng²

Author information +

文章历史 +

摘要

为改变输电线路铁塔验收的人工登高作业方式,开发了基于AR的铁塔验收无人机系统。首先制订了铁塔无人机验收规范;通过Unity引擎对AR眼镜内部场景进行虚拟化建模,搭配MRTK开发套件,实现跨设备人机交互操作;利用AR眼镜设计人的头部自然动作与无人机控制指令间的映射规则,通过局域网RTSP串流将无人机拍摄的视频发送到AR眼镜,相当于无人机带着人的眼睛开展铁塔验收工作,解决了传统无人机巡检难以应用于铁塔验收的难题。

Abstract

In order to solve the problems caused by the manual climbing operation mode of tower acceptance,a UAV interactive system is designed and developed based on augmented reality technology.First of all,the UAV acceptance specifications of the tower are formulated.The system uses augmented reality technology to carry out virtual modeling of AR glasses internal scenes through Unity engine,and realizes cross-device human-machine interaction operation with MRTK development.The mapping rules between the natural movements of human head and the control commands of UAV are designed by using AR glasses,translating and the RTSP streams the video shot by UAV to AR glasses through LAN sending the video captured by UAV to the AR glasses via LAN RTSP streaming.The system is equivalent to the UAV with human eyes carrying out the acceptance work of the tower,which solves the problem that the traditional UAV inspection is difficult to be applied to the acceptance of the tower.

导出引用

张四江, 李正发, 黄林柯, 王争辉, 张东升. 基于AR的高压铁塔验收无人机交互技术研究^*[J]. 集成电路与嵌入式系统. 2023, 23(6): 57-60

Zhang Sijiang, Li Zhengfa, Huang Linke, Wang Zhenghui, Zhang Dongsheng. Research on UAV Interactive Technology of High-voltage Tower Acceptance Based on AR Technology[J]. Integrated Circuits and Embedded Systems. 2023, 23(6): 57-60

中图分类号： TM755

参考文献

[1] 钱平,张永,徐街明.智能电网巡检机器人终端视觉巡检技术研究[J].现代电子技术,2018,41(18):113-116.
[2] 罗潇,於锋,彭勇.基于深度学习的无人机电网巡检缺陷检测研究[J].电力系统保护与控制,2022,50(10):132-139.
[3] 姚言章.双足混联铁塔攀爬机器人步态研究[D].武汉:武汉大学,2021.
[4] 熊佳佳.基于巡检机器人的电网覆冰输电线路状态智能监测技术[J].制造业自动化,2021,43(4):153-156.
[5] Hee-Jae Kim,Sung-Keun Lee,Mei-Lan Piao,et al.Three-dimensional holographic head mounted display using holographic optical element[C]//IEEE International Conference on Consumer Electronics,2015:132-133.
[6] Andrew Maimone,Andreas Georgiou,Joel S Kollin.Holographic near-eye displays for virtual and augmented reality[J].ACM Transactions on Graphics,2017,36(4):81-85.
[7] 李欣.基于AR技术的南航维修新模式研究与应用[J].航空维修与工程,2022(11):15-17.
[8] 刘子俊,简学之,时伯年,等.基于增强现实技术的智能变电站设备运维仿真[J].南方电网技术,2019,13(11):69-75.
[9] 简学之,刘子俊,文明浩,等.AR增强现实技术在变电站二次设备运检中的应用[J].电力系统保护与控制,2020,48(15):170-176.
[10] 史哲凡.增强现实环境下基于跨设备交互的远距离选择技术研究[D].长春:吉林大学,2022.
[11] 丁赞成,王大军,李万翔.基于多维感知的输电线路危险点识别控制技术研究[J].电气传动,2022,52(23):53-58.
[12] 卢丹,张中青,余晓鹏,等.电网运行风险管控可视化系统架构与功能研究[J].北京理工大学学报,2020,44(1):87-93.
[13] 李子阳,张东胜,杜邦.基于AR的智能安全巡检系统[J].北京化工大学学报(自然科学版),2022,49(5):59-66.
[14] 刘颖,陈佳,冯振新.基于增强现实技术的电力管廊运维系统研究及应用[J].计算机应用与软件,2022,39(7):134-140.
[15] 邓丽,鲁琛瑶,邵宇鹰,等.增强现实技术在电力系统故障源标识中的应用[J].系统仿真学报,2014,26(10):2386-2390.
[16] 薛鹏.基于AKAZE算法的变电站增强现实巡检系统研究[D].大庆:东北石油大学,2022.