基于AI机器视觉的盲道检测与信息采集系统

董心怡, 汪永良, 王远青, 千承辉

集成电路与嵌入式系统 ›› 2026, Vol. 26 ›› Issue (9) : 1-7.

PDF(10973 KB)
PDF(10973 KB)
集成电路与嵌入式系统 ›› 2026, Vol. 26 ›› Issue (9) : 1-7. DOI: 10.20193/j.ices2097-4191.2026.0013
封面文章

基于AI机器视觉的盲道检测与信息采集系统

作者信息 +

Tactile paving detection and information acquisition system based on AI machine vision

Author information +
文章历史 +

摘要

为了辅助视障人士出行,设计了一个基于AI机器视觉的盲道信息采集系统,实现对盲道信息的智能化采集。系统基于图像边缘检测以及形态学约束识别正常盲道,实现轮式机器人沿盲道的自动行驶,使用YOLOv8目标检测模型搭配华为昇腾AI处理器识别盲道异常情况,并将检测结果通过Wi-Fi上传至上位机。测试时铺设30 cm×30 cm模拟盲道砖块,并在不同位置放置破损盲道、缺失盲道、可移动与不可移动障碍物进行多次检测。经测试,该系统能在设定场景下完成盲道信息采集,确定异常情况类型与发生位置,盲道异常情况检测平均准确率达95%,异常情况定位信息与实际位置的平均绝对误差小于9.12 cm,可用于市政了解盲道环境信息,辅助视障人士安全出行。

Abstract

To assist visually impaired individuals in navigation, an AI-based machine vision system for collecting tactile paving information has been designed to enable intelligent data acquisition. The system ide.pngies standard tactile paving through image edge detection and morphological constraints, enabling wheeled robots to autonomously traverse tactile paths. It employs the YOLOv8 object detection model paired with Huawei Ascend AI processors to detect anomalies in tactile paving, transmitting detection results to a host computer via Wi-Fi. Experiments were conducted on a simulated tactile paving testbed composed of 30 cm×30 cm tiles, including damaged tiles, missing sections, and movable and immovable obstacles at different locations. Multiple detection runs were conducted with damaged tactile paving, missing sections, and both movable and immovable obstacles placed at various positions. Testing confirmed the system̓s capability to collect tactile paving data within defined scenarios, ide.pngy anomaly types and locations, with an average detection accuracy of 95%. The average absolute error in anomaly location pinpointing was less than 9.12 cm relative to actual positions. The proposed system provides technical support for tactile paving inspection, maintenance management, and accessible mobility assistance for visually impaired individuals.

关键词

视觉识别算法 / YOLOv8 / 同步定位与建图 / ROS机器人 / 昇腾AI处理器

Key words

visual recognition algorithm / YOLOv8 / simultaneous localization and mapping / ROS robot / ascend AI processor

引用本文

导出引用
董心怡, 汪永良, 王远青, 等. 基于AI机器视觉的盲道检测与信息采集系统[J]. 集成电路与嵌入式系统. 2026, 26(9): 1-7 https://doi.org/10.20193/j.ices2097-4191.2026.0013
Dong Xinyi, Wang Yongliang, Wang Yuanqing, et al. Tactile paving detection and information acquisition system based on AI machine vision[J]. Integrated Circuits and Embedded Systems. 2026, 26(9): 1-7 https://doi.org/10.20193/j.ices2097-4191.2026.0013
中图分类号: TP242 (机器人)   

参考文献

[1]
陈传荣. 人口老龄化背景下城市无障碍设施问题分析及改善策略——以苏州城市盲道建设现状为例[J]. 美与时代(城市版), 2019(5):65-66.
Chen C R. Analysis on the Problems and Improvement Strategies of Urban Barrier-Free Facilities Under the Background of Population Aging——Taking the Construction Status of Sidewalks for the Blind in Suzhou as an Example[J]. Beauty & Times, 2019(5):65-66 (in Chinese).
[2]
吴悦, 薛平聚, 武梦竹, 等. 城市无障碍设施现状分析及改进意见——以石家庄市盲道为例[J]. 中国康复理论与实践, 2017, 23(4):485-487.
摘要
本文以石家庄市盲道为例,采用随机抽取方式,选取3个区的30条街道,对盲道使用情况进行实地调查。调查显示,69%现有盲道可以正常使用,其余存在着铺设不合理、被占用和破损情况,各占8%、11%、12%。本文从科学合理铺设、加强监管与维护、加强宣传教育三个方面提出改进意见,以改善盲道现状,提高使用率,促进视力障碍者参与社会生活,提高其生活质量。
Wu Y, Xue P J, Wu M Z, et al. Analysis on the Current Situation and Improvement Suggestions of Urban Barrier-Free Facilities——Taking the Sidewalks for the Blind in Shijiazhuang as an Example[J]. Chinese Journal of Rehabilitation Theory and Practice, 2017, 23(4):485-487 (in Chinese).
[3]
李智蕊, 陈宇, 李佳乐, 等. 一种基于盲道识别的自主导盲小车设计开发[J]. 电子制作, 2024, 32(21): 23-27.
Li Z R, Chen Y, Li J L, et al. Design and Development of an Autonomous Guide Vehicle Based on Blind Sidewalk Recognition[J]. Practical Electronics, 2024, 32(21):23-27 (in Chinese).
[4]
Bastidas-Guacho G K, et al.Paguay Alvarado M A,Moreno-Vallejo P X, Computer Vision-Based Obstacle Detection Mobile System for Visually Impaired Individuals[J]. Multimodal Technologies and Interaction, 2025, 9(5):48.
[5]
Mitchell W, Staniforth A, Scott I. Analysis of Ackermann steering geometry[C]// Warrendale,PA, USA: SAE International, 2006.
[6]
甄国涌, 赵继达, 储成群, 等. 基于超分模型与改进Canny算法的零件测量系统[J]. 集成电路与嵌入式系统, 2024, 24(7):59-64.
Zhen G Y, Zhao J D, Chu C Q, et al. Parts measurement system based on super-resolution model and improved Canny algorithm[J]. Integrated Circuits and Embedded Systems, 2024, 24(7):59-64 (in Chinese).

In order to solve the problems of low measurement accuracy and poor algorithm adaptability in industrial measurement of part dimensions,a machine vision parts measurement system based on super-resolution model and improved Canny algorithm is designed and proposed.Firstly,the camera is calibrated to obtain the proportional relationship between the pixel distance and the actual size.Secondly,a super-resolution model is introduced and improved to pre-process the input image to obtain an image with clearer edge details.Thirdly,in order to solve the edge detection problem caused by poor lighting conditions in the industrial measurement environment,the Otsu algorithm and the double threshold segmentation algorithm are combined,and the Canny edge filtering algorithm is improved by using local threshold segmentation to obtain edge images.Finally,after simultaneously performing circle fitting and straight line fitting on the edge image,the part size results are marked based on the camera calibration results and super-resolution model parameters.The experiment results show that the measurement accuracy of this system can reach 0.001 mm,the average measurement error is 0.007 4 mm,and the overall measurement speed is 6.44 s,which can meet the needs of high-precision industrial measurement.

[7]
Yang X, Yu H. Lane Line Detection Based on Dynamic ROI and Adaptive Thresholding Segmentation[C]// Proceedings of the 2022 6th International Conference on Electronic Information Technology and Computer Engineering.Xiamen, China: Association for Computing Machinery,2022:549-553.
[8]
刘克平, 李西卫, 李岩, 等. 基于边缘信息的 SIFT 图像匹配算法[J]. 吉林大学学报(信息科学版), 2018, 36(2):200-206.
Liu K P, Li X W, Li Y, et al. SIFT image matching algorithm based on edge information[J]. Journal of Jilin University (Information Science Edition), 2018, 36(2):200-206 (in Chinese).
[9]
周逸凡, 杨智伟, 王粤洋, 等. 基于云端的移动式智能车底藏匿物检测系统设计[J]. 吉林大学学报(信息科学版), 2025, 43(4):903-912.
Zhou Y F, Yang Z W, Wang Y Y, et al. Design of a Cloud-Based Mobile System for Detecting Concealed Objects Under Vehicles[J]. Journal of Jilin University (Information Science Edition), 2025, 43(4):903-912 (in Chinese).
[10]
Modupalli B M, Prithvi P.YOLOv8-C2fSE-An Improved Accuracy Model for Object Detection[C]//6th International Conference on Recent Advances in Information Technology (RAIT).Dhanbad:IEEE,2025:1-5.
[11]
邹彦艳, 曹衍芬, 张馨月, 等. 基于YOLOv8-DSG的钢铁表面缺陷检测算法[J]. 吉林大学学报(信息科学版), 2025, 43(1):116-125.
Zou Y Y, Cao Y F, Zhang X Y, et al. A Steel Surface Defect Detection Algorithm Based on YOLOv8-DSG[J]. Journal of Jilin University (Information Science Edition), 2025, 43(1):116-125 (in Chinese).
[12]
熊恩杰, 张荣芬, 刘宇红, 等. 面向交通标志的Ghost-YOLOv8检测算法[J]. 计算机工程与应用, 2023, 59(20):200-207.
摘要
针对当前传统网络模型对交通标志识别精度低、检测不准确的问题,提出一种基于YOLOv8n优化、改进的Ghost-YOLOv8交通标志检测模型。使用GhostConv代替部分Conv,设计全新的C2fGhost模块代替部分C2f,减少了模型的参数量,提升了模型的检测性能;在Neck部分添加GAM注意力机制模块,强化特征中的语义信息和位置信息,提高了模型的特征融合能力;针对检测小目标时尺度不一导致语义信息的丢失,添加小目标检测层,增强深层语义信息与浅层语义信息的结合;使用GIoU边界损失函数代替原损失函数,提升了网络的边界框回归性能。实验结果表明,改进的模型在中国交通标志检测数据集TT100K中的精确度(Precision)及平均精度均值(mAP)相较于原模型分别提高了9.5、6.5个百分点,模型的参数量及模型大小相比原模型分别降低了0.223×109、0.2?MB。综合说明,该模型在减少模型参数量及大小的同时提高了检测精度,显著优于对比算法,也满足边缘计算设备的要求,具有实际的应用价值。
Xiong E J, Zhang R F, Liu Y H, et al. Ghost-YOLOv8 Detection Algorithm for Traffic Signs[J]. Computer Engineering and Applications, 2023, 59(20):200-207 (in Chinese).
Aiming at the problems of low accuracy and inaccurate detection of traffic signs in the current traditional network model, a Ghost-YOLOv8 traffic sign detection model is proposed based on YOLOv8n optimization and improvement. First of all, using GhostConv instead of some Conv, designing a new C2fGhost module instead of some C2f, the model’s parameters is reduced and the detection performance of the model is enhanced. Secondly, a GAM attention mecha-<br>nism module is added to the Neck part to strengthen the semantic and positional information in the features, which improves the feature fusion ability of the model; then, for detecting the loss of semantic information when detecting small targets, it adds a small target detection layer to enhance the combination of deep semantic information and shallow semantic information. Finally, it uses the GIoU boundary border loss function to replace the original loss function, which improves the backbone of the network’s boundary frame. The experimental results show that the accuracy(Precision) and average accuracy average(mAP) of the improvement model in China traffic sign detection data set TT100K are increased by 9.5 and 6.5 percentage points compared with the original model. And the reduction of number of model parameters and model size are 0.223×109 and 0.2 MB, respectively. Comprehensive explanation, the model of this article improves the detection accuracy while reducing the amount and size of the model, which is significantly better than the comparison algorithm, and also meets the requirements of the edge computing equipment, and has practical application value.
[13]
陈忠财, 李鑫, 隋立林. 基于深度学习的智能化无人机视觉系统设计[J]. 集成电路与嵌入式系统, 2024, 24(9):62-67.
摘要
针对无人机飞行高度高、目标尺度变化大、目标存在密集遮挡等问题,本文将对基于深度学习的无人机目标探测与识别以及视觉定位进行深入探讨,并设计出一套无人机目标探测与定位系统。研究选用Yolov5深度学习网络模型进行目标检测,基于Darknet深度学习框架完成端到端的训练预测,最后利用AprilTag视觉基准库完成无人机自身空间位置的辅助定位。测试结果表明,Yolov5模型的参数量只有5.3,准确率为97.41%,召回率为90.73%,mAP为83.2。AprilTag辅助定位的拟合精度达95%以上。研究设计的基于深度学习的智能化无人机视觉系统不仅具有实际的工程价值,更具有重要的社会意义。
Chen Z C, Li X, Sui L L. Design of intelligent UAV vision system based on deep learning technology[J]. Integrated Circuits and Embedded Systems, 2024, 24(9):62-67 (in Chinese).

To address the problems challenges such as high flight altitude, large changes in target scale, and the densely occluded targets, the study utilizes deep learning methods for target detection and identification and visual localization of UAV. A UAV target detection and positioning system is designed and discussed in depth. The study selects Yolov5 deep learning network model for target detection, completes end-to-end training prediction based on Darknet deep learning framework, and finally utilizes AprilTag visual benchmark library to complete the auxiliary localization of UAV's spatial positioning. The test results show that the parameter count of Yolov5 model is only 5.3. Meanwhile, the model achieves a precision of 97.41%, a recall rate of 90.73%, and an mAP of 83.2. The fitting precision of AprilTag assisted localization is more than 95%. The research and design of intelligent UAV vision system based on deep learning not only has actual engineering values, but also significant societal importance.

基金

国家级大学生创新创业基金资助项目(202410183283)

编辑: 薛士然
PDF(10973 KB)

Accesses

Citation

Detail

段落导航
相关文章

/

〈 〉