College of Engineering and Computer Science, Jazan University, Jazan 45142, Saudi Arabia.
Sensors (Basel). 2024 Oct 3;24(19):6411. doi: 10.3390/s24196411.
Visually Impaired Persons (VIPs) have difficulty in recognizing vehicles used for navigation. Additionally, they may not be able to identify the bus to their desired destination. However, the bus bay in which the designated bus stops has not been analyzed in the existing literature. Thus, a guidance system for VIPs that identifies the correct bus for transportation is presented in this paper. Initially, speech data indicating the VIP's destination are pre-processed and converted to text. Next, utilizing the Arctan Gradient-activated Recurrent Neural Network (ArcGRNN) model, the number of bays at the location is detected with the help of a Global Positioning System (GPS), input text, and bay location details. Then, the optimal bay is chosen from the detected bays by utilizing the Experienced Perturbed Bacteria Foraging Triangular Optimization Algorithm (EPBFTOA), and an image of the selected bay is captured and pre-processed. Next, the bus is identified utilizing a You Only Look Once (YOLO) series model. Utilizing the Sub-pixel Shuffling Convoluted Encoder-ArcGRNN Decoder (SSCEAD) framework, the text is detected and segmented for the buses identified in the image. From the segmented output, the text is extracted, based on the destination and route of the bus. Finally, regarding the similarity value with respect to the VIP's destination, a decision is made utilizing the Multi-characteristic Non-linear S-Curve-Fuzzy Rule (MNC-FR). This decision informs the bus conductor about the VIP, such that the bus can be stopped appropriately to pick them up. During testing, the proposed system selected the optimal bay in 247,891 ms, which led to deciding the bus stop for the VIP with a fuzzification time of 34,197 ms. Thus, the proposed model exhibits superior performance over those utilized in prevailing works.
视障人士(VIP)在识别用于导航的车辆时存在困难。此外,他们可能无法识别去往目的地的公交车。然而,现有的文献中并未分析指定公交车停靠的巴士站。因此,本文提出了一种为 VIP 提供导向系统,以识别正确的公交车进行出行。首先,预处理并将指示 VIP 目的地的语音数据转换为文本。然后,借助全球定位系统(GPS)、输入文本和巴士站位置详细信息,利用反正切梯度激活递归神经网络(ArcGRNN)模型检测所在位置的巴士站数量。然后,通过利用经验扰动细菌觅食三角优化算法(EPBFTOA),从检测到的巴士站中选择最优的巴士站,并拍摄和预处理选定巴士站的图像。接下来,利用 You Only Look Once(YOLO)系列模型识别公交车。利用子像素混洗卷积编码器-ArcGRNN 解码器(SSCEAD)框架,检测并分割图像中识别的公交车的文本。从分割输出中,根据公交车的目的地和路线提取文本。最后,利用多特征非线性 S 型曲线模糊规则(MNC-FR),根据与 VIP 目的地的相似度值做出决策。该决策会通知公交车驾驶员有关 VIP 的信息,以便适当停靠公交车来接他们。在测试过程中,所提出的系统在 247,891 毫秒内选择了最佳巴士站,从而在 34,197 毫秒的模糊化时间内为 VIP 决定了公交车站。因此,所提出的模型在性能上优于现有工作中使用的模型。