Wang Wenhui, Li Yongqi, He Rufei
CSG PGC Power Storage Research Institute, Guangzhou, China.
PLoS One. 2025 Mar 26;20(3):e0320000. doi: 10.1371/journal.pone.0320000. eCollection 2025.
The underwater environment is complex and variable, with limited transmission bandwidth and strong clutter and interference signals, which make the collected images susceptible to adverse effects such as attenuation and diffusion, resulting in image signal transmission congestion. In the current transmission system application process, the interference noise present in the collected original image will increase the average reprojection error of the image; And some systems have complex data collection processes, requiring the deployment of multiple sensors, which increases data transmission time. In order to improve the ability and efficiency of underwater data collection and transmission, and ensure the quality of underwater multimedia data transmission, a real-time transmission system for underwater panoramic cameras based on RTSP (Real Time Streaming Protocol) was designed. In the data acquisition layer, after setting the relevant parameters of the underwater panoramic camera through camera calibration method, the calibrated underwater panoramic camera is used to collect underwater data. The collected underwater data is compressed and encoded by the encoder in the data encoding layer, and then transmitted to the RTSP server layer. After receiving compressed and encoded underwater data, the RTSP server layer stores it on disk and encapsulates it into RTP (Real-time Transport Protocol) packets. The congestion control method using RTCP feedback monitors the network status in real-time and dynamically adjusts the data transmission rate, effectively avoiding the occurrence of network congestion problems. The RTSP application layer client receives data from the RTSP server, implements restructuring analysis through RTP packets, and sends the restructured frame data into a double buffer waiting for decoding and playback or file recording, achieving real-time transmission of underwater panoramic cameras. The experimental results show that the data transmission effect and quality of the system are good, and the average reprojection error of the calibrated image is 0.12 pixels; During the process of data collection and transmission, the effective time window of the eye diagram is the largest, and the waveform of the top-level data transmission tends to be stable with the smallest fluctuation amsplitude; Dynamically adjust the data transmission rate, control the network packet loss rate below 0.5%, and improve the real-time transmission efficiency of underwater data.
水下环境复杂多变,传输带宽有限,杂波和干扰信号强烈,这使得采集到的图像容易受到衰减和扩散等不利影响,导致图像信号传输拥塞。在当前传输系统应用过程中,采集到的原始图像中存在的干扰噪声会增加图像的平均重投影误差;而且一些系统的数据采集过程复杂,需要部署多个传感器,这增加了数据传输时间。为了提高水下数据采集和传输的能力与效率,并确保水下多媒体数据传输的质量,设计了一种基于实时流协议(RTSP)的水下全景相机实时传输系统。在数据采集层,通过相机标定方法设置水下全景相机的相关参数后,使用标定后的水下全景相机采集水下数据。采集到的水下数据在数据编码层由编码器进行压缩编码,然后传输到RTSP服务器层。RTSP服务器层接收到压缩编码后的水下数据后,将其存储在磁盘上并封装成实时传输协议(RTP)数据包。利用RTCP反馈的拥塞控制方法实时监测网络状态,动态调整数据传输速率,有效避免网络拥塞问题的发生。RTSP应用层客户端从RTSP服务器接收数据,通过RTP数据包进行重组分析,并将重组后的帧数据发送到双缓冲中等待解码回放或文件记录,实现水下全景相机的实时传输。实验结果表明,该系统的数据传输效果和质量良好,标定图像的平均重投影误差为0.12像素;在数据采集和传输过程中,眼图的有效时间窗口最大,顶层数据传输波形趋于稳定,波动幅度最小;动态调整数据传输速率,将网络丢包率控制在0.5%以下,提高了水下数据的实时传输效率。