Mixed Reality and Interaction Lab, Department of Software, Sejong University, Seoul 143-747, Korea.
Department of Electrical Information Control, Dong Seoul University, Seoul 143-747, Korea.
Sensors (Basel). 2020 May 30;20(11):3097. doi: 10.3390/s20113097.
In recent years, 360° videos have gained the attention of researchers due to their versatility and applications in real-world problems. Also, easy access to different visual sensor kits and easily deployable image acquisition devices have played a vital role in the growth of interest in this area by the research community. Recently, several 360° panorama generation systems have demonstrated reasonable quality generated panoramas. However, these systems are equipped with expensive image sensor networks where multiple cameras are mounted in a circular rig with specific overlapping gaps. In this paper, we propose an economical 360° panorama generation system that generates both mono and stereo panoramas. For mono panorama generation, we present a drone-mounted image acquisition sensor kit that consists of six cameras placed in a circular fashion with optimal overlapping gap. The hardware of our proposed image acquisition system is configured in such way that no user input is required to stitch multiple images. For stereo panorama generation, we propose a lightweight, cost-effective visual sensor kit that uses only three cameras to cover 360° of the surroundings. We also developed stitching software that generates both mono and stereo panoramas using a single image stitching pipeline where the panorama generated by our proposed system is automatically straightened without visible seams. Furthermore, we compared our proposed system with existing mono and stereo contents generation systems in both qualitative and quantitative perspectives, and the comparative measurements obtained verified the effectiveness of our system compared to existing mono and stereo generation systems.
近年来，由于 360°视频的多功能性及其在实际问题中的应用，引起了研究人员的关注。此外，不同视觉传感器套件和易于部署的图像采集设备的广泛获取，也在研究界对该领域的兴趣增长中发挥了重要作用。最近，有几个 360°全景生成系统展示了生成的具有合理质量的全景图。然而，这些系统配备了昂贵的图像传感器网络，其中多个相机安装在带有特定重叠间隙的圆形装置中。在本文中，我们提出了一种经济的 360°全景生成系统，该系统可以生成单目和双目全景图。对于单目全景图生成，我们提出了一种基于无人机的图像采集传感器套件，该套件由六个相机以最佳重叠间隙安装在一个圆形结构中。我们提出的图像采集系统的硬件配置方式使得无需用户输入即可拼接多个图像。对于双目全景图生成，我们提出了一种轻量级、经济高效的视觉传感器套件，该套件仅使用三个相机即可覆盖 360°的周围环境。我们还开发了拼接软件，该软件使用单个图像拼接管道生成单目和双目全景图，其中我们提出的系统生成的全景图可以自动校正，没有可见的拼接痕迹。此外，我们从定性和定量两个方面将我们提出的系统与现有的单目和双目内容生成系统进行了比较，并且获得的比较测量结果验证了与现有的单目和双目生成系统相比，我们的系统的有效性。
