Erdenebat Munkh-Uchral, Amgalan Tuvshinjargal, Khuderchuluun Anar, Nam Oh-Seung, Jeon Seok-Hee, Kwon Ki-Chul, Kim Nam
School of Information and Communication Engineering, Chungbuk National University, Chungbuk 28644, Republic of Korea.
Department of Electronics Engineering, Incheon National University, Incheon 22012, Republic of Korea.
Sensors (Basel). 2023 Jul 8;23(14):6245. doi: 10.3390/s23146245.
We propose a high-quality, three-dimensional display system based on a simplified light field image acquisition method, and a custom-trained full-connected deep neural network is proposed. The ultimate goal of the proposed system is to acquire and reconstruct the light field images with possibly the most elevated quality from the real-world objects in a general environment. A simplified light field image acquisition method acquires the three-dimensional information of natural objects in a simple way, with high-resolution/high-quality like multicamera-based methods. We trained a full-connected deep neural network model to output desired viewpoints of the object with the same quality. The custom-trained instant neural graphics primitives model with hash encoding output the overall desired viewpoints of the object within the acquired viewing angle in the same quality, based on the input perspectives, according to the pixel density of a display device and lens array specifications within the significantly short processing time. Finally, the elemental image array was rendered through the pixel re-arrangement from the entire viewpoints to visualize the entire field-of-view and re-constructed as a high-quality three-dimensional visualization on the integral imaging display. The system was implemented successfully, and the displayed visualizations and corresponding evaluated results confirmed that the proposed system offers a simple and effective way to acquire light field images from real objects with high-resolution and present high-quality three-dimensional visualization on the integral imaging display system.
我们提出了一种基于简化光场图像采集方法的高质量三维显示系统,并提出了一种定制训练的全连接深度神经网络。所提出系统的最终目标是在一般环境中从现实世界物体获取并重建可能具有最高质量的光场图像。一种简化光场图像采集方法以简单方式获取自然物体的三维信息,具有与基于多相机方法相同的高分辨率/高质量。我们训练了一个全连接深度神经网络模型,以输出具有相同质量的物体所需视角。具有哈希编码的定制训练即时神经图形原语模型根据显示设备的像素密度和镜头阵列规格,在极短的处理时间内,基于输入视角,以相同质量输出所采集视角范围内物体的整体所需视角。最后,通过从整个视角进行像素重排来渲染元素图像阵列,以可视化整个视场,并在积分成像显示器上重建为高质量的三维可视化。该系统成功实现,所显示的可视化效果及相应评估结果证实,所提出的系统提供了一种简单有效的方法,可从真实物体获取高分辨率的光场图像,并在积分成像显示系统上呈现高质量的三维可视化。