Wang Chunpeng, Li Xiaoyun, Wan Rongzheng, Chen Jige, Ye Jing, Li Ke, Li Aiguo, Tai Renzhong, Sepe Alessandro
Big Data Science Center, Shanghai Synchrotron Radiation Facility, Shanghai Advanced Research Institute, Chinese Academy of Sciences, No. 239 Zhangheng Road, Shanghai 201210, People's Republic of China.
Shanghai Synchrotron Radiation Facility, Shanghai Advanced Research Institute, Chinese Academy of Sciences, No. 239 Zhangheng Road, Shanghai 201210, People's Republic of China.
J Synchrotron Radiat. 2024 Sep 1;31(Pt 5):1317-1326. doi: 10.1107/S1600577524007239. Epub 2024 Aug 27.
To date, computed tomography experiments, carried-out at synchrotron radiation facilities worldwide, pose a tremendous challenge in terms of the breadth and complexity of the experimental datasets produced. Furthermore, near real-time three-dimensional reconstruction capabilities are becoming a crucial requirement in order to perform high-quality and result-informed synchrotron imaging experiments, where a large amount of data is collected and processed within a short time window. To address these challenges, we have developed and deployed a synchrotron computed tomography framework designed to automatically process online the experimental data from the synchrotron imaging beamlines, while leveraging the high-performance computing cluster capabilities to accelerate the real-time feedback to the users on their experimental results. We have, further, integrated it within a modern unified national authentication and data management framework, which we have developed and deployed, spanning the entire data lifecycle of a large-scale scientific facility. In this study, the overall architecture, functional modules and workflow design of our synchrotron computed tomography framework are presented in detail. Moreover, the successful integration of the imaging beamlines at the Shanghai Synchrotron Radiation Facility into our scientific computing framework is also detailed, which, ultimately, resulted in accelerating and fully automating their entire data processing pipelines. In fact, when compared with the original three-dimensional tomography reconstruction approaches, the implementation of our synchrotron computed tomography framework led to an acceleration in the experimental data processing capabilities, while maintaining a high level of integration with all the beamline processing software and systems.
迄今为止,在全球同步辐射设施上进行的计算机断层扫描实验,在产生的实验数据集的广度和复杂性方面带来了巨大挑战。此外,近实时三维重建能力正成为进行高质量且基于结果的同步辐射成像实验的关键要求,在这类实验中,大量数据在短时间窗口内被收集和处理。为应对这些挑战,我们开发并部署了一个同步辐射计算机断层扫描框架,旨在自动在线处理来自同步辐射成像光束线的实验数据,同时利用高性能计算集群的能力,加快向用户反馈其实验结果的实时信息。此外,我们还将其集成到一个现代统一的国家认证和数据管理框架中,该框架是我们开发并部署的,涵盖了大型科学设施的整个数据生命周期。在本研究中,详细介绍了我们的同步辐射计算机断层扫描框架的整体架构、功能模块和工作流程设计。此外,还详细说明了上海同步辐射设施的成像光束线成功集成到我们的科学计算框架中的情况,这最终实现了其整个数据处理管道的加速和完全自动化。事实上,与原来的三维断层扫描重建方法相比,我们的同步辐射计算机断层扫描框架的实施提高了实验数据处理能力,同时与所有光束线处理软件和系统保持了高度集成。