Parsons Aaron D, Price Stephen W T, Wadeson Nicola, Basham Mark, Beale Andrew M, Ashton Alun W, Mosselmans J Frederick W, Quinn Paul D
Diamond Light Source, Didcot, OX11 0DE, UK.
Research Complex at Harwell, Didcot, OX11 0FA, UK.
J Synchrotron Radiat. 2017 Jan 1;24(Pt 1):248-256. doi: 10.1107/S1600577516017756.
With the development of fourth-generation high-brightness synchrotrons on the horizon, the already large volume of data that will be collected on imaging and mapping beamlines is set to increase by orders of magnitude. As such, an easy and accessible way of dealing with such large datasets as quickly as possible is required in order to be able to address the core scientific problems during the experimental data collection. Savu is an accessible and flexible big data processing framework that is able to deal with both the variety and the volume of data of multimodal and multidimensional scientific datasets output such as those from chemical tomography experiments on the I18 microfocus scanning beamline at Diamond Light Source.
随着第四代高亮度同步加速器即将问世,成像和映射光束线上已经庞大的数据量预计将增加几个数量级。因此,需要一种简单且易于使用的方法,以便尽快处理如此庞大的数据集,从而能够在实验数据收集过程中解决核心科学问题。Savu是一个易于使用且灵活的大数据处理框架,能够处理多模态和多维科学数据集输出的数据多样性和数据量,比如来自钻石光源I18微聚焦扫描光束线化学断层扫描实验的数据。