Hider Robert, Kleissas Dean, Gion Timothy, Xenes Daniel, Matelsky Jordan, Pryor Derek, Rodriguez Luis, Johnson Erik C, Gray-Roncal William, Wester Brock
Research and Exploratory Development Department, Johns Hopkins University Applied Physics Laboratory, Laurel, MD, United States.
Front Neuroinform. 2022 Feb 15;16:828787. doi: 10.3389/fninf.2022.828787. eCollection 2022.
Technological advances in imaging and data acquisition are leading to the development of petabyte-scale neuroscience image datasets. These large-scale volumetric datasets pose unique challenges since analyses often span the entire volume, requiring a unified platform to access it. In this paper, we describe the Brain Observatory Storage Service and Database (BossDB), a cloud-based solution for storing and accessing petascale image datasets. BossDB provides support for data ingest, storage, visualization, and sharing through a RESTful Application Programming Interface (API). A key feature is the scalable indexing of spatial data and automatic and manual annotations to facilitate data discovery. Our project is open source and can be easily and cost effectively used for a variety of modalities and applications, and has effectively worked with datasets over a petabyte in size.
成像和数据采集方面的技术进步正推动着拍字节规模的神经科学图像数据集的发展。这些大规模的体积数据集带来了独特的挑战,因为分析通常跨越整个体积,需要一个统一的平台来访问它。在本文中,我们描述了大脑观测站存储服务和数据库(BossDB),这是一种用于存储和访问拍字节规模图像数据集的基于云的解决方案。BossDB通过一个RESTful应用程序编程接口(API)提供对数据摄取、存储、可视化和共享的支持。一个关键特性是空间数据的可扩展索引以及自动和手动注释,以促进数据发现。我们的项目是开源的,可以轻松且经济高效地用于各种模态和应用,并且已经有效地处理了超过一PB大小的数据集。