Scalable Minds GmbH, Potsdam, Germany.
Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, United States.
Methods Cell Biol. 2023;177:359-387. doi: 10.1016/bs.mcb.2023.01.016. Epub 2023 Mar 9.
The growing size of EM volumes is a significant barrier to findable, accessible, interoperable, and reusable (FAIR) sharing. Storage, sharing, visualization and processing are challenging for large datasets. Here we discuss a recent development toward the standardized storage of volume electron microscopy (vEM) data which addresses many of the issues that researchers face. The OME-Zarr format splits data into more manageable, performant chunks enabling streaming-based access, and unifies important metadata such as multiresolution pyramid descriptions. The file format is designed for centralized and remote storage (e.g., cloud storage or file system) and is therefore ideal for sharing large data. By coalescing on a common, community-wide format, these benefits will expand as ever more data is made available to the scientific community.
EM 卷的不断增大给可发现、可访问、可互操作和可重复使用(FAIR)的共享带来了巨大的障碍。对于大型数据集,存储、共享、可视化和处理都是具有挑战性的。在这里,我们讨论了最近朝着标准化存储体积电子显微镜(vEM)数据的发展方向,该方向解决了研究人员面临的许多问题。OME-Zarr 格式将数据分割成更易于管理、性能更高的块,从而实现基于流的访问,并统一了重要的元数据,如多分辨率金字塔描述。该文件格式专为集中式和远程存储(例如,云存储或文件系统)而设计,因此非常适合共享大型数据。通过共同采用通用的、社区范围的格式,随着越来越多的数据可供科学界使用,这些好处将不断扩大。