Heinz College, Carnegie Mellon University, United States.
Computer Science, University of Manitoba, Canada.
Comput Methods Programs Biomed. 2018 Oct;165:129-137. doi: 10.1016/j.cmpb.2018.08.007. Epub 2018 Aug 16.
Cloud computing plays a vital role in big data science with its scalable and cost-efficient architecture. Large-scale genome data storage and computations would benefit from using these latest cloud computing infrastructures, to save cost and speedup discoveries. However, due to the privacy and security concerns, data owners are often disinclined to put sensitive data in a public cloud environment without enforcing some protective measures. An ideal solution is to develop secure genome database that supports encrypted data deposition and query.
Nevertheless, it is a challenging task to make such a system fast and scalable enough to handle real-world demands providing data security as well. In this paper, we propose a novel, secure mechanism to support secure count queries on an open source graph database (Neo4j) and evaluated the performance on a real-world dataset of around 735,317 Single Nucleotide Polymorphisms (SNPs). In particular, we propose a new tree indexing method that offers constant time complexity (proportion to the tree depth), which was the bottleneck of existing approaches.
The proposed method significantly improves the runtime of query execution compared to the existing techniques. It takes less than one minute to execute an arbitrary count query on a dataset of 212 GB, while the best-known algorithm takes around 7 min.
The outlined framework and experimental results show the applicability of utilizing graph database for securely storing large-scale genome data in untrusted environment. Furthermore, the crypto-system and security assumptions underlined are much suitable for such use cases which be generalized in future work.
云计算以其可扩展和经济高效的架构在大数据科学中发挥着至关重要的作用。利用这些最新的云计算基础设施进行大规模基因组数据存储和计算,可以节省成本并加速发现。然而,由于隐私和安全问题,数据所有者往往不愿意在没有采取一些保护措施的情况下将敏感数据放在公共云环境中。理想的解决方案是开发支持加密数据存储和查询的安全基因组数据库。
然而,要使这样的系统足够快速和可扩展,以处理现实世界的需求并提供数据安全性,这是一项具有挑战性的任务。在本文中,我们提出了一种新颖的安全机制,用于在开源图数据库(Neo4j)上支持安全计数查询,并在大约 735317 个单核苷酸多态性(SNP)的真实数据集上评估了性能。特别是,我们提出了一种新的树索引方法,该方法提供了固定的时间复杂度(与树的深度成比例),这是现有方法的瓶颈。
与现有技术相比,所提出的方法显著提高了查询执行的运行时。在 212GB 的数据集上执行任意计数查询不到一分钟,而最知名的算法大约需要 7 分钟。
所概述的框架和实验结果表明,在不可信环境中利用图数据库安全存储大规模基因组数据是可行的。此外,所强调的加密系统和安全假设非常适合这种用例,可以在未来的工作中进行推广。