Hong Aaron, Oliva Marco, Köppl Dominik, Bannai Hideo, Boucher Christina, Gagie Travis
Department of Computer and Information Science and Engineering University of Florida, Gainesville, 32611, Florida, USA.
Faculty of Engineering, University of Yamanashi, Kōfu, 400-8510, Japan.
Res Sq. 2023 Oct 30:rs.3.rs-3487536. doi: 10.21203/rs.3.rs-3487536/v1.
FM-indexes are a crucial data structure in DNA alignment, but searching with them usually takes at least one random access per character in the query pattern. Ferragina and Fischer [1] observed in 2007 that word-based indexes often use fewer random accesses than character-based indexes, and thus support faster searches. Since DNA lacks natural word-boundaries, however, it is necessary to parse it somehow before applying word-based FM-indexing. Last year, Deng et al. [2] proposed parsing genomic data by induced suffix sorting, and showed the resulting word-based FM-indexes support faster counting queries than standard FM-indexes when patterns are a few thousand characters or longer. In this paper we show that using prefix-free parsing-which takes parameters that let us tune the average length of the phrases-instead of induced suffix sorting, gives a significant speedup for patterns of only a few hundred characters. We implement our method and demonstrate it is between 3 and 18 times faster than competing methods on queries to GRCh38, and is consistently faster on queries made to 25,000, 50,000 and 100,000 SARS-CoV-2 genomes. Hence, it seems our method accelerates the performance of count over all state-of-the-art methods with a minor increase in the memory. The source code for PFP-FM is available at https://github.com/marco-oliva/afm.
FM索引是DNA比对中的一种关键数据结构,但使用它们进行搜索通常在查询模式中每个字符至少需要一次随机访问。费拉吉纳和菲舍尔[1]在2007年观察到,基于单词的索引通常比基于字符的索引使用更少的随机访问,因此支持更快的搜索。然而,由于DNA缺乏自然的单词边界,在应用基于单词的FM索引之前,有必要以某种方式对其进行解析。去年,邓等人[2]提出通过诱导后缀排序来解析基因组数据,并表明当模式为几千个字符或更长时,由此产生的基于单词的FM索引比标准FM索引支持更快的计数查询。在本文中,我们表明使用无前缀解析(它采用参数,使我们能够调整短语的平均长度)而不是诱导后缀排序,对于只有几百个字符的模式能显著加快速度。我们实现了我们的方法,并证明在对GRCh38的查询中,它比竞争方法快3到18倍,并且在对25000、50000和100000个SARS-CoV-2基因组的查询中始终更快。因此,我们的方法似乎在内存略有增加的情况下,加速了所有现有技术方法的计数性能。PFP-FM的源代码可在https://github.com/marco-oliva/afm获取。