Title: Research on cloud storage biological data deduplication method based on Simhash algorithm

Authors: Haijuan Du

Addresses: School of Information Science and Engineering, Jiaxing University, Jia'xing, 314001, China

Abstract: Aiming at the problems of high duplication error, low data similarity accuracy and poor throughput in cloud storage biological data deduplication, a cloud storage biological data deduplication method based on Simhash algorithm is designed. First, we analyse the cloud storage mode, characteristics and advantages of biological data, and determine the distribution rule of biological data in cloud storage. Then, K-nearest neighbour algorithm and Bayesian algorithm are used to extract the features of cloud storage biological data. Finally, Simhash algorithm is introduced to map the data into digital signatures that are longer than specialty to the maximum extent; digital signatures of different dimensions after cloud storage biological data mapping is set, the similarity of biological data signature bit values is determined, and duplication removal is completed. The results show that the proposed method has lower error and is feasible.

Keywords: Simhash algorithm; cloud storage; biological data; deduplication method; K-nearest neighbour algorithm; Bayesian algorithm; digital signature.

DOI: 10.1504/IJDMB.2023.134296

International Journal of Data Mining and Bioinformatics, 2023 Vol.27 No.4, pp.252 - 266

Received: 28 Dec 2022
Accepted: 19 Jun 2023
Published online: 17 Oct 2023 *