Efficient index lookup for De-duplication backup system

Youjip Won, Jongmyeong Ban, Jaehong Min, Jungpil Hur, Sangkyu Oh, Jangsun Lee

Research output: Chapter in Book/Report/Conference proceedingConference contribution

11 Scopus citations

Abstract

We minimizes fingerprint management overhead(index lookup and index insert) via introducing main memory index lookup structure and workload-aware index partitioning of the index file in the storage. Backup server maintains three data structures for redundancy elimination: Header files, chunk files and fingerprint tables. These data structures altogether enables PRUNE to effectively eliminate redundancy and to perform efficient backup. We perform various experiment to measure the overhead of each tasks in backup operation and to examine the efficiency of redundancy elimination. Incremental modulo-K reduces the file chunking latency by approximately 60%. With filter based in-memory index data structure and index partitioning, PRUNE eliminates 99.4% of disk accesses involved in fingerprint management.

Original languageEnglish
Title of host publication2008 IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, MASCOTS
DOIs
Publication statusPublished - 2008 Dec 1
Event2008 IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, MASCOTS - Baltimore, MD, United States
Duration: 2008 Sep 82008 Sep 20

Publication series

Name2008 IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, MASCOTS

Other

Other2008 IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, MASCOTS
CountryUnited States
CityBaltimore, MD
Period08/09/808/09/20

    Fingerprint

Cite this

Won, Y., Ban, J., Min, J., Hur, J., Oh, S., & Lee, J. (2008). Efficient index lookup for De-duplication backup system. In 2008 IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, MASCOTS [4770594] (2008 IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, MASCOTS). https://doi.org/10.1109/MASCOT.2008.4770594