Effect of timer interrupt interval on file system synchronization overhead

Hankeun Son, Seongjin Lee, Youjip Won

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

File system metadata is indispensable in both describing the data and maintaining the file system. Despite the importance of metadata in the file system, the overhead of maintaining the metadata cannot be taken lightly. It is because the metadata also have to be persisted on the storage device and it consumes IO bandwidth as well as creates journaling overhead. In this paper, we find that the random write with synchronous performance of a storage is significantly affected by not only the hardware performance but also timer interrupt interval of the kernel. Extending the timer interrupt interval allows reducing the write volume and increasing the random write followed by fsync() performance of EXT4 file system. We propose intermittent mtime timestamp update on Coarse grain mtime interval instead of Fine grain mtime interval. The experiment results with mtime update interval of 1 second show that the total write volume is decreased by 75% and 28%, respectively compared to total write volume of 1 ms and 10 ms mtime interval, and the throughput increased 3.1× and 1.2× compared to 1 ms and 10 ms mtime interval. Coarse grain mtime update is resolve to the journaling overhead issues while still logging mtime timestamp.

Original languageEnglish
Title of host publicationProceedings of 2016 5th International Conference on Network Infrastructure and Digital Content, IEEE IC-NIDC 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages99-102
Number of pages4
ISBN (Electronic)9781509012459
DOIs
StatePublished - 2017 Jul 10
Event5th International Conference on Network Infrastructure and Digital Content, IEEE IC-NIDC 2016 - Beijing, China
Duration: 2016 Sep 232016 Sep 25

Other

Other5th International Conference on Network Infrastructure and Digital Content, IEEE IC-NIDC 2016
CountryChina
CityBeijing
Period16/09/2316/09/25

Fingerprint

Metadata
Synchronization
Throughput
Hardware
Bandwidth
Experiments

Keywords

  • EXT4 file system
  • Journaling overhead
  • Kernel timer interrupt
  • mtime
  • Random write

Cite this

Son, H., Lee, S., & Won, Y. (2017). Effect of timer interrupt interval on file system synchronization overhead. In Proceedings of 2016 5th International Conference on Network Infrastructure and Digital Content, IEEE IC-NIDC 2016 (pp. 99-102). [7974543] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICNIDC.2016.7974543
Son, Hankeun ; Lee, Seongjin ; Won, Youjip. / Effect of timer interrupt interval on file system synchronization overhead. Proceedings of 2016 5th International Conference on Network Infrastructure and Digital Content, IEEE IC-NIDC 2016. Institute of Electrical and Electronics Engineers Inc., 2017. pp. 99-102
@inproceedings{8a2b24e9abf744569da35dba3212db1b,
title = "Effect of timer interrupt interval on file system synchronization overhead",
abstract = "File system metadata is indispensable in both describing the data and maintaining the file system. Despite the importance of metadata in the file system, the overhead of maintaining the metadata cannot be taken lightly. It is because the metadata also have to be persisted on the storage device and it consumes IO bandwidth as well as creates journaling overhead. In this paper, we find that the random write with synchronous performance of a storage is significantly affected by not only the hardware performance but also timer interrupt interval of the kernel. Extending the timer interrupt interval allows reducing the write volume and increasing the random write followed by fsync() performance of EXT4 file system. We propose intermittent mtime timestamp update on Coarse grain mtime interval instead of Fine grain mtime interval. The experiment results with mtime update interval of 1 second show that the total write volume is decreased by 75{\%} and 28{\%}, respectively compared to total write volume of 1 ms and 10 ms mtime interval, and the throughput increased 3.1× and 1.2× compared to 1 ms and 10 ms mtime interval. Coarse grain mtime update is resolve to the journaling overhead issues while still logging mtime timestamp.",
keywords = "EXT4 file system, Journaling overhead, Kernel timer interrupt, mtime, Random write",
author = "Hankeun Son and Seongjin Lee and Youjip Won",
year = "2017",
month = "7",
day = "10",
doi = "10.1109/ICNIDC.2016.7974543",
language = "English",
pages = "99--102",
booktitle = "Proceedings of 2016 5th International Conference on Network Infrastructure and Digital Content, IEEE IC-NIDC 2016",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

Son, H, Lee, S & Won, Y 2017, Effect of timer interrupt interval on file system synchronization overhead. in Proceedings of 2016 5th International Conference on Network Infrastructure and Digital Content, IEEE IC-NIDC 2016., 7974543, Institute of Electrical and Electronics Engineers Inc., pp. 99-102, 5th International Conference on Network Infrastructure and Digital Content, IEEE IC-NIDC 2016, Beijing, China, 16/09/23. https://doi.org/10.1109/ICNIDC.2016.7974543

Effect of timer interrupt interval on file system synchronization overhead. / Son, Hankeun; Lee, Seongjin; Won, Youjip.

Proceedings of 2016 5th International Conference on Network Infrastructure and Digital Content, IEEE IC-NIDC 2016. Institute of Electrical and Electronics Engineers Inc., 2017. p. 99-102 7974543.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Effect of timer interrupt interval on file system synchronization overhead

AU - Son, Hankeun

AU - Lee, Seongjin

AU - Won, Youjip

PY - 2017/7/10

Y1 - 2017/7/10

N2 - File system metadata is indispensable in both describing the data and maintaining the file system. Despite the importance of metadata in the file system, the overhead of maintaining the metadata cannot be taken lightly. It is because the metadata also have to be persisted on the storage device and it consumes IO bandwidth as well as creates journaling overhead. In this paper, we find that the random write with synchronous performance of a storage is significantly affected by not only the hardware performance but also timer interrupt interval of the kernel. Extending the timer interrupt interval allows reducing the write volume and increasing the random write followed by fsync() performance of EXT4 file system. We propose intermittent mtime timestamp update on Coarse grain mtime interval instead of Fine grain mtime interval. The experiment results with mtime update interval of 1 second show that the total write volume is decreased by 75% and 28%, respectively compared to total write volume of 1 ms and 10 ms mtime interval, and the throughput increased 3.1× and 1.2× compared to 1 ms and 10 ms mtime interval. Coarse grain mtime update is resolve to the journaling overhead issues while still logging mtime timestamp.

AB - File system metadata is indispensable in both describing the data and maintaining the file system. Despite the importance of metadata in the file system, the overhead of maintaining the metadata cannot be taken lightly. It is because the metadata also have to be persisted on the storage device and it consumes IO bandwidth as well as creates journaling overhead. In this paper, we find that the random write with synchronous performance of a storage is significantly affected by not only the hardware performance but also timer interrupt interval of the kernel. Extending the timer interrupt interval allows reducing the write volume and increasing the random write followed by fsync() performance of EXT4 file system. We propose intermittent mtime timestamp update on Coarse grain mtime interval instead of Fine grain mtime interval. The experiment results with mtime update interval of 1 second show that the total write volume is decreased by 75% and 28%, respectively compared to total write volume of 1 ms and 10 ms mtime interval, and the throughput increased 3.1× and 1.2× compared to 1 ms and 10 ms mtime interval. Coarse grain mtime update is resolve to the journaling overhead issues while still logging mtime timestamp.

KW - EXT4 file system

KW - Journaling overhead

KW - Kernel timer interrupt

KW - mtime

KW - Random write

UR - http://www.scopus.com/inward/record.url?scp=85027518349&partnerID=8YFLogxK

U2 - 10.1109/ICNIDC.2016.7974543

DO - 10.1109/ICNIDC.2016.7974543

M3 - Conference contribution

AN - SCOPUS:85027518349

SP - 99

EP - 102

BT - Proceedings of 2016 5th International Conference on Network Infrastructure and Digital Content, IEEE IC-NIDC 2016

PB - Institute of Electrical and Electronics Engineers Inc.

ER -

Son H, Lee S, Won Y. Effect of timer interrupt interval on file system synchronization overhead. In Proceedings of 2016 5th International Conference on Network Infrastructure and Digital Content, IEEE IC-NIDC 2016. Institute of Electrical and Electronics Engineers Inc. 2017. p. 99-102. 7974543 https://doi.org/10.1109/ICNIDC.2016.7974543