Menu

High Performance Metadata Integrity Protection in the WAFL Copy-on-Write File System

Date

February 25, 2017

Author

Harendra Kumar; Yuvraj Patel, University of Wisconsin—Madison; Ram Kesavan and Sumith Makam, NetApp

15th USENIX Conference on File and Storage Technologies (FAST 2017) Feb. 27 - March 2, 2017 Santa Clara, CA.

We introduce a low-cost incremental checksum technique that protects metadata blocks against in-memory scribbles, and a lightweight digest-based transaction auditing mechanism that enforces file system consistency invariants. Compared with previous work, our techniques reduce performance overhead by an order of magnitude. They also help distinguish scribbles from logic bugs. We also present a mechanism to pinpoint the cause of scribbles on production systems. Our techniques have been productized in the NetApp® WAFL® (Write Anywhere File Layout) file system with negligible performance overhead, greatly reducing corruption-related incidents over the past five years, based on millions of runtime hours.

Resources

The definitive version of the paper can be found at: https://www.usenix.org/conference/fast17/technical-sessions/presentation/kumar.