filesystem showdown: what a difference a decade makes
TRANSCRIPT
![Page 1: Filesystem Showdown: What a Difference a Decade Makes](https://reader031.vdocuments.site/reader031/viewer/2022030318/5a678e487f8b9a2f638b4b0b/html5/thumbnails/1.jpg)
Filesystem ShowdownWhat a difference a decade makes
Matt Janulewicz & Steve OddoDolby Labs
![Page 2: Filesystem Showdown: What a Difference a Decade Makes](https://reader031.vdocuments.site/reader031/viewer/2022030318/5a678e487f8b9a2f638b4b0b/html5/thumbnails/2.jpg)
2
The Problem
Perforce on Solaris is sunsetting
Standardizing on Linux
• Which filesystem?
Previous Merge presentations a decade old
Perforce has recommendations, no numbers
![Page 3: Filesystem Showdown: What a Difference a Decade Makes](https://reader031.vdocuments.site/reader031/viewer/2022030318/5a678e487f8b9a2f638b4b0b/html5/thumbnails/3.jpg)
3
The Methodology
Standard Perforce branch-submit benchmark
Test on same physical hardware (retired master)
Use out-of-the-box settings (aside from compression)
Include Windows
Software RAID drives (lvm, ZFS, BTRFS, Windows volume)
Run tests five times, chart average
![Page 4: Filesystem Showdown: What a Difference a Decade Makes](https://reader031.vdocuments.site/reader031/viewer/2022030318/5a678e487f8b9a2f638b4b0b/html5/thumbnails/4.jpg)
4
The System
Master server retired in March 2015
• 2 physical processors (Intel Xeon 2.2 Ghz)
• 16 cores (8 per CPU)
• 512 GB memory
Ten SAS drives
• 3 TB each
• Samsung 7200 RPM 6 Gbps
P4D 2015.1
![Page 5: Filesystem Showdown: What a Difference a Decade Makes](https://reader031.vdocuments.site/reader031/viewer/2022030318/5a678e487f8b9a2f638b4b0b/html5/thumbnails/5.jpg)
5
Filesystems and OS’s
Solaris 11 x86_64
• ZFS (uncompressed/compressed lzjb)
RedHat Linux 7.2
• ZFS (uncompressed/compressed lzjb)
• Ext3/Ext4
• Xfs
• BTRFS (uncompressed/compressed lzo/compressed zlib)
Windows Server 2012R2
• NTFS/ReFS
![Page 6: Filesystem Showdown: What a Difference a Decade Makes](https://reader031.vdocuments.site/reader031/viewer/2022030318/5a678e487f8b9a2f638b4b0b/html5/thumbnails/6.jpg)
6
Datasets
Branch-Submit
• ftp://ftp.perforce.com/perforce/tools/benchmarks/datasets/reference01.2015.1.ckp.gz
Miscellaneous Tests
• changes 6,478
• files 4,200,348
• revisions 5,658,595
• Integs 15,434,516
• total size 112 GB
![Page 7: Filesystem Showdown: What a Difference a Decade Makes](https://reader031.vdocuments.site/reader031/viewer/2022030318/5a678e487f8b9a2f638b4b0b/html5/thumbnails/7.jpg)
7
Results (Benchmark)
Winner: XFS
Honorable Mention:BTRFS-compressed, BTRFS-uncompressed, ext3
Running Tally:
XFS: 1.0BTRFS-c: 0.5BTRFS-u: 0.5ext3: 0.5
![Page 8: Filesystem Showdown: What a Difference a Decade Makes](https://reader031.vdocuments.site/reader031/viewer/2022030318/5a678e487f8b9a2f638b4b0b/html5/thumbnails/8.jpg)
8
Results (Benchmark)
Winner: BTRFS-c
Honorable Mention:BTRFS-u, XFS, ext4, ext3
Running Tally:
XFS: 1.5BTRFS-c: 1.5BTRFS-u: 1.0ext3: 1.0ext4: 0.5
![Page 9: Filesystem Showdown: What a Difference a Decade Makes](https://reader031.vdocuments.site/reader031/viewer/2022030318/5a678e487f8b9a2f638b4b0b/html5/thumbnails/9.jpg)
9
Results (Benchmark)
Winner: BTRFS, ZFS-l
Honorable Mention:XFS, ext4, ext3
Running Tally:
BTRFS-c: 2.5XFS: 2.0BTRFS-u: 2.0ext3: 1.5ext4: 1.0ZFS-l: 1.0
![Page 10: Filesystem Showdown: What a Difference a Decade Makes](https://reader031.vdocuments.site/reader031/viewer/2022030318/5a678e487f8b9a2f638b4b0b/html5/thumbnails/10.jpg)
10
Results (Benchmark)
Winner: ZFS-l
Honorable Mention:BTRFS-u, BTRFS-c
Running Tally:
BTRFS-c: 3.0BTRFS-u: 2.5XFS: 2.0ZFS-l: 2.0ext3: 1.5ext4: 1.0
![Page 11: Filesystem Showdown: What a Difference a Decade Makes](https://reader031.vdocuments.site/reader031/viewer/2022030318/5a678e487f8b9a2f638b4b0b/html5/thumbnails/11.jpg)
11
Results (Benchmark)
Winner: XFS, ext4
Honorable Mention:Ext3, BTRFS-c, BTRFS-u
Running Tally:
BTRFS-c: 3.5XFS: 3.0BTRFS-u: 3.0ext4: 2.0ZFS-l: 2.0ext3: 1.5
![Page 12: Filesystem Showdown: What a Difference a Decade Makes](https://reader031.vdocuments.site/reader031/viewer/2022030318/5a678e487f8b9a2f638b4b0b/html5/thumbnails/12.jpg)
12
Results (Benchmark)
Winner: XFS, ext4
Honorable Mention:Ext3, BTRFS-c, BTRFS-u
Running Tally:
XFS: 4.0BTRFS-c: 4.0BTRFS-u: 3.5ext4: 3.0ext3: 2.0ZFS-l: 2.0
![Page 13: Filesystem Showdown: What a Difference a Decade Makes](https://reader031.vdocuments.site/reader031/viewer/2022030318/5a678e487f8b9a2f638b4b0b/html5/thumbnails/13.jpg)
13
Results (Miscellaneous)
Winner: ext3, BTRFS-u, BTRFS-c, ext4, XFS
Honorable Mention:
Running Tally:
XFS: 5.0BTRFS-c: 5.0BTRFS-u: 4.5ext4: 4.0ext3: 3.0ZFS-l: 2.0
![Page 14: Filesystem Showdown: What a Difference a Decade Makes](https://reader031.vdocuments.site/reader031/viewer/2022030318/5a678e487f8b9a2f638b4b0b/html5/thumbnails/14.jpg)
14
Results (Miscellaneous)
Winner: ext3, BTRFS-u, BTRFS-c, ext4, XFS
Honorable Mention:
Running Tally:
XFS: 6.0BTRFS-c: 6.0BTRFS-u: 5.5ext4: 5.0ext3: 4.0ZFS-l: 2.0
![Page 15: Filesystem Showdown: What a Difference a Decade Makes](https://reader031.vdocuments.site/reader031/viewer/2022030318/5a678e487f8b9a2f638b4b0b/html5/thumbnails/15.jpg)
15
Results (Miscellaneous)
Winner: BTRFS-c
Honorable Mention:BTRFS-u, ext3
Running Tally:
BTRFS-c: 7.0XFS: 6.0BTRFS-u: 5.5ext4: 5.0ext3: 4.5ZFS-l: 2.0
![Page 16: Filesystem Showdown: What a Difference a Decade Makes](https://reader031.vdocuments.site/reader031/viewer/2022030318/5a678e487f8b9a2f638b4b0b/html5/thumbnails/16.jpg)
16
Results (Miscellaneous)
Winner: BTRFS-u
Honorable Mention:BTRFS-c, ext3, ZFS-l
Running Tally:
BTRFS-c: 7.5BTRFS-u: 6.5XFS: 6.0ext3: 5.0ext4: 5.0ZFS-l: 2.5
![Page 17: Filesystem Showdown: What a Difference a Decade Makes](https://reader031.vdocuments.site/reader031/viewer/2022030318/5a678e487f8b9a2f638b4b0b/html5/thumbnails/17.jpg)
17
Results (Miscellaneous)
Winner: XFS, ext4
Honorable Mention:BTRFS-c, BTRFS-u, ext3
Running Tally:
BTRFS-c: 8.0XFS: 7.0BTRFS-u: 7.0ext3: 5.5ext4: 5.0ZFS-l: 2.5
![Page 18: Filesystem Showdown: What a Difference a Decade Makes](https://reader031.vdocuments.site/reader031/viewer/2022030318/5a678e487f8b9a2f638b4b0b/html5/thumbnails/18.jpg)
Poor Performers: Windows, ZFS
Better Performers: Linux (anything)
![Page 19: Filesystem Showdown: What a Difference a Decade Makes](https://reader031.vdocuments.site/reader031/viewer/2022030318/5a678e487f8b9a2f638b4b0b/html5/thumbnails/19.jpg)
19
Final Thoughts
Windows performs generally worse when compared to almost any Linux filesystem.
XFS is a solid choice. Supported, mature, fast.
BTRFS compressed vs uncompressed not hugely different.
Ext3 holds up surprisingly well. Go figure.
![Page 20: Filesystem Showdown: What a Difference a Decade Makes](https://reader031.vdocuments.site/reader031/viewer/2022030318/5a678e487f8b9a2f638b4b0b/html5/thumbnails/20.jpg)
20
Questions For You
Are ZFS features worth the performance hit? (likely)
Is BTRFS ready for primetime? (perhaps)
Is Windows performance poor enough to justify introducing Linux into your data center? (yes, yes it is)
![Page 21: Filesystem Showdown: What a Difference a Decade Makes](https://reader031.vdocuments.site/reader031/viewer/2022030318/5a678e487f8b9a2f638b4b0b/html5/thumbnails/21.jpg)
Contact us for raw data or further questions.