ReiserFS

ReiserFS is a general-purpose, journaled computer file system initially designed and implemented by a team at Namesys led by Hans Reiser. ReiserFS is currently supported on Linux (without quota support) licensed as GPLv2. Introduced in version 2.4.1 of the Linux kernel, it was the first journaling file system to be included in the standard kernel. ReiserFS was the default file system in Novell's SUSE Linux Enterprise until Novell decided to move to ext3 on October 12, 2006 for future releases.[3]

Not to be confused with ReFS.
This article is about ReiserFS version 3. For version 4, see Reiser4.
ReiserFS 3.6
Developer(s)Namesys
Full nameReiserFS
Introduced2001 (2001) with Linux 2.4.1
Partition identifierApple_UNIX_SVR2 (Apple Partition Map)
0x83 (MBR)
EBD0A0A2-B9E5-4433-87C0-68B6B72699C7 (GPT)
Structures
Directory contentsB+ tree
File allocationBitmap[1]
Limits
Max. volume size16 TiB[2]
Max. file size1 EiB (8 TiB on 32 bit systems)[2]
Max. number of files232−3 (~4 billion)[2]
Max. filename length4032 bytes, limited to 255 by Linux VFS
Allowed characters in filenamesAll bytes except NUL and '/'
Features
Dates recordedmodification (mtime), metadata change (ctime), access (atime)
Date rangeDecember 14, 1901 – January 18, 2038
Date resolution1 s
ForksExtended attributes
File system permissionsUnix permissions, ACLs and arbitrary security attributes
Transparent compressionNo
Transparent encryptionNo
Other
Supported operating systemsLinux, ReactOS

Namesys considered ReiserFS version 3.6 which introduced a new on-disk format allowing bigger filesizes, now occasionally referred to as Reiser3, as stable and feature-complete and, with the exception of security updates and critical bug fixes, ceased development on it to concentrate on its successor, Reiser4. Namesys went out of business in 2008 after Reiser's conviction for murder. The product is now maintained as open source by volunteers.[4] The reiserfsprogs 3.6.27 were released on 25 July 2017.[5]

Features

At the time of its introduction, ReiserFS offered features that had not been available in existing Linux file systems:

  • Metadata-only journaling (also block journaling, since Linux 2.6.8), its most-publicized advantage over what was the stock Linux file system at the time, ext2.
  • Online resizing (growth only), with or without an underlying volume manager such as LVM. Since then, Namesys has also provided tools to resize (both grow and shrink) ReiserFS file systems offline.
  • Tail packing, a scheme to reduce internal fragmentation. Tail packing can have a significant performance impact. Reiser4 may have improved this by packing tails where it does not negatively affect performance.[6]

Design

ReiserFS stores file metadata ("stat items"), directory entries ("directory items"), inode block lists ("indirect items"), and tails of files ("direct items") in a single, combined B+ tree keyed by a universal object ID. Disk blocks allocated to nodes of the tree are "formatted internal blocks". Blocks for leaf nodes (in which items are packed end-to-end) are "formatted leaf blocks". All other blocks are "unformatted blocks" containing file contents. Directory items with too many entries or indirect items which are too long to fit into a node spill over into the right leaf neighbour. Block allocation is tracked by free space bitmaps in fixed locations.

By contrast, ext2 and other Berkeley FFS-like file systems of that time simply used a fixed formula for computing inode locations, hence limiting the number of files they may contain.[7] Most such file systems also store directories as simple lists of entries, which makes directory lookups and updates linear time operations and degrades performance on very large directories. The single B+ tree design in ReiserFS avoids both of these problems due to better scalability properties.

Version history

Regarding the development of a filesystem, three fields have to be considered separately:

  • The on-disk format, thus the way data is structured on the media.
  • The implementation of the filesystem driver, which enables the operating system to read and write data.
  • The maintenance tools for creating, deleting, resizing, defragmenting and checking partitions on the media.

Therefore this section contains three tables: one for the 3.5.x series of the filesystem driver that was used to read and write the 3.5 on-disk format, another one for the 3.6.x series of the filsystem driver that is used to read and write the 3.6 on-disk format and a third one for the tools contained in the reiserfsprogs package.

Since the on-disk format 3.6 is regarded as feature complete and stable, it is frozen and doesn't get changed anymore. The filesystem driver for Linux, that is part of the official kernel as well as the reiserfsprogs operating in user space are still being maintained and getting updates (rarely also new features) even nowadays (as of 2019).

The defrag program was never fully implemented, although there were attempts up to the year 2014. One reason why it never was finished was the rise of solid state disks (SSD) which – contrary to the classic spinning wheel hard disk drives (HDD) – do not need to be defragmented, or more precisely: shouldn't be defragmented at all, as any unnecessary write operations will shorten the life of an SSD.

Performance

Compared with ext2 and ext3 in version 2.4 of the Linux kernel, when dealing with files under 4 KiB and with tail packing enabled, ReiserFS may[8] be faster. This was said to be of great benefit in Usenet news spools, HTTP caches, mail delivery systems, and other applications where performance with small files is critical. However, in practice news spools use a feature called cycbuf, which holds articles in one large file; fast HTTP caches and several revision control systems use a similar approach, nullifying these performance advantages. For email servers, ReiserFS was problematic due to semantic problems explained below. Also, ReiserFS had a problem with very fast filesystem aging when compared to other filesystems — in several usage scenarios filesystem performance decreased dramatically with time.

Before Linux 2.6.33,[9] ReiserFS heavily used the big kernel lock (BKL) — a global kernel-wide lock — which does not scale very well[10][11] for systems with multiple cores, as the critical code parts are only ever executed by one core at a time.

Usage

ReiserFS was the default file system in SuSE Linux since version 6.4 (released in 2000),[12][13] until switching to ext3 in SUSE Linux Enterprise 10.2/openSUSE 11, announced in 2006.[14][15]

Jeff Mahoney of SUSE wrote a post on 14 September 2006 proposing to move from ReiserFS to ext3 for the default installation file system.[10] Some reasons he mentioned were scalability, "performance problems with extended attributes and ACLs", "a small and shrinking development community", and that "Reiser4 is not an incremental update and requires a reformat, which is unreasonable for most people."[10] On October 4 he wrote a response comment on a blog in order to clear up some issues.[16] He wrote that his proposal for the switch was unrelated to Hans Reiser being under trial for murder.[17] Mahoney wrote he "was concerned that people would make a connection where none existed" and that "the timing is entirely coincidental and the motivation is unrelated."[16]

Criticism

Some directory operations (including unlink(2)) are not synchronous on ReiserFS, which can result in data corruption with applications relying heavily on file-based locks (such as mail transfer agents qmail[18] and Postfix[19]) if the machine halts before it has synchronized the disk.[20]

There are no programs to specifically defragment a ReiserFS file system, although tools have been written to automatically copy the contents of fragmented files hoping that more contiguous blocks of free space can be found. However, a "repacker" tool was planned for the next Reiser4 file system to deal with file fragmentation.[21] With the rise of Solid State Disks this problem became irrelevant as contrary to Hard Disk Drives there is no slow down caused by fragmentation as SSDs don't use any moving parts. It is even recommended to abstain from any kind of defragmentation on SSDs because it will shorten their lifetime.

fsck

The tree rebuild process of ReiserFS's fsck has attracted much criticism by the *nix community: If the file system becomes so badly corrupted that its internal tree is unusable, performing a tree rebuild operation may further corrupt existing files or introduce new entries with unexpected contents,[22] but this action is not part of normal operation or a normal file system check and has to be explicitly initiated and confirmed by the administrator.

ReiserFS v3 images should not be stored on a ReiserFS v3 partition (e.g., backups or disk images for emulators) without transforming them (e.g., by compressing or encrypting) in order to avoid confusing the rebuild. Reformatting an existing ReiserFS v3 partition can also leave behind data that could confuse the rebuild operation and make files from the old system reappear. This also allows malicious users to intentionally store files that will confuse the rebuilder. As the metadata is always in a consistent state after a file system check, corruption here means that contents of files are merged in unexpected ways with the contained file system's metadata. The ReiserFS successor, Reiser4, fixes this problem.

Earlier issues

ReiserFS in versions of the Linux kernel before 2.4.16 were considered unstable by Namesys and not recommended for production use, especially in conjunction with NFS.[23]

Early implementations of ReiserFS (prior to that in Linux 2.6.2) were also susceptible to out-of-order write hazards. But the current journaling implementation in ReiserFS is now on par with that of ext3's "ordered" journaling level.

See also

References
  1. Reiser FS node layout, Namesys, archived from the original on 2006-06-14
  2. "Reiser FS Specifications", FAQ, Namesys, archived from the original on 2006-07-05
  3. Shankland, Stephen (2006-10-16). "Novell makes file storage software shift". Business Tech. cnet..
  4. Shankland, Stephen (January 16, 2008). "Namesys vanishes, but Reiser project lives on". CNet. Archived from the original on March 27, 2016. Retrieved 2008-01-26.
  5. ""Fossies" - the Fresh Open Source Software Archive". July 25, 2017. Retrieved 2019-07-25.
  6. Reiser, Hans. "Reiser4 is released!". Archived from the original on 2007-10-24. Retrieved 2006-07-15.
  7. Mingming Cao, Theodore Y. Ts'o, Badari Pulavarty, Suparna Bhattacharya (2005-07-26). "State of the Art: Where we are with the Ext3 file system". 2005 Linux Symposium. Ottawa, Canada: IBM Linux Technology Center. Retrieved 2007-03-08.CS1 maint: multiple names: authors list (link)
  8. "PHP Manual". php.net. The PHP Group. Retrieved 5 December 2018.
  9. "kill-the-BKL". git.kernel.org.
  10. Jeff Mahoney (2006-09-14). "Proposal: Change in default fs for releases >= 10.2". gmane.org. Retrieved 2009-08-23..
  11. discussion thread stored at gmane.org
  12. "Archive:SuSE Linux 6.4". openSUSE wiki. Retrieved 2017-06-28.
  13. "SUSE LINUX 9.1 Administration Guide: Major File Systems in Linux". Novell. Retrieved 2017-06-28.
  14. Shankland, Stephen (16 October 2006). "Novell makes file storage software shift". CNET.
  15. Sharma, Mayank (12 October 2006). "Novell will switch from ReiserFS to ext3". Linux.com.
  16. comment by Jeff Mahoney (2006-10-04). "SUSE 10.2 Ditching ReiserFS as its' default FS? (comment 29)". linux.wordpress.com / archive.org. Archived from the original on 2006-11-09. Retrieved 2009-08-23.
  17. CBS 5 / AP / BCN (2006-09-14). "Oakland Police Search Home Of Missing Woman's Ex". cbs5.com / archive.org. Archived from the original on 2006-11-06. Retrieved 2009-08-23.
  18. Daniel Robbins (2001), "Advanced file system implementor's guide". Retrieved 5. July 2006
  19. Matthias Andree (2001), LKML post on Postfix synchronity assumptions. Retrieved 15. July 2006
  20. NEOHAPSIS - Peace of Mind Through Integrity and Insight
  21. Hans Reiser, Reiser4 design, repacker Archived 2007-10-24 at the Wayback Machine. Retrieved 5. July 2006
  22. Theodore Ts'o LKML post. Retrieved 5. July 2006
  23. ReiserFS download page, see warning. Retrieved 5. July 2006
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.