July 21, 2009, 9:09 am
Given the size of today‚Äôs hard drives, a question often asked is how to create and manage large file systems. Many times, this question is asked around ext3 which can be fairly limiting in size. The corollary to this question is how one manages large file systems. In this article, an approach to creating file systems using the concepts of ChunkFS will be presented. In particular, UnionFS will be used to create a large file system from ‚Äúchunks‚Äù using UnionFS and at the same time helps with check and repair times.
Everyone has seen the reports about the huge explosion of data. While this article isn‚Äôt intended to present the data around this explosion, it is important to understand that data storage is growing at a huge rate. In July 2006 IBM Global Technology Services published a seminal paper entitled ‚ÄúThe Toxic Terabyte...‚Äù