Modern systems, such as Hadoop Distributed File System (HDFS), are primarily designed for large datasets and are often burdened by the metadata overhead when managing vast numbers of small files.

DeepSeek has released the Fire-Flyer File System (3FS), an open source project that is a parallel file system that improves the efficiency of AI training and inference performance.