Welcome to ChubaoFS(Chubao File System)

Getting Started

• Introduction
  • High Level Architecture
  • Features
• Quick Start Guide
  • Building
  • Deployment
  • Mount Client
  • Upgrading

Design Documentation

• Resource Manager (Master)
  • Utilization-Based Distribution/Placement
  • Replica Placement
  • Meta Partition Splitting
  • Exception Handling
• Metadata Subsystem
  • Internal Structure
  • Replication
  • Failure Recovery
• Data Subsystem
  • Features
  • HTTP APIs
• Object Subsystem (ObjectNode)
  • Structure
  • Features
  • Semantic Transform
  • Authentication
  • Invisible Temporary Data
  • Object Key Conflict (Important)
  • Supported S3-Compatible APIs
  • Supported SDKs
• Client
  • Client Caching
  • Integration with FUSE
• Authnode
  • Security Problems
  • High Level Architecture
  • Future Work

User Documentation

• Resource Manager (Master)
  • Features
  • Configurations
  • Start Service
• Meta Subsystem
• Data Subsystem
  • How To Start DataNode
  • Configurations
• Object Subsystem (ObjectNode)
  • How To Provide Object Storage Service with Object Subsystem (ObjectNode)
  • Configurations
  • Fetch Authentication Keys
  • Using Object Storage Interface
• Client
  • Prerequisite
  • Prepare Config File
  • Mount
• Authnode
  • Concepts
  • Client Tool
  • AuthNode Configurations
  • Steps for Starting ChubaoFS with AuthNode
  • Generate Certificate
• Monitor
• Tune FUSE Performance
  • Fetch Linux kernel source code
  • Optimize FUSE linux kernel module
  • Build against current running Linux kernel
  • Install kernel module
• Docker

Administration

• Resource Manager (Master) API
  • Cluster
  • Metanode Related
  • Datanode Related
  • Volume
  • Meta Partition
  • Data Partition
  • Master Management
• Meta Node API
  • Meta Partition
  • Inode
  • Dentry

use case

• Use Cases
  • Machine Learning
  • ElasticSearch
  • Nginx Log Storage
  • Spark
  • MySQL Database Backup

Evaluation

• Performance
  • Environment
  • Small File Performance and Scalability
  • IO Performance and Scalability
    • 1. Sequential Read
    • 2. Sequential Write
    • 3. Random Read
    • 4. Random Write
  • Metadata Performance and Scalability
• Integrity
• Workload
• Scalability

Contributing

• Contributing to ChubaoFS
  • Bug Reports
  • Patch Guidelines
  • Credits

FAQ

• FAQ
  • How does ChubaoFS compare with its alternatives ?