面向自动驾驶与物理 AI 的开源存储：JuiceFS 的生产环境实践经验 Open Storage for Autonomous Driving and Physical Al Production Lessons from JuiceFS

JuiceFSSIEMENSOPENSOURCEDAY

OpenStoragefor

AutonomousDrivingandPhysicalAl

ProductionLessonsfromJuiceFS

RuiSu,co-founderofJuiceFS

Wheredoesatrainingsamplespenditstime?

SIEMENSOpenSourceDay01/16

JuiceFSPRODUCTOVERVIEW

CommunityEditionarchitecture:OpenSourceSummitJapan2025,p.1302/16

JuiceFSataglance

Apprunningon

Linux/macoS/Windowsdatabricks

FUSECSIDriverS3GatewayPythonSDKJavaSDK

JuiceFSClient

LocalMetadataCacheLocalDataCache

JuiceFSMetadataEngineJuiceFSDataEngine

redis

AmazonS3

TiKV

CloudflareR2DigitalOceanSpace

MysQL

FoundationDB

OCIObjectStorage

andmore

andmore

2017

Founded

2021

Opensource

Builtforthecloud

Multi-cloudandhybriddeployments

JuiceFSscale

EBscale

500Bfiles

1millionclients

Pragmaticdesign

Performancebalancedwithcost

AutonomousDriving/PhysicalAl/LLM&Multi-ModalModels/Biotech/QuantInvestment

JuiceFSTHEQUESTION

TheGPUiswaiting.Whichpartneedscapacity?

METADATA

MetadataDB

paths+dataindex

CACHEMISS

Localcache

hotdatablocks

Trainingworker

open()/read()

Objectstorage

durabledata

JuiceFSclient

POSIXviaFUSE

Decode

PathlookupBlocklocationCache/origin

AcachehitcanstillleavemetadatacallsandCPUworkonthecriticalpath.

JuiceFSI/Ointernals03/16

JuiceFSAUTONOMOUSDRIVING

Sourcetalk,pp.5-6,15-1704/16

Bytes,filesandreusegrowindependently

Roadlogs

continuouswrites

Frames+pointclouds

manyflecreates

Labels+derivatives

moreobjects

Train/simulate

repeatedreads

48,000

8cameras×10frames/s×600s

imagefilesfrom10minutes,ifeachframeisafile

illustrativefilecount

Capacity

bytesretained

Metadata

fles×operations

Readdemand

epochs×consumers

JuiceFSPHYSICALAI

LeRobotDatasetv3.005/16

Asamplecanbeatimewindowinsideashard

dataset[i]withrelativetimestamps

十-0.2s十-0.1s十

Parquetshards

state/action/timestamps

Episodemetadata

shardpath+start/endoffsets

MP4shardspercamera

manyepisodesperfile

FewerfilesystementriesMoreworkinindexinganddecode

LeRobotv3packsmultipleepisodesintoeachParquet/MP4file.

JuiceFSAPPLICATIONINTERFACE

Sourcetalk,pp.5-6,15-17/Zhuoyucasestudy,2026-09-1606/16

Filesemanticskeepexistingtoolsworking

PreprocessingtoolsTrainingloadersDataplatformSDK

paths+directoriesrandomread+mmapobjectAPI

Onenamespace,multipleaccessmethods

POSIXreducesintegrationwork

Accesslatencystilldependsonfilecount,colddataandclientconcurrency.

JUICEFSINTERNALS

JuiceFS

JuiceFSI/Ointernals/JuiceFSmetadataengines07/16

Onereadcrossestwoindependentservices

open("/train/scene/frame.jpg")read(offset,length)

1Path/inode2Chunk/slices

lookup+attributeslogicalbyteranges

Metadatadatabase

3Blockcache

localdisk/memory

DatapathbypassesthemetadataDB

4GETobject

miss/prefetch

Rename/createrequireatomicnamespaceupdates.

Clientandkernelcachescanskipwork.Thisistheconceptualcoldpath.

JuiceFSJUICEFSINTERNALS

JuiceFSI/Ointernals08/16

Apartialoverwritecreatesanewslice

Chunk:64MiBlogicalregion64MiB

OriginalsliceA

(18,19)MiBoverwrite

SliceB:1MiB

newobject

A:(0,18)

Publishslicemappingafterupload

existingobjectAstaysimmutable

Readview

Newwrite

A:(19,64)

Blocksdefaultto4MiB.Ashortslicecanproduceasmallerobject.

Repeatedoverwritesaddfragments.CompactionandGCconsumebackgroundI/O.

JuiceFSARCHITECTURETRADE-OFFS

Lustrearchitecture/CephFSarchitecture/Glusterarchitecture/JuiceFS/Lustre09/16

Fourdesignsplaceresponsibilityindifferentlayers

LustreCephFSGlusterFSJuiceFSCE

Client

MDS/MDT

OSS/OSTs

Client

MDS/metapool

RADOSdatapool

Client

DHT+AFRclient

Bricks+localFS

Client

ExternalDB

Cache/objectstore

Stripelayout

targets+HA

MDS+RADOS

placement+recovery

Clientdistribution

rebalance+heal

DB+origin+cache

coldread+DBlimits

JuiceFSPRODUCTION/ZELOS

Zeloscasestudy,2025-10-09/Enterpriseregioncomparison10/16

Zeloscopiesdatabeforetrainingacrossclouds

700TB600millionfles

onereportedbucket

onjuicefssync

Self-builtdatacenter

overdedicatedlinks

Publiccloud

JuiceFS+Redis+OSS

JuiceFS+Redis+MinlO

dataset

built

tool

copy

KubernetesCSI+PVCNode-localNVMecache

EnterpriseMulti-Regionisaseparatecapabilityfromthesynctoolinthiscase.

JuiceFS

PRODUCTION/ZHUOYU

Zhuoyucasestudy,2026-09-1611/16

Anewworkercanreuseanothernode'shotdata

WorkerA

localcache

Sharedcachenode

sameblockkey

WorkerB:newnode

localmiss

consistenthash(blockkey)

S3origin

onmiss

LocalcacheSharedcache

reusewithinanodereuseacrossnodes

Zhuoyu'sdistributedcacheisacustomerextensionofCommunityEdition.

JuiceFSPRODUCTION/ZHUOYU

Zhuoyucasestudy,2026-09-1612/16

Datapreparationbecomesataskdependency

≈80%

usedwithin8daysofupload

Dataset

source+PVC

Upload—→Buildcache

TTLfollowstheobservedusewindow

Dataready

workflowgate

Training

consumedata

DataLoad

JuiceFSRuntime

Fluidcoordinatespreloadandlifecycle.OtherjobsuseZhuoyu'scacheAPI.

JuiceFSPRODUCTION/ZHUOYU

Zhuoyucasestudy,2026-09-16/Rangewarmup,PR#7398/Lanceparser,PR#739913/16

Columnselectionreducesthebytestoprepare

SelectedLancecolumns

datasetversion+manifest

Illustrative16MiBfle

block0

JuiceFSwarmup

intersectingblocks

Filebyteranges

physicallayout

block1

block2

block3

Two4MiBblockswarmedforselectedrangesReportedI/Otime:-20-90%acrosspipelines

Rangewarmup·PR#7398Lanceparser·PR#7399

JuiceFS

PRODUCTION/ZHUOYU

Zhuoyucasestudy,2026-09-1614/16

Nearsaturation,asmallgainraisesthetail

1Msequentialreads,aggregateserverlinks:1,200Gbit/s

≈135GiB/s≈138GiB/s

P99≈2msP99≈20-30ms

morethroughput

10-15×

P99

Measuredcachepath.Acoldobject-storereadortrainingjobhasdifferentlimits.

JuiceFSPRODUCTION/HORIZONROBOTICS

Horizoncasestudy,2026-10-13