← Back
Home › Systems › Operating systems and runtimes

image-snapshotter

container image layers and snapshotter

overlayfs, stargz

SystemTechniques · 0Primitives · 16 image-snapshotter Content defined chunkingcompression · low: Rolling-hash chunk boundaries (Rabin, FastCDC) for deduplication that survives insertionsSeekable compressed streamcompression · low: Independently compressed blocks plus an index for random access (BGZF, seekable zstd, eStargz)Zstandard (zstd)compression · low: LZ77 plus Huffman and FSE entropy coding, with levels from LZ4-like speed to xz-like ratio, all decoding at about 1-2 GB/s.›Merkle treedata-structures · low: Hash tree for verifying and diffing large datasets with logarithmic proofsCgroups and namespaceshardware-os · low: Linux namespaces limit what a process can see; cgroup v2 limits and accounts what it may use. Containers, sandboxes and job schedulers are built from the two.›Fuse userspace filesystemhardware-os · low: FUSE protocol: kernel forwards VFS requests to a userspace daemon; caching and splicemmap and the page cachehardware-os · low: How read() and mmap reach file data through the kernel page cache, what readahead and madvise do, and why databases use their own buffer pool instead.›Overlay filesystemhardware-os · low: Union mounts (overlayfs) stacking read-only layers under a writable layerHTTP range requestsnetworking · low: Ask for byte offsets with Range and get a 206 slice back; the standard way to resume, seek and read big remote files piecewise.›Cryptographic hashes (SHA-2, BLAKE3)security · low: Collision-resistant fingerprints of data; SHA-256 for interoperability, BLAKE3 for speed, HMAC/HKDF for keyed uses.›Digital signatures (Ed25519)security · low: Small, fast, deterministic public-key signatures that prove who produced a message; the default for tokens, releases and protocols.›Content-addressed storagestorage · low: Store each blob under the hash of its bytes: immutable, deduplicated by construction, self-verifying on every read, and composable into Merkle trees.›Tar archive formatstorage · low: Ustar/pax tar headers and streaming archivesMerkle dagdata-structures · low: Content-addressed DAG of hashed nodes (git trees/commits) for dedupe and verifiable historyAtomic file replacementhardware-os · low: Write temp file, fsync, rename over target, fsync directory: crash-safe whole-file updatesVirtual memory and the TLBhardware-os · low: How page tables and TLBs translate every address, what TLB reach means, and when 2 MiB or 1 GiB huge pages pay off on Linux.›

Similar systems

Share the most building blocks with this one.

container-build 35 %patch-delivery 23 %backup-dr 22 %remote-build-execution 22 %cold-archive 20 %