← Back
Home › Systems › Embedded and IoT

camera-isp

camera image signal processor pipeline

smartphone ISP

SystemTechniques · 4Primitives · 24 camera-isp Auto exposure focus white balancemedia · medium: Camera 3A loops: metering-driven exposure, contrast/phase autofocus, gray-world/illuminant white balanceImage alignment registrationmedia · medium: Align frames via feature matching or pyramidal optical flow for burst merging and stitchingImage denoisingmedia · medium: Bilateral, non-local means and temporal noise reduction for sensor imagesVideo stabilizationmedia · medium: Gyro- or feature-based motion estimation, path smoothing and frame warpingColor space conversiongraphics · low: Convert pixels between transfer curves (sRGB, linear light), primaries (sRGB, Display P3, XYZ) and Y'CbCr, using tables for the curve and 3x3 matrices for the rest.›Convolution image filtersgraphics · low: Separable 2D convolution kernels for blur, sharpen (unsharp mask) and edges with border handlingImage pyramidsgraphics · low: Gaussian/Laplacian pyramids and tiled multi-resolution images for zoom and blendingImage warping remapgraphics · low: Resampling with lookup maps: resize, lens undistortion, homographies, bilinear/bicubicDma transfersembedded · low: DMA controllers: descriptors, circular buffers, cache coherence for zero-CPU data movementDeterministic fixed-point mathgame-networking · low: Bit-identical simulation math across CPUs, compilers and builds: integer fixed-point formats, the float traps (FMA, x87, fast-math, libm), deterministic trig, sqrt and RNG.›Tone mapping (HDR to display range)graphics · low: Compress scene-referred linear light to a display's range in three steps: expose, apply a curve to luminance, then encode (sRGB, PQ or HLG) and dither.›SIMD programminghardware-os · low: Process 4-16 lanes per instruction with AVX2, AVX-512 or NEON via Rust std::arch, with runtime dispatch and a portable fallback.›Demosaicingmedia · low: Reconstruct full RGB from Bayer sensor data (bilinear, edge-aware, gradient-corrected)Line buffer streamingmedia · low: Stream image processing with a few line buffers instead of full frames (hardware ISPs)Convolutional networksml-training · low: Layers that slide a small shared kernel over a grid, giving translation equivariance and few parameters; still the most compute-efficient choice for many vision tasks.›Weight quantizationml-training · low: Store weights as 8/4-bit integers with per-group scales; decode is memory-bound, so 4-bit weights give about 3-4x tokens/s and fit 4x larger models.›PID controllerrobotics · low: Drive a measured value to a setpoint with three terms on the error: proportional, integral, derivative. The default feedback loop for motors, heaters, drones and gimbals.›Peak detectionsignal-processing · low: Robust peak and event detection in noisy signals with adaptive thresholds and refractory periodsHomogeneous transformsgeometry · low: 4x4 affine and projective matrices, homogeneous coordinates, view and projection, normal matricesFeature detection orbrobotics · low: FAST corners with oriented BRIEF descriptors and Hamming matching for tracking and relocalization+ 8 more primitives

Similar systems

Share the most building blocks with this one.