Every frame-based camera attached to a robot is a small lie about time. The sensor pretends the world updates at 30, 60, maybe 120 frames per second — but a robot’s actuators, contacts, and collisions play out in microseconds. This mismatch has been tolerated for decades because the algorithms built on dense, synchronous image frames are so mature. But as robots push into faster manipulation, aggressive locomotion, and low-light deployment, the frame-based paradigm is quietly becoming a bottleneck. Event cameras offer a fundamentally different contract, and the robotics community is finally building the infrastructure to exploit it.

1️⃣ The mechanism is neuromorphic by design. Unlike a conventional camera that reads out every pixel at a fixed clock tick, an event camera — also called a Dynamic Vision Sensor (DVS) — fires independently per pixel, asynchronously, the moment that pixel detects a change in log-luminance above a threshold. The output is not a frame but a stream of events: each event encodes pixel coordinates, a timestamp (typically at microsecond resolution), and polarity (brightness increase or decrease). The canonical sensor families — Prophesee’s Metavision line and iniVation’s DAVIS cameras — have demonstrated latency under 1 ms end-to-end. A standard 60 fps camera, by comparison, can introduce up to 16 ms of latency per frame before any processing begins.

2️⃣ Three properties matter most for physical AI. ✅ Temporal resolution: microsecond timestamps let a controller respond to a fingertip slip or a foot strike before a frame camera would have even begun its next exposure. ✅ High dynamic range: DVS sensors routinely achieve 120 dB or more, compared to ~60 dB for most RGB sensors. Welding robots, outdoor inspection drones, and warehouse systems operating under mixed lighting all benefit directly. ✅ Low power and low bandwidth: because only changing pixels generate data, a static scene produces near-zero output. A Prophesee EVK4 generates roughly 10–100× less data than a comparable frame camera in typical manipulation settings, which matters enormously for edge-compute budgets.

3️⃣ The algorithmic gap is closing fast. The hard problem has always been that the entire computer vision stack — convolutional feature extractors, optical flow estimators, object detectors — was built for dense synchronous frames. Event data is sparse and asynchronous; naively converting it to pseudo-frames throws away most of what makes it valuable. Davide Scaramuzza’s Robotics and Perception Group at UZH has driven much of the foundational work here: event-based visual odometry (ESVO, DEVO), event + frame fusion for SLAM, and learned optical flow from event streams. More recently, methods like Event-based Vision Transformers process raw event streams directly as point clouds or token sequences, bypassing the frame conversion entirely. TU Delft’s work on event-based control for quadrotors demonstrated sub-millisecond obstacle avoidance that no frame camera could match physically.

The translation to manipulation is earlier-stage but accelerating. MIT and Stanford groups have demonstrated event cameras on fingertips and wrists for high-speed contact detection — catching a ball mid-flight, detecting thread-slip in assembly tasks — where the event camera acts as a 1 ms tactile proxy through visual surface deformation. Combined with spiking neural networks (SNNs) on neuromorphic chips like Intel’s Loihi 2, the full pipeline — sensor to policy — can run at biologically realistic speeds with a fraction of the power budget of a GPU-based system.

The missing piece has been ecosystem: tooling, simulation support, and training datasets. Prophesee’s Metavision SDK and the community-built Tonic library for PyTorch are closing the toolchain gap. The DSEC benchmark (stereo event + frame driving data) and N-MNIST, N-Caltech for classification gave the community a foothold, but manipulation-specific event datasets remain scarce — a genuine opportunity for groups with real hardware.

The frame camera won robotics by default, not by merit. For the class of fast, contact-rich, power-constrained robots that humanoids and next-generation manipulators are becoming, event cameras are not an exotic alternative — they are the correct prior. The question is no longer whether the technology works. It is whether the learning and control stack catches up before the moment passes.