Research direction · Concept

Any wall. Any desk. A touch surface.

An ultra-short-throw projector and a depth camera turn a bare surface into something you touch directly, with nothing mounted on the surface itself.

A chair against a plain, evenly lit wall, the kind of bare surface the unit projects onto

The projector sits close and steeply angled.

That is the whole reason ultra-short-throw optics exist here: your hand never casts a shadow across what you are touching. A conventional projector puts your arm directly in the beam.

Depth sensing, because colour cannot do this job.

A colour camera aimed at a projected surface is the hardest possible case. It sees the projected image, which wrecks hand detection, and it fundamentally cannot tell hovering from touching. Depth gives touch, hover, mid-air gestures and hand identity from one sensor, and tolerates a surface that is not perfectly flat.

Calibration decides whether it feels good or infuriating.

Not the sensor brand. A projector-to-camera mapping from projected calibration dots, a stored empty-surface depth reference, and a pre-warp so a heavily angled image reads as a clean rectangle. Above roughly 50 milliseconds end to end, typing and dragging feel broken.

Code Start a conversation