Finger Tracking

Finger Tracking is a set of three pieces controlled by hand gestures in front of a webcam. MediaPipe tracks the hands, and Three.js draws the visuals.

Timeline
2026
Built with
MediaPipe and Three.js
Input
A webcam, no controller
01 · Arcane Orb

In Arcane Orb, pulling the hands apart grows an orb, and a pinch changes its form.

The orb has eight forms, from a plain sphere to liquid and glass, and the final gesture releases it.

Orb
Orb
Terra
Terra
Spell
Spell
Seal
Seal
Totem
Totem
Release
Release
Liquid
Liquid
Glass
Glass
02 · Glass

In Glass, a pinch moulds a piece of glass, and two fingers bend the light passing through it.

03 · Ink Familiars

In Ink Familiars, my doodles become creatures that respond to the hands.

An open hand feeds a creature, and a fist turns it into another one.

Glyph
Glyph
Skeleton
Skeleton
Particles
Particles
Morph
Morph
Next projectDeep-sea Bioluminescent