Face Modality

Capture Your Face

All Modalities

Your facial geometry and symmetry map to melodic intervals and harmony. Look directly at the camera in even lighting.

We'll also record a 10s background video to read your heart rate — you get a second, cardiac-driven composition for free.

Face data is encrypted end-to-end and only used to compose your music.

Waking up camera…

What we read from your face

Layer A · interpretable
68 landmarks
Eye corners, jaw arc, lip outline, nose bridge
→ chord voicings
Eye-line tilt
Horizontal angle through your pupils
→ tempo offset
Smile + eye-open
Two blendshapes (0..1)
→ mood + dynamics
Jaw width / forehead
Face proportions
→ instrument register

Tips for best results

  • -Good, even lighting — face a window or lamp
  • -Look directly at the camera, centered in the oval
  • -Keep a neutral expression for geometry accuracy
  • -Ensure your full face is visible, no obstructions