VOXA reads hand gestures through your camera and speaks them aloud, instantly — no wearable, no install, no internet round-trip. Everything runs right here in your browser.
Camera-based
4 gestures
Speaks aloud, offline
No wearable needed
—
Fist
→ No
Open palm
→ Help
Thumbs up
→ Yes
Peace sign
→ Special message
Requires the physical device
Wearable Mode
Gesture-to-speech from the VOXA wristband — reads wrist motion directly over USB, no camera needed.
This connects to the real VOXA wristband over USB using your browser's Web Serial feature (Chrome or Edge, desktop only). Without the physical wristband plugged in, there's nothing to select — this is demonstrated in person using the actual hardware.
Not connected
—
Sensor
MPU6050 accelerometer + gyroscope, read from an Arduino Nano on the wrist.
Model
The same trained Random Forest classifier as the desktop app, running live in this browser.
Output
The same offline speech engine used by Camera Mode.
Project overview
About VOXA
VOXA is a gesture-to-speech project built for ICT Expo 2026, designed to give people who
can't speak an easy, low-friction way to communicate. Its primary mode reads hand shapes
through any camera and speaks them aloud, right in the browser — no hardware, no install.
A second, wearable mode reads real wrist motion over USB for a hands-free, camera-free
alternative, using the same trained model as the desktop app.
At a glance
Primary mode
Camera-based hand gestures, powered by MediaPipe, runs entirely in your browser.
Secondary mode
Wrist sensor (MPU6050) over Web Serial, demoed with the physical wearable.
Gestures
Fist (no), open palm (help), thumbs up (yes), peace sign (special) — one hand each.
Output
Built-in browser text-to-speech — no server calls, works fully offline once loaded.
How it works
1
Sensor detects motion
A camera tracks your hand, or the wristband streams live wrist motion over USB.
2
Model classifies it
A trained classifier matches the shape or motion to a known gesture.
3
VOXA speaks
Once a gesture is recognized, the matching phrase is spoken aloud instantly.