computervision
I Built a 3D Particle Universe You Can Control With Your Hands ✋🌌
What if you could control a 3D world without a mouse or keyboard? I built AetherParticles 3D — an interactive particle universe where hand gestures become the controls. Just a camera, your hands, and thousands of particles. ✋ Gesture → Action ✊ Fist → Implode particles 🖐️ Open Palm → Scatter particles 🤏 Pinch → Scale the particle world ☝️ Point → Attract particles like a magnet ✌️ Peace → Switch to the next 3D shape 🤘 Rock → Trigger a particle burst 👍 Thumbs Up → Increase energy 👌 OK → Randomize the experience The particles can transform into different 3D forms such as galaxies, Saturn, hearts, fireworks, lotus shapes, and more. 🪐❤️✨ 🧠 What I Wanted to Explore The goal wasn't simply to create a visually impressive particle system. I wanted to explore a bigger question: What happens when we remove the traditional interface and let humans interact with digital worlds naturally? Instead of clicking a button, moving a mouse, or pressing a key, your hand becomes the interface. ⚙️ What I Built The project combines: Real-time hand tracking Gesture recognition 3D particle simulation Interactive particle physics Dynamic 3D shape transformations Real-time visualization Modern web UI One of the interesting challenges was making the gestures feel responsive without making the particle system unstable or unpredictable. There is still plenty I want to improve: Better gesture accuracy More realistic particle physics Improved performance More interactive shapes More complex gesture combinations Better visual effects 🚀 Try AetherParticles 3D https://normal-amethyst-pnff6pqr.edgeone.dev/ This project started as an experiment with computer vision and 3D graphics. It turned into something I enjoyed much more: Making the human hand the controller of a digital universe. ✋🌌 I'm continuing to learn, build, experiment, and explore where AI + computer vision + creative coding can take interactive experiences next. If you try it, I'd love to know: Which gesture or particle shape should I add next? 👀 showcase ai computervision threejs creativecoding webdev javascript 3d
Air Rhythm — Play music with your hands
Happy to share one of the projects I have been working on: Air Rhythm. It’s a computer vision rhythm game where you play music by moving your hands in front of a webcam. In this demo, I’m playing a short version of Für Elise by catching falling notes with my fingertips. How it works: • Your fingertips control virtual drumsticks. • Catching a falling circle plays its musical note. • Following the note sequence lets you build the melody yourself. • A live camera inset shows your hands and the tracked skeleton behind the interaction. The computer vision behind it: I used MediaPipe’s pretrained Hand Landmarker to detect 21 landmarks on each hand, then built the interaction around those predictions: • Adaptive smoothing to reduce tracking jitter. • Collision checks along fingertip movement between camera frames. • Time-based note movement and sequence-aware scoring. • Synthesized audio triggered by successful hits. Tech stack: • Desktop: Python, OpenCV, MediaPipe Hand Landmarker, NumPy, sounddevice, and pywebview. • Browser: TypeScript, OpenCV.js, MediaPipe Hand Landmarker, and Web Audio. • Shared interface: HTML, CSS, and Canvas. • Hosting: GitHub Pages. Most of the testing went into making quick movements register and reducing jitter. Partially visible hands still challenge the tracker, so the interface prompts users to keep their hands and wrists in view. Both versions process camera footage locally on your device without uploading it. Try the live web version: https://adolph1999v.github.io/air-rhythm/ GitHub repo, code, and documentation: https://github.com/Adolph1999v/air-rhythm Give it a play and let me know what you think 😄