3D model control using hand gestures and voice commands

by getToTheChopinon 5/30/2025, 2:04:45 PM with 2 comments
  • by getToTheChopinon 5/30/2025, 2:04:45 PM

    3D model control (move, rotate, scale, animate) using hand gestures and voice commands, running in real-time in the browser

    Created with threejs, mediapipe computer vision, and web speech API

    3D model from Quaternius

    Here's the live demo if you want to try: https://rosebud.ai/p/93986db5-4d99-437f-9e8b-c8d742e131da

    Any feedback would be appreciated!

  • by nimzoLarsenon 5/30/2025, 2:21:42 PM

    That’s awesome. Can you import new 3D models?