Designing a shader using voice and hand gestures

  • This is a computer vision experiment, using voice + hand gestures to control a shader animation.

    This uses a liquid Chladni pattern, with controls for color and wave frequency / amplitude.

    Created using threejs, mediapipe computer vision, and web speech API.