Using hand gestures and voice commands to control a 3D data visualization

  • 4d sudoku!

    ?? side list of selectable group colors

    ?? verbal "set operators" (intersection, difference, union,symetric difference) based on verbally selected item tag names vs. "hand pick" color group/group items to perform set operation.

    "blinking" objects/object connectors involved in set operation. Results forming new "color group" of copy of originals vs. moving originals into group per set result. ??

    Associate color/group with "gravity well" spot.

  • Created using threejs, mediapipe computer vision, web speech API, and Vasco Asturiano's 3D-force-graph library