this is dope! I bought a pair of pinebuds to do something similar but got pulled into another project.
my use case was to tape one pine bud to my shoulder to wear all day, and it would bluetooth connect to my android keyboard app, with the simple goals
#1) always record my voice even if I have another headset connected to the phone. I.e., do not get interrupted by incoming calls, spotify, or other bluetooth jank
#2) only do STT on my voice, bonus if you can figure out context and only do STT when i'm talking to the phone (via eyeballs?)
#3) always put the generated STT into a form, or if no form has focus, spawn a new browser tab and put focus on the search-input form
that's all. fin
We built an always-on open source wearable AI. Listens to (and will soon see) everything you experience, all-day long. Supports a number of capture devices, including Apple Watch and a tiny wearable with days of battery life. Interactive assistance coming soon.
The convergence of powerful LLM and VLM models with low-power wearable devices opens up entirely new frontiers for human-computer interaction, including memory augmentation, pro-active life assistance, and distributed knowledge gathering. We believe in exploring this transparently and openly, and look forward to contributions :)
Today, we launch with Apple Watch, Xiao ESP32S3 Sense, and Sony Spresense support. Code and design files for the ulta-low-power reference wearable coming soon. We are looking for select people to give out units to and set up private servers for, to help us test and spread the word!
The server is written in Python and the display client is a native iOS Swift app (but a web client is included in the project as well for those outside the Apple ecosystem).