On-Device AI Voice Assistant
· 6 min read
Introduction
At CES 2025 Synaptics is showcasing a wide range of impressive AI demos.
Among them is a contextual AI voice assistant, operating entirely on-device, with no cloud dependency or offloading, running on a Synaptics Astra™ Machina SL1680 linux development board.
note
You can buy the Synaptics Astra SL1680 board and run this open-source demo today:
Find the Python source code on github for you to customize and use.
Some cool capabilities:
- Understanding context-specific queries.
- Responding quickly (as low as 500ms) and accurately without cloud dependence.
- Tool calling peripherals or cloud services possible for extended functionality.
- Leveraging multi-modal systems for vision-based queries.
- Hallucination-free responses, providing Q&A dataset is clean (see Limitations).