Build llama-cpp Python wheel
Build llama-cpp-python on the board for local LLM inference from Python.
Build llama-cpp-python on the board for local LLM inference from Python.
Cross-compile llama.cpp on a host machine for Astra Machina.
A lightweight 270M parameter model from Google, built on Gemma 3 270M and trained for function calling, intended as a foundation for specialized fine-tuned models.
A compact 270M parameter multimodal language model from Google optimized for text classification and data extraction tasks with rapid fine-tuning capability.
A compact 270M parameter language model from Google, quantized to INT4, for text classification and data extraction tasks with rapid fine-tuning capability.
Run small large language models locally on Astra.
A 230M parameter hybrid short-convolution and attention language model from Liquid AI that can act as a skill-selection layer, decomposing instructions into tool calls.
Run Llama 3.2 1B on Astra as a single llamafile executable.
Run TinyLlama natively on Astra Machina with llama.cpp.
A 0.5B parameter instruction-tuned language model from the Qwen team, quantized to INT4 with GPTQ for the Torq NPU.
A 0.6B parameter language model from the Qwen team, quantized to INT4 with GPTQ for the Torq NPU.