5 docs tagged with "llama.cpp"

Build llama-cpp-python on the board for local LLM inference from Python.

Cross-compile llama.cpp on a host machine for Astra Machina.

Run small large language models locally on Astra.

Run TinyLlama natively on Astra Machina with llama.cpp.

Run vision language models that understand images and text with llama.cpp.