Cross Compile LLM
This tutorial will guide you to cross-compile llama.cpp binaries (building binaries on a host machine for customization purposes) for Synaptics Astra™ Machina™.
3 docs tagged with "LLM"
View all tagsLlamafile on Astra
LLMs are powerful tools which have many uses, but the output may contain inaccuracies, bias, or safety issues.
LLM on Astra
This tutorial will guide you through the process of running the TinyLlama model using llama.cpp Natively on an Synaptics Astra™ Machina™ using the SL1680 processor.