Skip to main content

Gemma3 270M IT INT4

A compact 270M parameter language model from Google, quantized to INT4, for text classification and data extraction tasks with rapid fine-tuning capability.

HuggingFaceHuggingFace

Supported processors

  • SL2619

Gemma3 270M IT INT4

Model Overview​

The Gemma 3 270M is a highly compact, 270-million parameter model from Google designed for extreme efficiency. It is specifically engineered for well-defined tasks like text classification and data extraction where it offers a cost-effective alternative to larger models. Its lightweight architecture is particularly optimized for rapid fine-tuning.

This is the instruction-tuned model quantized to INT4, optimized for the Synaptics Astra® SL2610-Series processors with Torq NPU.

Model Features​

  • Model Type: Large Language Model
  • Input: Text
  • Output: Text
  • Quantization: INT4

Deployment​

The compiled model files are available for download on Huggingface at Synaptics/gemma-3-270-int4-it-torq.

Usage Tutorial​

A usage example is provided at Torq Examples / gemma3. Check out the README for instructions.

License​

Both the source model and the compiled model for on-device deployment are licensed under Gemma Terms of Use.

Learn More​

Related models

LLM

Gemma3 270M IT

A compact 270M parameter multimodal language model from Google optimized for text classification and data extraction tasks with rapid fine-tuning capability.