ekryski
/

gemma-4-12B-it-mlx-4bit

4-bit precision

Model card Files Files and versions

gemma-4-12B-it

4-bit affine quantization of google/gemma-4-12B-it, produced with FFAI 0.1.0's ffai convert (mlx-affine format, group_size=64).

Conversion

ffai convert google/gemma-4-12B-it --bits 4

See also

FFAI — fast Apple Silicon LLM inference. Model.load("google/gemma-4-12B-it") runs this checkpoint end-to-end.
FFAI quickstart
FFAI quantization docs

Downloads last month: 16

Safetensors

Model size

12B params

Tensor type

BF16

·

U32

·

MLX

Hardware compatibility

Log In to add your hardware

4-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ekryski/gemma-4-12B-it-mlx-4bit

Base model

google/gemma-4-12B

Finetuned

google/gemma-4-12B-it

Quantized

(393)

this model