clef-4bit / joint_head_config.json
lucataco's picture
Add MLX 4-bit conversion of Cloudflare/clef with joint schema head and clef_mlx.py loader
e0a23bd verified
Raw History Blame Contribute Delete
119 Bytes
{
"hidden_size": 5120,
"width": 1024,
"routing_layers": 2,
"layers": 4,
"heads": 16,
"feedforward": 4096
}