| Output + Embedding | ||||||||
|---|---|---|---|---|---|---|---|---|
| 2-bit | 3-bit | 4-bit | 5-bit | 6-bit | 8-bit | 16-bit | 32-bit | |
| AXL | BXL | CXL | DXL | EXL | FXL | GXL | HXL | |
- Downloads last month
- 9
Hardware compatibility
Log In to add your hardware
4-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support