Spaces:

---

atlasia

/

DarijaLID-Leaderboard

like 1

Sleeping

feat: add HuggingFace Transformers support with safetensors and custom tokenizers

• Added support for fine-tuned HuggingFace Transformer models
• Enabled loading of .safetensors and .bin weights
• Integrated AutoTokenizer with automatic special token handling
• Added Transformer-based inference pipeline with GPU support
• Preserved existing FastText evaluation workflow
• Improved model loading robustness for public and private HF repos
• Extended UI to support Transformer models and predictions fallback