schneiderkamplab/dfm4-historical-additions
Viewer • Updated • 158k • 39
- Ressource constrained language modelling - Evaluation - Low-Bandwidth Distributed Training - Quantization - Medical Language Modelling - AI x Human
FlexMoRE: A Flexible Mixture of Rank-heterogeneous Experts for Efficient Federatedly-trained Large Language Models
DeToNATION: Decoupled Torch Network-Aware Training on Interlinked Online Nodes