ForgeWorks

ForgeWorks is an organisation that builds small language models. Currently best known for the ForgePlex M series, a series of decoder-only <10m parameter models.

Highlights

ForgePlex-M2.2-10M

• Currently 1st 🥇 on the Open SLM Leaderboard <10m parameters category.
• The definitive M2: an Intelligence Index of 12.12 on the Open SLM Leaderboard, post-trained for 2B tokens on top of ForgePlex-M2.1.
• A +1.42 Index gain over ForgePlex-M2.1 (10.70), with the same core architecture.

ForgePlex-M2.1-10M

• Peaked at 1st 🥇 (currently 3rd) on the Open SLM Leaderboard <10m parameters category.
• The first sub-10M-parameter model to pass an Intelligence Index of 10 on the Open SLM Leaderboard with 10.70
• A +1.56 Index gain over ForgePlex-M2 (9.14), with the same core architecture.

ForgePlex-M2-9M

• Peaked at 3rd 🥉 on the Open SLM Leaderboard <10m parameters category.

ForgePlex-M1-6M

• First model trained on Axiomic Labs training framework: Trainwork.
• Peaked at 23rd on the Open SLM Leaderboard <10m parameters category.