AI & ML interests

We are interested in building Language model from scratch & finetune models into its last limits

Recent Activity

ArushCodes  new activity 6 days ago
RuVI-AI/Pragya-EXP3-CHAT:Ooo
ArushCodes  updated a Space 7 days ago
RuVI-AI/blogs
ArushCodes  updated a model 10 days ago
RuVI-AI/Pragya-EXP2
View all activity

Banaxi-Tech 
posted an update about 4 hours ago
view post
Post
29
Updates to Klein Ternary 1.7B:

The current checkpoints retains about 80% of FP16 performance, we're still improving it to 85% of 4 bit.

We are also releasing Klein Binary 1.7B, targeting 70-75% retention.



We're really working alot on these models to bring AI to single-board IoT devices.
  • 3 replies
·
Bc-AI 
posted an update 4 days ago
view post
Post
1,557
🚀 Introducing CSM-1

We’re excited to introduce CSM-1, our Cyber Safety Model, built with a focus on understanding cyber threats, identifying risks, and strengthening AI-powered cyber safety.

CSM-1 represents an important step forward in our work towards smarter, more capable cyber safety systems.

And we’re not stopping here.

👀 CSM-1.1 is coming soon.

A new iteration, further improvements, and more to come.

Stay tuned. 🔥

OpenModel-Labs/CSM-1-Preview

AI built by High Schoolers.

Special thanks and kudos to the team!
@OpenModel-Researcher
@JP-AI-2026
@ArushCodes
@ArushBuilds
@Banaxi-Tech
@GGUFGuy
@Hoglet-33
@Bc-AI
  • 3 replies
·
Banaxi-Tech 
posted an update 4 days ago
view post
Post
103
We're announcing Klein Ternary 1.7B.

Its our latest, ternary-weight model based on LFM 3 1.7B. Our target is 80-85% top 1 alignment, putting it close to 4 bit.

Klein Ternary is aimed at coding, with a footprint under 1 GB. It’s best suited for Raspberry Pis, phones and other low-power devices where even 4-bit models are too heavy.

The training pipeline is, normal self distillation, with a small seperate stage to bring out more coding performance after, and then a bit of post-training on Qwen distilled data to make it better.

We plan to release it in about 10 days.

Ooo

#1 opened 6 days ago by
ArushCodes
Banaxi-Tech 
posted an update 8 days ago
view post
Post
6,644
We're introducing KV1 1.2B.
Its our first KV1 model using a 2 bit KV cache, based on LFM 2.5 1.2B.

KV1 1.2B retains 75.8% of original intelligence.

More details: klein-ml/blog

Model klein-ml/KV1-1.2B
  • 5 replies
·
Banaxi-Tech 
posted an update 9 days ago
view post
Post
6,365
BananaMind 3 is coming.

Biggest context in all SLMs with NSA.
10M, 50M, 150M, 400M.

And maybe, 1B.
  • 14 replies
·
Banaxi-Tech 
posted an update 10 days ago
view post
Post
6,713
We've released the BananaMind/BETU-SLM-Leaderboard

Its so simple to use, it ranks models, and by one command add your own model to it.

It scores by Overall Index which is a weighted mix of Hellaswawg, ARC EASY, PIQA, Arithmark 3, Tiny Theory of Mind, and BananaMind Base Bench.
  • 1 reply
·
Banaxi-Tech 
posted an update 11 days ago
view post
Post
106
We ARE Announcing BananaMind 3 Ultra.

400M parameters, designed to beat LFM 2.5 1.2B.

This model is a usable small agent. Not a demo model like our 3M models.


FP8. KV1. Optimization. FactBase DCLM. Fable 5.2 for maximum speed kernels. TST.

This model will M.
What do you think? 50+ INT Index on the Open SLM leaderboard? BananaMind 3 is coming before christmas.

  • 11 replies
·
Banaxi-Tech 
posted an update 14 days ago
ArushCodes 
updated a Space 14 days ago
Banaxi-Tech 
posted an update 15 days ago
view post
Post
71
Hi guys.

We're announcing Klein SL Pro, our new model at Klein ML.
It's doing post-training of Qwen3.8 Flash Next to make IT fit on 16GB VRAM.

It works by converting its MoE to SLMoE, SLMoE is an architecture, that chooses experts per response, not per token anymore.

This makes it so you can offload everything else to the disk and not get slow speed.


We're also seeking more compute to do this same thing on Deepseek V4.1 Flash, allowing it to run on 16GB VRAM tightly and definitely on 24GB. If you have hardware, more than 200B of VRAM in total, create a discussion klein-ml/README.
  • 2 replies
·
Banaxi-Tech 
posted an update 19 days ago
Banaxi-Tech 
posted an update 21 days ago
view post
Post
136
SupraTTS is going to be cooked lol

Klein TTS X1.5 is releasing in under a WEEK


(supratts scoring 743 on tts index: 😭)


we are just doing our post training now before releasing and are so excited with the results x2 will be insane!
  • 19 replies
·
Banaxi-Tech 
posted an update 22 days ago
view post
Post
115
Happy halloween everyone!


We've did some updates to Banaxi-Tech/TTS-Arena and now, everyone who uses the TTS Arena alot will get featured in our Klein TTS Release. Using it REALLY helps us alot so please use it.

Updates on the sizes: Klein TTS Flash Lite with 0.4M parameters, Klein TTS Flash with 1.7M parameters, Klein TTS Pro with 13M parameters and Ultra with 21M.