FAJU85 PRO
vooom
AI & ML interests
None yet
Recent Activity
updated a bucket 1 day ago
vooom/Fast_Growth-storage updated a bucket 2 days ago
vooom/home reacted to Banaxi-Tech's post with 👍 2 days ago
We're excited to release BananaMind 2 MoE, a new addition to the BananaMind 2 series!
BananaMind 2 MoE is a sparse mixture-of-experts model with 25M total parameters but only 2M active per token, Like the rest of the series, it uses our custom digit-aware BPE tokenizer that keeps every digit isolated, fixing the core arithmetic weakness of our earlier models. It's trained on 30B tokens from FineWeb-Edu, DCLM, Cosmopedia-v2 and FineMath-4+, and outperforms Pythia-31M on average despite activating just 2M parameters.
Check it out at
https://huggingface.co/BananaMind/BananaMind-2-MoE
BananaMind 2 Nano is Coming Next. Already training. Apache 2.0.Organizations
None yet