README
🏢
Joseph Jones PRO
KlondikeDev
AI & ML interests
Restoring the Digital Millennium. https://kunix.org/digital-millennium.html
Recent Activity
new activity about 10 hours ago
BananaMind/BananaMindBench-Leaderboard:OpenCerebral new activity about 13 hours ago
BananaMind/BananaMindBench-Leaderboard:OpenCerebral updated a Space about 14 hours ago
opencerebral/READMEOrganizations
OpenCerebral
6
#6 opened about 13 hours ago
by KlondikeDev
OpenCerebral
4
#5 opened about 13 hours ago
by KlondikeDev
updated a
Space about 14 hours ago
posted an update about 14 hours ago
Post
325
Boris-2 coming soon!
The Models:
Boris-2-75M: Trained on 26B tokens -- estimated to start training on August 12th.
Boris-2-125M: Trained on 90B tokens -- Estimated to start training on August 20th.
Boris-2-250M: Trained on 60B tokens -- Estimated to start training on September 10th.
Why does 125M get more tokens than 250M?
Well, the straight answer is time. It saves time, while still allowing the 250M model to exceed the 125M model.
Furthermore, we are attempting a unique architecture and layering scheme to hopefully end up around the strength of SmolLM2-135M. Fingers crossed!
We hope to end up in the ballpark of AxiomicLabs/GPT-X2.5-135M or BananaMind/BananaMind-2-Pro-Preview
Following this, we will release the Pro, Instruct and Pro-Instruct variants. More info will be coming soon!
The Models:
Boris-2-75M: Trained on 26B tokens -- estimated to start training on August 12th.
Boris-2-125M: Trained on 90B tokens -- Estimated to start training on August 20th.
Boris-2-250M: Trained on 60B tokens -- Estimated to start training on September 10th.
Why does 125M get more tokens than 250M?
Well, the straight answer is time. It saves time, while still allowing the 250M model to exceed the 125M model.
Furthermore, we are attempting a unique architecture and layering scheme to hopefully end up around the strength of SmolLM2-135M. Fingers crossed!
We hope to end up in the ballpark of AxiomicLabs/GPT-X2.5-135M or BananaMind/BananaMind-2-Pro-Preview
Following this, we will release the Pro, Instruct and Pro-Instruct variants. More info will be coming soon!
upvoted an article about 14 hours ago
Article
TutorMoments: Do AI tutors know when to help and when to hold back?
allenai
• • 19Making SLMs is so fun! I really enjoy it, personally. Given how little compute is needed, I think everybody should try it!
replied to Banaxi-Tech's post about 17 hours ago
Is this from scratch or does it use something like a minimal Linux backend? Very cool either way!
liked a
model about 17 hours ago
Add littlerock-1M (OpenCerebral)
4
#72 opened 2 days ago
by KlondikeDev
updated a
collection 2 days ago
updated a
model 2 days ago
published a
model 2 days ago
Add littlerock-1M base checkpoint (OpenCerebral)
#74 opened 2 days ago
by KlondikeDev
updated a
model 2 days ago
published a
model 2 days ago
liked a
model 3 days ago
liked a
Space 3 days ago
updated 2
models 4 days ago