microsoft/Fara1.5-27B
Image-Text-to-Text • 27B • Updated • 2.94k • 247
Ben Kelly PRO
YellowjacketGames
AI & ML interests
None yet
Recent Activity
liked a model 2 days ago
microsoft/Fara1.5-27B updated a collection 2 days ago
[models] RTX a6000 48gb repliedto danielhanchen's post 2 days ago
Kimi K3 can now be run locally! ✨
The 1-bit model retains ~78.9% accuracy after we shrunk it from 1.56TB to 594GB (-62% size).
Run on a Mac Studio connected with 128GB RAM device. Kimi K3 is the strongest open model to date.
GGUF: https://huggingface.co/unsloth/Kimi-K3-GGUF
Guide: https://unsloth.ai/docs/models/kimi-k3Organizations
liked a
model 2 days ago
updated a
collection 2 days ago
replied to danielhanchen's post 2 days ago
That's almost exactly what I'm estimating based on Deepseek R1 pulling about 1 or 2 TPS. Offloading a few layers to some A6000s didnt really help much either.
replied to danielhanchen's post 3 days ago
I have enough DDR4 to put this on a 64 core threadripper, but I'm worried about how brutally slow it will be :)
liked a
Space 15 days ago
why AGPL?
#1 opened about 1 month ago
by YellowjacketGames
upvoted a collection about 1 month ago
liked a
model about 1 month ago
updated a
collection 2 months ago
liked a
model 2 months ago
updated a
collection 2 months ago
liked a
model 2 months ago
commented on Flux 2 Dev on a single RTX A6000 48gb GPU # 2 months ago
btw we got it using 2 nvlinked RTX 6000 GPUs and its even better.
Interested in training this further myself
#1 opened 2 months ago
by YellowjacketGames
liked 2
models 2 months ago
updated a
dataset 2 months ago
liked a
model 3 months ago
updated a
collection 3 months ago
upvoted a collection 3 months ago