-
inference-optimization/Llama-3.1-8B-Instruct-NVFP4
5B • Updated • 22 • 1 -
inference-optimization/Llama-3.1-8B-Instruct-NVFP4-GPTQ-BlockSize16
5B • Updated • 9 • 1 -
inference-optimization/Llama-3.1-8B-Instruct-NVFP4-GPTQ
5B • Updated • 22 -
inference-optimization/Llama-3.1-8B-Instruct-NVFP4-GPTQ-SmoothQuant
5B • Updated • 22
Inference Optimization
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
-
inference-optimization/Llama-3.1-8B-Instruct-NVFP4
5B • Updated • 22 • 1 -
inference-optimization/Llama-3.1-8B-Instruct-NVFP4-GPTQ-BlockSize16
5B • Updated • 9 • 1 -
inference-optimization/Llama-3.1-8B-Instruct-NVFP4-GPTQ
5B • Updated • 22 -
inference-optimization/Llama-3.1-8B-Instruct-NVFP4-GPTQ-SmoothQuant
5B • Updated • 22
Tiny models used for testing
models 217
inference-optimization/Inkling-0.6B-A0.6B
Image-Text-to-Text • 0.6B • Updated
inference-optimization/Qwen3-VL-1.0B-A0.4B-Instruct
Image-Text-to-Text • 1B • Updated • 23 • 1
inference-optimization/Qwen3-8B-speculator.dflash.swa.causal-qwen235b-instruct-bs16.adamw-g7-ckpt9
2B • Updated
inference-optimization/Qwen3-8B-DFlash-b16-fullattn-fulldataset-rerun-clean-muon1e3-ckpt1
2B • Updated
inference-optimization/Qwen3-8B-DFlash-b16-fullattn-fulldataset-rerun-clean-muon1e3-ckpt0
2B • Updated • 12
inference-optimization/Qwen3-8B-speculator.dflash.swa.causal-qwen235b-instruct-bs16.adamw-g7-ckpt8
2B • Updated • 18
inference-optimization/Qwen3-8B-DFlash-b16-fullattn-fulldataset-rerun-clean-muon1e3-ckpt0-halfepoch1
2B • Updated • 1
inference-optimization/Qwen3-8B-speculator.dflash.swa.causal-qwen235b-instruct-bs16.adamw-g7-ckpt7
2B • Updated • 16
inference-optimization/thinkingmachines-Inkling-speculator.dflash
6B • Updated • 18
inference-optimization/Qwen3-8B-DFlash-b16-fullinstruct-muon1e3-ckpt1
2B • Updated • 21
datasets 27
inference-optimization/dflash-qwen3-8b-qwen235b-instruct-bs16-prepared-data
Preview • Updated • 50
inference-optimization/every-eval-ever-demo
Viewer • Updated • 1 • 23
inference-optimization/DeepSeek-V4-Flash-responses
Viewer • Updated • 508k • 70
inference-optimization/Qwen3.5-4B-responses
Viewer • Updated • 7.47k • 46
inference-optimization/Qwen3.5-0.8B-responses
Viewer • Updated • 7.47k • 145
inference-optimization/Qwen3.5-9B-responses
Viewer • Updated • 7.67k • 73
inference-optimization/Qwen3-8B-Regenerated-Collection
Preview • Updated • 140
inference-optimization/Qwen3-30B-A3B-responses
Preview • Updated • 77
inference-optimization/gpt-oss-120b-responses
Preview • Updated • 83
inference-optimization/Qwen3-32B-responses
Preview • Updated • 43