Article
MLA in the Transformers modeling backend for vLLM
hmellor
• • 1
Harry Mellor
hmellor
AI & ML interests
Machine Learning Engineer @ HF
Recent Activity
upvoted an article 3 days ago
MLA in the Transformers modeling backend for vLLM published an article 3 days ago
MLA in the Transformers modeling backend for vLLM upvoted an article 3 days ago
The Transformers modeling backend is now as fast as native vLLMOrganizations
published an article 3 days ago
published an article 3 days ago
Article
The Transformers modeling backend is now as fast as native vLLM
hmellor
• • 1 published an article 13 days ago
Article
Native-speed vLLM transformers modeling backend
hmellor, lysandre
• • 56