Vishva R
Vishva007
AI & ML interests
Deeply interested in Generative AI, particularly Large Language Models (LLMs). Focusing on model fine-tuning, prompt engineering, and practical applications using the Hugging Face ecosystem (Transformers, Datasets).
Recent Activity
upvoted a collection 5 days ago
Nemotron 3 Embed updated a model about 2 months ago
Vishva007/Qwen3.5-9B-W2A16-AutoRound-GPTQ published a model about 2 months ago
Vishva007/Qwen3.5-9B-W2A16-AutoRound-GPTQOrganizations
None yet
Inference support for vLLM and SGLang OpenAI endpoints
➕ 14
10
#3 opened 2 months ago
by Vishva007
Does Somebody have https://github.com/OLAF-OSS/gemma4-vllm/blob/main/QUANTIZE.md ??
2
#1 opened 3 months ago
by 
Rafik241
Thanks for the gemma4-vllm quantization guide!
#1 opened 4 months ago
by Vishva007
Can't get the model to run on vllm 0.19.1rc1
1
#1 opened 4 months ago
by 
toughcent
DFlash compatibility with AutoRound (W4A16) quantized Qwen3.5-9B in vLLM?
2
#1 opened 4 months ago
by Vishva007
Will this model work with an AutoRound-quantized Qwen 3.5 9B model in the vLLM inference engine?
#1 opened 4 months ago
by Vishva007
Update README.md
#23 opened 6 months ago
by Vishva007
How Much GPU Memory (VRAM) is Needed to Run This Model?
🤯 2
6
#3 opened 9 months ago
by Vishva007
[bot] Conversion to Parquet
#1 opened over 1 year ago
by 
parquet-converter
How to output in a Structured format with pydantic model in transformers model?
3
#10 opened over 1 year ago
by Vishva007
How to output in a Structured format with pydantic model in transformers model?
3
#10 opened over 1 year ago
by Vishva007