Instructions to use google/gemma-4-E2B-it-qat-mobile-transformers with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use google/gemma-4-E2B-it-qat-mobile-transformers with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("google/gemma-4-E2B-it-qat-mobile-transformers", dtype="auto") - Notebooks
- Google Colab
- Kaggle
How do we use MTP for speculative decoding?
#6 opened 20 minutes ago
by
pythiccoder
Add response_template to tokenizer_config.json
#3 opened 5 days ago
by
Rocketknight1
Raise per-image vision soft-token budget from 280 to 1120
#2 opened 7 days ago
by
lucianommartins