Image-Text-to-Video
Diffusers
Safetensors
text-to-video
image-to-video
video-to-video
text-to-audio-video
image-to-audio-video
image-text-to-audio-video
video-to-audio-video
audio-to-audio-video
audio-video-generation
multimodal
synchronized-audio-video
reference-to-audio-video
Instructions to use MiniMaxAI/MiniMax-H3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use MiniMaxAI/MiniMax-H3 with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("MiniMaxAI/MiniMax-H3", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Nice work, will the training recipe opensource soon?
#18
by DDDPG - opened
Amazing work for generation, looking forward to the report and deeper opensource!
BTW, personally tested the audio VAE with SDD dataset, , is that roughly match?
| Metric | Mean ± 95% CI |
|---|---|
| SI-SDR (dB) ↑ | 10.00 ± 0.35 |
| Multi-res STFT distance ↓ | 1.016 ± 0.019 |
| Multi-res Mel distance ↓ | 0.535 ± 0.009 |
| Per-channel phase coherence ↑ | 0.9585 ± 0.0032 |
| Inter-channel phase coherence ↑ | 0.9560 ± 0.0032 |