MiniMax H3 Turbo β€” ComfyUI 4-Step T2V and I2V LoRA

This repository contains an inference acceleration LoRA for the ComfyUI release of MiniMax H3, covering Text-to-Video (T2V) and Image-to-Video (I2V). It targets H3's joint audio-video diffusion path and uses a fixed 4-step Euler inference contract.

This file is a LoRA, not a standalone diffusion checkpoint. It must be paired with the matching BF16 base model from Comfy-Org/MiniMax-H3.

Supported generation modes

  • Text-to-Video (T2V): generate a video directly from a text prompt with the FL2VA model and LoRA.
  • Image-to-Video (I2V): animate an input image using the FL2VA first-frame path; an optional last frame can also guide the ending.

Comparison protocol

Within each comparison group, all results use the same MiniMax H3 BF16 base model, the same inference input, and the following standardized inference target. Measured generation times are shown directly in the corresponding comparison table.

  • Sampling steps: 4
  • LoRA strength: 1.0
  • Video duration: 10 seconds
  • Output resolution: approximately 0.9 megapixels per frame

First comparison group

No LoRA
Ours LoRA
190 s 178 s 180 s

Second comparison group β€” Subway scene

No LoRA
Ours LoRA
177 s 174 s 175 s

Third comparison group β€” Outdoor lawn scene

No LoRA
Ours LoRA
183 s 174 s 175 s

Recommended inference settings

Setting Value
LoRA strength 1.0
Steps 4
Sampler Euler
Scheduler simple
CFG Disabled
Sigma path 1.0 β†’ 0.97297297 β†’ 0.92307692 β†’ 0.8 β†’ 0.0

The 4-step sigma path is part of the model contract. Different samplers, schedulers, step counts, or LoRA strengths may work experimentally, but are outside the validated configuration.

ComfyUI usage

  1. Place the .safetensors file in ComfyUI/models/loras/.
  2. Load minimax_h3_fl2va_pruned_bf16.safetensors as the diffusion model.
  3. Add the LoRA with strength 1.0.
  4. For T2V, use the FL2VA workflow without keyframe conditioning. For I2V, use MiniMax H3 Image to Video with the first-frame input.
  5. Configure Euler, simple, and 4 sampling steps.

How it works

Four-step flow update

MiniMax H3 predicts a conditional velocity field for a noisy joint audio-video latent. At each sampling boundary, Euler advances the latent with:

x_next = x + (sigma_next - sigma) * v(x, sigma, condition)

Running the original model with fewer scheduler evaluations is not enough by itself: each interval becomes much larger, so small velocity errors accumulate quickly. This Turbo LoRA modifies the model's velocity prediction for the fixed four-interval path. The acceleration therefore comes from a learned model correction, not merely from skipping scheduler steps.

The supplied adapter is tied to the published sigma boundaries. Euler + simple + 4 steps keeps the network evaluations and integration intervals aligned with that contract.

Joint audio-video denoising

H3 processes text and visual conditioning, audio latents, and video latents inside one denoising model. Shared transformer blocks model cross-modal timing and semantic relationships, while separate final projections predict audio and video velocity outputs. The LoRA covers both shared blocks and both output paths, so the four-step correction is applied coherently to the synchronized audio-video state.

FL2VA conditioning

First and last keyframes are encoded into latent-space keyframe conditions aligned to positions on the target video timeline. Their visual embeddings are also presented to the text/vision encoder before the prompt. This path supports text-only generation as well as control from boundary frames.

Technical profile

  • ComfyUI-native LoRA key layout in safetensors format.
  • Covers attention, MLP, conditioning modulation, video output, and audio output paths.
  • Designed for MiniMax H3's synchronized audio-video latent denoising.
  • Structural loading was verified against ComfyUI successfully.

Notes and limitations

  • The exact matching base model and the remaining MiniMax H3 components are required and are not included here.
  • Four-step inference trades some fine detail and temporal stability for substantially lower sampling cost.
  • Visual fidelity, motion, audio quality, and prompt adherence vary with input quality, aspect ratio, duration, and seed.
  • This repository does not modify or redistribute the MiniMax H3 base checkpoints. Follow the upstream model's license and usage terms.
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Space using joyfox/MiniMax-H3-Turbo 1