Inflect-Micro-v2 for AXera NPU(三芯片)

High-quality English TTS (VITS) optimized for AX650 / AX620E / AX637 NPUs.

芯片支持

Chip Encoder Decoder SDK
AX650 NPU (axmodel) NPU (axmodel) 老一代 inflect_tts_sdk(emb + dp 分离)
AX620E NPU (axmodel) NPU (axmodel) 新一代 inflect_ax_tts
AX637 NPU (axmodel) NPU (axmodel) 新一代 inflect_ax_tts

更新记录:2026-08-03 AX620E/AX637 decoder 已升级为全 NPU。 注:AX620E/AX637 已从“encoder NPU + decoder CPU(onnxruntime)”升级为 encoder/decoder 双 NPU。AX650 保持原有全 NPU 交付与老 SDK 不变。

模型

models/
  ax650/   — 老一代全 NPU(encoder/decoder axmodel + dp.onnx + emb.npy)
  ax620e/  — 新一代全 NPU(encoder.axmodel + decoder.axmodel, T=256/Tp=512)
  ax637/   — 新一代全 NPU(encoder.axmodel + decoder.axmodel, 权重 S16 升级版)

新一代 encoder 输入 tokens [1,256] S32 + x_lengths [1] S32,输出 m_p/logs_p [1,192,256]logw [1,1,256];decoder 输入 z_p [1,192,512] fp32, 输出 wav [1,1,131072](≈5.46 s/块)。Host 侧完成音素前端、时长取整、 generate_path 对齐、prior 扩展与噪声注入(seed 可控)。

快速开始

bash setup.sh

# AX650(老 SDK)
bash run.sh "Hello world." output.wav cli ax650

# AX620E / AX637(新 SDK,encoder+decoder 全 NPU)
bash run.sh "Hello world." output.wav cli ax620e
bash run.sh "Hello world." output.wav cli ax637

新 SDK 也可以直接用:

cd python
python3 example.py \
  --encoder ../models/ax620e/encoder.axmodel \
  --decoder ../models/ax620e/decoder.axmodel \
  --text "The quick brown fox jumps over the lazy dog." --output out.wav

音频示例(AX650 NPU)

"Hello and welcome to Inflect Micro V2 text to speech."

"The weather today is sunny with a gentle breeze."

"Once upon a time, there lived a curious robot who loved to sing."

"Neural voice synthesis is the next frontier of AI."

"This audio was generated entirely on the AX650 NPU chip."

目录结构

models/
  ax650/    — 全 NPU(老一代模型,emb + dp 分离)
  ax620e/   — 全 NPU(新一代模型)
  ax637/    — 全 NPU(新一代模型,decoder 权重 S16)
python/
  inflect_tts_sdk/   — 老 SDK(AX650)
  inflect_ax_tts/    — 新 SDK(AX620E/AX637)+ example.py + tests
cpp/
  inflect_tts_sdk/   — 老 C++ SDK(AX650)
  CMakeLists.txt + src/ — 新 C++ SDK(AX620E/AX637)
samples/   — 音频示例(AX650 NPU 生成)

License & Attribution(许可与署名)

本仓库是 owensong/Inflect-Micro-v2 (作者 Owen Song,Apache-2.0)的 NPU 转换与再分发。原始 Inflect 代码与权重以 Apache License 2.0 发布;本仓库的转换产物(AXMODEL、SDK)同样以 Apache-2.0 许可提供。

  • 许可全文:LICENSE(Apache License 2.0)
  • 署名与修改说明:NOTICE.md
  • 第三方组件声明:THIRD_PARTY_NOTICES.mdthird_party/
Downloads last month
59
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including AXERA-TECH/inflect_micro_v2