Skip to content

Add Qwen3-TTS Twinkle LoRA integration (2/5) - #356

Open
Wallbreazzz wants to merge 6 commits into
modelscope:mainfrom
Wallbreazzz:cookbook/qwen3-tts-02-lora
Open

Wallbreazzz wants to merge 6 commits into
modelscope:mainfrom
Wallbreazzz:cookbook/qwen3-tts-02-lora

Conversation

@Wallbreazzz

@Wallbreazzz Wallbreazzz commented Oct 30, 2026 •

Copy link
Copy Markdown

Scope

Connects the cookbook to Twinkle local-mode model loading, tokenization and LoRA targeting. Model snapshots, gradient assertions and frozen-weight digests live under tests rather than the runtime package. The adapter identifier is retained for checkpoint compatibility.

Part 2/5 of the Qwen3-TTS cookbook proposal (RFC #279), open together for maintainers to assess alongside Swift/TTS integration.

Dependencies

This PR targets upstream main; later layers have cumulative diffs including prerequisites. Review this layer using the exact incremental comparison.

Exact head: 0a8f3d17fa489efe8bdf90815443d9a1686d1adf. Integrate prerequisites first, then update remaining PR diffs, or choose a consolidated integration. These overlapping PRs should not be merged independently in arbitrary order.

  1. Add Qwen3-TTS data and forward/loss contracts (1/5) #350 — data and forward/loss contracts
  2. Add Qwen3-TTS Twinkle LoRA integration (2/5) #356 — Twinkle LoRA integration
  3. Add Qwen3-TTS gradient accumulation and checkpoint recovery (3/5) #357 — accumulation and recovery
  4. Add Qwen3-TTS manifest preparation and training CLI (4/5) #358 — manifest preparation and training CLI
  5. Add Qwen3-TTS minimal adapter inference (5/5) #359 — minimal adapter inference

Validation

  • Current cumulative snapshot: 18 local CPU tests, 16 passed, 2 official-package checks skipped in isolated mode.
  • Before this scope cleanup, the corrected forward was exercised through real multi-step training, recovery, adapter reload and generation on one Ascend NPU. The prior integrated commit 791b488f62ae9b5a246e9ab85ce23e61f56a6c02 passed targeted native contracts and generated sample-identical audio to the reviewed reference pair.
  • The cleaned integrated commit 2f2294641f79be1791f2d282da6d96fbc951fe72 subsequently passed 2 causal contracts and 4 inference CLI/waveform contracts with installed Twinkle on the remote NPU host. Its minimal entrypoint generated base and existing-adapter audio on one Ascend NPU; both waveforms were independently verified sample-identical to the previously reviewed pair. This is targeted integrated verification, not a rerun of the full training/resume suite or native validation of every intermediate commit.
  • Scope: local single-NPU bf16 LoRA, Qwen3-TTS 12Hz Base. Multi-card, CUDA, client/server execution and other TTS families are not covered. No private dataset, customer audio, weights, listening UI or project acceptance workflow is included.

@Wallbreazzz Wallbreazzz changed the title Add Qwen3-TTS Twinkle and LoRA integration (2/5) Add Qwen3-TTS Twinkle LoRA integration (2/5) Oct 30, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant