git-subtree-dir: vendor/dumas_minimax_h3_refmod git-subtree-split: 517e8c419a8584fbf69fceb487bc39d83e6a6ec8
57 lines
3.1 KiB
Markdown
57 lines
3.1 KiB
Markdown
# RefMod v0.2.0 — Master, audio references and loader fixes
|
|
|
|
## Highlights
|
|
|
|
- **Extract H3 RefMod Master:** image/video and optional audio in one node,
|
|
sequential extraction with separate VAEs, a combined token budget and one
|
|
bundle output. Visual and audio references save as separate compatible files.
|
|
- **Integrated audio:** extract and load audio RefMods without installing
|
|
H3AudioMod. Includes an input-music and generated-video example in the README.
|
|
- **Save H3 RefMods:** a dedicated output node saves bundles without a connected
|
|
Preview or sampler. Supports prefixes, subfolders and copy deduplication.
|
|
- **Library and inspection:** search/filter the collection, select loader slots,
|
|
inspect metadata/token counts and optionally preview stored visual/audio latents.
|
|
|
|
## Fixes and maintenance
|
|
|
|
- Linked mod names no longer fail queue validation before upstream nodes run;
|
|
covers both the standard and Axis loaders.
|
|
- Recursive subfolder discovery and saving to registered external RefMod roots
|
|
respect ComfyUI's folder configuration.
|
|
- File changes invalidate loader caches; loaded tensors have a bounded cache.
|
|
- Step Curve no longer retains reference tensors between calls. Bridge injection
|
|
is scoped to the MODEL branch and restores conditioning after errors.
|
|
- Matching image/mask crops, bounded video sampling, runtime numeric/copy limits
|
|
and optional total-token budgets.
|
|
- Atomic file saves and explicit Master Created/Replaced destination logs.
|
|
- Removed sibling-pack imports and the startup dependency warning. Legacy
|
|
av_encoder inputs resolve through ComfyUI's native video VAE loader.
|
|
- Shared extraction helpers and grouped multi-reference MSE refinement; explicit
|
|
shuffle/subset options and experimental extraction presets.
|
|
|
|
## Known failure: voice transfer
|
|
|
|
**Audio support is not working voice cloning.** Music-reference conditioning has
|
|
produced an observed result, but current speaker-identity transfer tests failed.
|
|
The cause has not been isolated: H3/checkpoint behavior and the difference in how
|
|
RefMod presents audio references to text encoding both remain under investigation.
|
|
|
|
The visual mode named `training` refines a compressed latent; it does not train
|
|
H3 weights or learn a supervised control-to-target edit. The separate gradient
|
|
probe is experimental and does not establish full-checkpoint training support.
|
|
|
|
## Updating
|
|
|
|
Validation: all 39 regression tests passed before release, using ComfyUI's
|
|
embedded Python and real queue-validation modules. Previous audio codec checks
|
|
used the real H3 audio VAE; these checks do not establish voice-transfer quality.
|
|
|
|
Update the node pack and restart ComfyUI to register the new nodes and library.
|
|
Existing visual RefMods and legacy audio metadata remain readable. When using
|
|
Save H3 RefMods after an extractor, set the extractor's save option to false to
|
|
avoid writing twice. Master saves `name_visual` and `name_audio`; load both to
|
|
reconstruct a mixed bundle. Existing files at those destinations are replaced.
|
|
|
|
The old Bridge Disarm node is retained for workflow compatibility; disable or
|
|
bypass the bridge on its MODEL branch instead of relying on global state.
|