Merge commit '70d0672ee306019c7dba8f799a273ec486bec95b' as 'vendor/dumas_minimax_h3_refmod'
This commit is contained in:
@@ -0,0 +1,56 @@
|
||||
# RefMod v0.2.0 — Master, audio references and loader fixes
|
||||
|
||||
## Highlights
|
||||
|
||||
- **Extract H3 RefMod Master:** image/video and optional audio in one node,
|
||||
sequential extraction with separate VAEs, a combined token budget and one
|
||||
bundle output. Visual and audio references save as separate compatible files.
|
||||
- **Integrated audio:** extract and load audio RefMods without installing
|
||||
H3AudioMod. Includes an input-music and generated-video example in the README.
|
||||
- **Save H3 RefMods:** a dedicated output node saves bundles without a connected
|
||||
Preview or sampler. Supports prefixes, subfolders and copy deduplication.
|
||||
- **Library and inspection:** search/filter the collection, select loader slots,
|
||||
inspect metadata/token counts and optionally preview stored visual/audio latents.
|
||||
|
||||
## Fixes and maintenance
|
||||
|
||||
- Linked mod names no longer fail queue validation before upstream nodes run;
|
||||
covers both the standard and Axis loaders.
|
||||
- Recursive subfolder discovery and saving to registered external RefMod roots
|
||||
respect ComfyUI's folder configuration.
|
||||
- File changes invalidate loader caches; loaded tensors have a bounded cache.
|
||||
- Step Curve no longer retains reference tensors between calls. Bridge injection
|
||||
is scoped to the MODEL branch and restores conditioning after errors.
|
||||
- Matching image/mask crops, bounded video sampling, runtime numeric/copy limits
|
||||
and optional total-token budgets.
|
||||
- Atomic file saves and explicit Master Created/Replaced destination logs.
|
||||
- Removed sibling-pack imports and the startup dependency warning. Legacy
|
||||
av_encoder inputs resolve through ComfyUI's native video VAE loader.
|
||||
- Shared extraction helpers and grouped multi-reference MSE refinement; explicit
|
||||
shuffle/subset options and experimental extraction presets.
|
||||
|
||||
## Known failure: voice transfer
|
||||
|
||||
**Audio support is not working voice cloning.** Music-reference conditioning has
|
||||
produced an observed result, but current speaker-identity transfer tests failed.
|
||||
The cause has not been isolated: H3/checkpoint behavior and the difference in how
|
||||
RefMod presents audio references to text encoding both remain under investigation.
|
||||
|
||||
The visual mode named `training` refines a compressed latent; it does not train
|
||||
H3 weights or learn a supervised control-to-target edit. The separate gradient
|
||||
probe is experimental and does not establish full-checkpoint training support.
|
||||
|
||||
## Updating
|
||||
|
||||
Validation: all 39 regression tests passed before release, using ComfyUI's
|
||||
embedded Python and real queue-validation modules. Previous audio codec checks
|
||||
used the real H3 audio VAE; these checks do not establish voice-transfer quality.
|
||||
|
||||
Update the node pack and restart ComfyUI to register the new nodes and library.
|
||||
Existing visual RefMods and legacy audio metadata remain readable. When using
|
||||
Save H3 RefMods after an extractor, set the extractor's save option to false to
|
||||
avoid writing twice. Master saves `name_visual` and `name_audio`; load both to
|
||||
reconstruct a mixed bundle. Existing files at those destinations are replaced.
|
||||
|
||||
The old Bridge Disarm node is retained for workflow compatibility; disable or
|
||||
bypass the bridge on its MODEL branch instead of relying on global state.
|
||||
Reference in New Issue
Block a user