git-subtree-dir: vendor/dumas_minimax_h3_refmod git-subtree-split: 517e8c419a8584fbf69fceb487bc39d83e6a6ec8
3.1 KiB
RefMod v0.2.0 — Master, audio references and loader fixes
Highlights
- Extract H3 RefMod Master: image/video and optional audio in one node, sequential extraction with separate VAEs, a combined token budget and one bundle output. Visual and audio references save as separate compatible files.
- Integrated audio: extract and load audio RefMods without installing H3AudioMod. Includes an input-music and generated-video example in the README.
- Save H3 RefMods: a dedicated output node saves bundles without a connected Preview or sampler. Supports prefixes, subfolders and copy deduplication.
- Library and inspection: search/filter the collection, select loader slots, inspect metadata/token counts and optionally preview stored visual/audio latents.
Fixes and maintenance
- Linked mod names no longer fail queue validation before upstream nodes run; covers both the standard and Axis loaders.
- Recursive subfolder discovery and saving to registered external RefMod roots respect ComfyUI's folder configuration.
- File changes invalidate loader caches; loaded tensors have a bounded cache.
- Step Curve no longer retains reference tensors between calls. Bridge injection is scoped to the MODEL branch and restores conditioning after errors.
- Matching image/mask crops, bounded video sampling, runtime numeric/copy limits and optional total-token budgets.
- Atomic file saves and explicit Master Created/Replaced destination logs.
- Removed sibling-pack imports and the startup dependency warning. Legacy av_encoder inputs resolve through ComfyUI's native video VAE loader.
- Shared extraction helpers and grouped multi-reference MSE refinement; explicit shuffle/subset options and experimental extraction presets.
Known failure: voice transfer
Audio support is not working voice cloning. Music-reference conditioning has produced an observed result, but current speaker-identity transfer tests failed. The cause has not been isolated: H3/checkpoint behavior and the difference in how RefMod presents audio references to text encoding both remain under investigation.
The visual mode named training refines a compressed latent; it does not train
H3 weights or learn a supervised control-to-target edit. The separate gradient
probe is experimental and does not establish full-checkpoint training support.
Updating
Validation: all 39 regression tests passed before release, using ComfyUI's embedded Python and real queue-validation modules. Previous audio codec checks used the real H3 audio VAE; these checks do not establish voice-transfer quality.
Update the node pack and restart ComfyUI to register the new nodes and library.
Existing visual RefMods and legacy audio metadata remain readable. When using
Save H3 RefMods after an extractor, set the extractor's save option to false to
avoid writing twice. Master saves name_visual and name_audio; load both to
reconstruct a mixed bundle. Existing files at those destinations are replaced.
The old Bridge Disarm node is retained for workflow compatibility; disable or bypass the bridge on its MODEL branch instead of relying on global state.