Merge commit 'bf8f76505fdd25ea99770f262eb9371509bf226d' as 'vendor/dumas_h3_continuum'
This commit is contained in:
@@ -0,0 +1,33 @@
|
||||
# H3 Continuum Join V1 — Manual Wiring
|
||||
|
||||
## Clip 1
|
||||
|
||||
```text
|
||||
MiniMax H3 Image to Video ── conditioning/latent ─┐
|
||||
H3 model → Sage → Sol ───────────────────────────┼→ H3 Continuum Join (state empty)
|
||||
└→ Spectrum → Basic Guider → Sampler
|
||||
Sampler output → Video VAE Decode / Audio VAE Decode
|
||||
└────────────────────────────────────→ H3 Continuum Finish
|
||||
└→ STATE 1
|
||||
```
|
||||
|
||||
## Clip 2
|
||||
|
||||
Duplicate the H3 conditioning/sampling group and connect `STATE 1` to the next `H3 Continuum Join.previous_state`. Use another seed for the next clip.
|
||||
|
||||
Two conditioning choices are supported:
|
||||
|
||||
1. **Identity anchored:** keep the original image connected. Join removes its spatial first-frame keyframe but retains the Qwen visual tokens as identity guidance.
|
||||
2. **Context only:** disconnect the image from the second MiniMax H3 Image to Video node. The previous AV state becomes the only visual timeline anchor.
|
||||
|
||||
## Clip 3+
|
||||
|
||||
Repeat the same pattern. State Save/Load is optional when every clip is in one graph. Use numbered state slots when clips are approved across separate runs.
|
||||
|
||||
## Recommended accelerator order
|
||||
|
||||
```text
|
||||
MODEL → SageAttention → Sol-Attn → H3 Continuum Join → Spectrum → Basic Guider
|
||||
```
|
||||
|
||||
The order is shown for clarity. Continuum uses `APPLY_MODEL`, Spectrum uses `DIFFUSION_MODEL`, and Sage/Sol remain attention overrides.
|
||||
@@ -0,0 +1,68 @@
|
||||
# H3 Continuum Sampler V2 — 配線
|
||||
|
||||
## MODEL
|
||||
|
||||
```text
|
||||
UNET Loader
|
||||
→ Patch Sage Attention KJ
|
||||
→ Sol-Attn Patch
|
||||
→ Power LoRA Loader(任意)
|
||||
→ Spectrum Apply MiniMax H3
|
||||
→ H3 Continuum Sampler V2.model
|
||||
```
|
||||
|
||||
## 共有入力
|
||||
|
||||
```text
|
||||
CLIP Loader → clip
|
||||
Video VAE → video_vae
|
||||
Audio VAE → audio_vae
|
||||
KSampler Select → sampler
|
||||
Basic Scheduler → sigmas
|
||||
Load Image → ImageScaleToTotalPixels → first_frame
|
||||
GetImageSize.width/height → width/height(widgetをinputへ変換して接続する場合)
|
||||
```
|
||||
|
||||
## 出力
|
||||
|
||||
```text
|
||||
Sampler V2.images ─→ CreateVideo.images
|
||||
Sampler V2.audio ─→ CreateVideo.audio
|
||||
CreateVideo ─→ SaveVideo
|
||||
|
||||
Sampler V2.session ─→ Save Session(任意)
|
||||
```
|
||||
|
||||
## 3×5秒の初期値
|
||||
|
||||
```text
|
||||
prompt_mode: Fixed — one prompt
|
||||
chunks: 3
|
||||
chunk_seconds: 5.0
|
||||
continuity: Balanced — 22 frames
|
||||
base_seed: 固定値
|
||||
audio_continuity: true
|
||||
exact_total_duration: true
|
||||
diagnostics: Basic
|
||||
reroll_from_chunk: 0
|
||||
reroll_nonce: 0
|
||||
strict_compatibility: true
|
||||
```
|
||||
|
||||
## 再開
|
||||
|
||||
```text
|
||||
Load Session.session → Sampler V2.session
|
||||
chunks: 保存時より大きい値
|
||||
reroll_from_chunk: 0
|
||||
```
|
||||
|
||||
## 最終チャンクだけリロール
|
||||
|
||||
```text
|
||||
Load Session.session → Sampler V2.session
|
||||
reroll_from_chunk: 最終チャンク番号
|
||||
reroll_nonce: 1以上へ変更
|
||||
```
|
||||
|
||||
同梱の`H3_Continuum_V2_3x5s.json`は、上記配線を1本のV2ノードにまとめた編集可能なComfyUI workflow例です。モデル名、入力画像、Prompt、LoRAを自分の環境に合わせて変更してください。
|
||||
@@ -0,0 +1,31 @@
|
||||
H3 Continuum V2 standard workflow
|
||||
|
||||
Contents:
|
||||
- H3_Continuum_V2.json
|
||||
- H3_Continuum_V2_reference.webp
|
||||
|
||||
Setup:
|
||||
1. Copy H3_Continuum_V2_reference.webp to ComfyUI/input/.
|
||||
2. Drag H3_Continuum_V2.json onto the ComfyUI canvas.
|
||||
3. Install or replace any custom nodes reported as missing.
|
||||
4. Confirm the model selections before queueing.
|
||||
|
||||
Default profile:
|
||||
- 3 chunks x 5.0 seconds
|
||||
- Timeline prompt with three sections
|
||||
- Scale Image to Total Pixels: area, 0.50 MP, 32-step rounding
|
||||
- Continuity: Balanced, 22 frames
|
||||
- Seam correction: Auto
|
||||
- Report Detail: Basic
|
||||
|
||||
Quality note:
|
||||
- In the current local A/B sample, Seam Correction Off produced the least noticeable visual boundary.
|
||||
- Compare Auto and Off with the same seed; keep Off when Native Continuity already provides a clean join.
|
||||
|
||||
Reference test environment:
|
||||
- NVIDIA GeForce RTX 5060 Ti 16GB
|
||||
- 64GB system RAM
|
||||
- Python 3.13.12, PyTorch 2.13.0+cu130, CUDA 13.0
|
||||
- SageAttention 2.2.0+cu130, KJNodes FP8 CUDA++, compile disabled
|
||||
|
||||
The 0.50 MP profile is a starting point. If VRAM is insufficient, reduce the image scale to 0.30 MP.
|
||||
Binary file not shown.
|
After Width: | Height: | Size: 47 KiB |
File diff suppressed because it is too large
Load Diff
File diff suppressed because it is too large
Load Diff
+2414
File diff suppressed because it is too large
Load Diff
@@ -0,0 +1,24 @@
|
||||
{
|
||||
"h3_continuum_join": {
|
||||
"continuity": "Balanced — 22 frames",
|
||||
"extend_seconds": 5.0,
|
||||
"audio_continuity": true,
|
||||
"first_frame_policy": "Use Continuum context; keep visual identity tokens (Recommended)",
|
||||
"preserve_last_frame": true,
|
||||
"strict_compatibility": true,
|
||||
"debug": false
|
||||
},
|
||||
"spectrum": {
|
||||
"blend_weight": 0.5,
|
||||
"degree": 1,
|
||||
"warmup_steps": 1,
|
||||
"offline_smoothing_replay": true,
|
||||
"audio_blend_weight": 0.0
|
||||
},
|
||||
"validation_matrix": [
|
||||
"Sage only",
|
||||
"Sage + Sol",
|
||||
"Sage + Spectrum",
|
||||
"Sage + Sol + Spectrum"
|
||||
]
|
||||
}
|
||||
@@ -0,0 +1,29 @@
|
||||
{
|
||||
"h3_continuum_sampler_v2": {
|
||||
"chunks": 3,
|
||||
"chunk_seconds": 5.0,
|
||||
"continuity": "Balanced — 22 frames",
|
||||
"audio_continuity": true,
|
||||
"exact_total_duration": true,
|
||||
"diagnostics": "Basic",
|
||||
"reroll_from_chunk": 0,
|
||||
"reroll_nonce": 0,
|
||||
"strict_compatibility": true,
|
||||
"debug": false
|
||||
},
|
||||
"sampling": {
|
||||
"sampler": "res_multistep",
|
||||
"scheduler": "simple",
|
||||
"steps": 20,
|
||||
"denoise": 1.0,
|
||||
"turbo_lora": false
|
||||
},
|
||||
"spectrum": {
|
||||
"enabled": true,
|
||||
"blend_weight": 0.5,
|
||||
"degree": 1,
|
||||
"warmup_steps": 1,
|
||||
"offline_smoothing_replay": true,
|
||||
"audio_blend_weight": 0.0
|
||||
}
|
||||
}
|
||||
@@ -0,0 +1,5 @@
|
||||
The same woman begins singing in one continuous shot. Preserve identity, clothing, background, lighting, camera direction, vocal timbre, and piano tempo. End while the phrase is still continuing.
|
||||
---
|
||||
Seamless continuation of the immediately preceding clip. Continue the exact mouth motion, sustained note, breathing state, camera movement, vocal key, tempo, and piano phrase. No cut or reset.
|
||||
---
|
||||
Seamless final continuation. Preserve all identity and motion. Complete the vocal phrase and piano cadence naturally during the final second, then release a soft breath. No scene change.
|
||||
@@ -0,0 +1,8 @@
|
||||
[0-5s]
|
||||
The same woman begins singing in a single continuous shot. The melody and camera movement remain unresolved at the boundary.
|
||||
|
||||
[5-10s]
|
||||
Continue the exact performance, mouth motion, breath, vocal key, piano tempo, and camera movement with no reset.
|
||||
|
||||
[10-15s]
|
||||
Continue seamlessly, then resolve the final vocal note and piano phrase naturally in the last second.
|
||||
Vendored
+2319
File diff suppressed because it is too large
Load Diff
Vendored
BIN
Binary file not shown.
+2319
File diff suppressed because it is too large
Load Diff
Binary file not shown.
+2321
File diff suppressed because it is too large
Load Diff
BIN
Binary file not shown.
+2321
File diff suppressed because it is too large
Load Diff
BIN
Binary file not shown.
+2078
File diff suppressed because it is too large
Load Diff
Binary file not shown.
File diff suppressed because it is too large
Load Diff
Binary file not shown.
Vendored
+2342
File diff suppressed because it is too large
Load Diff
BIN
Binary file not shown.
+2414
File diff suppressed because it is too large
Load Diff
BIN
Binary file not shown.
Reference in New Issue
Block a user