Files
comfyui-workflows/optimized/R2V/minimax/sparse-latent-upscale/README.md
T

73 lines
3.6 KiB
Markdown
Raw Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
# MiniMax H3 sparse-attention latent-upscale study
This workflow variant is based on the supplied CSGlide H3 workflow. It uses:
- `fastvideo_fasth3_8step_v2_pruned_int8_convrot.safetensors`
- Block Sparse Attention with VSA selection
- Comfy Kitchen attention, MiniMax low-VRAM attention and chunked feed-forward
- 8-step Euler + beta initial generation
- MiniMax latent upscaling with tiled spatial splitting and latent refinement
- The supplied VAE, audio VAE, references, seed and one approximately 10-second clip
The workflow is preserved in `workflow-source.json`; `workflow.json` is the tracked test copy with the enhanced common prompt and corrected reference filenames.
## Fixed test input
- **References:** `references/Scene022.png` as `@image1`, `references/Char034_TurnaroundFull_001.png` as `@image2`
- **Clip:** 243 frames at 24 fps, approximately 10.125 seconds
- **Seed:** `317182692766673` for the initial sampler; keep it unchanged in every test
- **Initial sampler:** Euler, beta scheduler, 8 steps, denoise 1.0
- **Latent refinement:** SA solver, simple scheduler, 3 steps, denoise 0.2, CFG 1
- **Prompt:** `prompt.txt`; do not change it between tests
## Test matrix
Every test changes only the listed variables. Record runtime, peak VRAM, success/failure, output dimensions, visible seams, detail retention, anatomy, motion stability and audio output in the matching result JSON.
### Phase A — Upscale ceiling
| ID | Initial latent | Target latent | Tile | Purpose |
|---|---:|---:|---:|---|
| SLU-01 | 672×384 | 1344×768 | supplied baseline tile | Reproduce the supplied good result |
| SLU-02 | 672×384 | 1920×1080 | supplied baseline tile | Test the desired 1080p endpoint |
| SLU-03 | 672×384 | 1680×960 | supplied baseline tile | Intermediate fallback if 1080p fails or is too slow |
| SLU-04 | 672×384 | 1536×864 | supplied baseline tile | Practical quality/runtime fallback |
### Phase B — Tile size
Use the best successful target from Phase A and compare tile sizes while keeping overlap and all other settings fixed:
- SLU-05: 512×512 tiles
- SLU-06: 640×640 tiles
- SLU-07: 768×768 tiles
- SLU-08: 864×480-style wide tiles from the supplied workflow
- SLU-09: full-frame/no split if VRAM permits
For each tile, preserve 128-pixel spatial overlap where possible, then check seam visibility, runtime and peak VRAM.
### Phase C — Initial generation dimensions
Use the best target and tile combination:
- SLU-10: 672×384 supplied baseline
- SLU-11: 768×432
- SLU-12: 832×480 supplied alternate resolution node
- SLU-13: 960×544
- SLU-14: 1024×576 if the 8GB card remains stable
The initial aspect ratio must remain 16:9 and the same final target must be used for fair comparison.
### Phase D — Combined candidates
- SLU-15: best upscale ceiling + best tile + best initial dimensions
- SLU-16: quality-first combination, accepting a longer runtime if the visual improvement is clear
- SLU-17: practical production combination targeting a predictable sub-hour render
## First two runs
Run **SLU-01** and **SLU-02** first. SLU-01 validates the supplied configuration. SLU-02 directly tests whether 1080p is feasible on the RTX 3070. If SLU-02 exhausts VRAM, stalls or becomes impractically slow, stop that run and continue with SLU-03/04 rather than changing the prompt or seed.
## Evidence and verdict
The test is **VALIDATED** only when a configuration completes with a usable video and recorded measurements. A completed render with unacceptable seams, detail loss or motion instability is **PARTIAL**, not a success. Keep all result JSON and MP4 files under `results/`.