Files
comfyui-workflows/optimized/R2V/minimax/README.md
T

105 lines
7.7 KiB
Markdown
Raw Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
# MiniMax H3 — optimized reference-to-video
This is the MiniMax H3 R2V evaluation workflow. It is derived from the
imported MiniMax H3 int8 graph and kept separate from the source workflows
under `models/minimax/`.
## Fixed comparison inputs
- Reference: `reference.png`, supplied as Picture 1
- Prompt: `prompt.txt`
- Seed: fixed within each comparison batch
- Resolution: 864×480 (480p landscape)
- Initial duration: 3 seconds
- CFG: **1.0**
- Model, text encoder, VAE, batch size, and denoise: fixed
- Audio: none for the initial R2V matrix
Only the variables in the matrix may change. Before each row is run, confirm
that the named node or sampler exists on the live server. Unsupported rows
must be marked `Unsupported` with the exact validation error; do not silently
substitute another configuration.
## Files
- `workflow.json` — ComfyUI web workflow derived from the source graph
- `reference.png` — fixed character reference
- `prompt.txt` — fixed haunted-room investigation prompt
- `variables.json` — fixed comparison variables
- `results/` — labelled outputs and matching JSON metadata
## Test matrix
All rows are planned; only the scheduled MM-R2V-01 and MM-R2V-02 control/
memory tests should be run first. Later phases are gated on valid 3-second
results and should not be queued automatically with Phase 1.
| ID | Phase | Efficiency / node combination | Steps | Sampler | Scheduler | Duration (s) | CFG | Tested? | Valid? | Current Best | Runtime (s) |
|---|---|---|---:|---|---|---:|---:|---|---|---|---:|
| MM-R2V-01 | A control | Base workflow | 8 | workflow default | workflow default | 3 | 1.0 | Yes | Yes | No | 320.4 |
| MM-R2V-02 | A memory | MemoryEfficientSageAttentionPatch | 8 | workflow default | workflow default | 3 | 1.0 | Yes | Unsupported | No | 5.0 |
| MM-R2V-03 | A memory | Model cache/offload path only | 8 | workflow default | workflow default | 3 | 1.0 | Yes | Yes | No | 365.3 |
| MM-R2V-04 | A attention | Sol-Attn only | 4 | workflow default | workflow default | 3 | 1.0 | Yes | Yes | No | 205.7 |
| MM-R2V-05 | A attention | Spectrum only | 4 | euler | simple | 3 | 1.0 | Yes | Yes | No | 158.881 |
| MM-R2V-06 | A LoRA | Turbo LoRA only | 4 | euler | simple | 3 | 1.0 | Yes | Yes | No | 167.078 |
| MM-R2V-07 | A combined | Memory + Sol-Attn | 4 | euler | simple | 3 | 1.0 | Yes | Yes | No | 202.124 |
| MM-R2V-08 | A combined | Memory + Spectrum | 4 | euler | simple | 3 | 1.0 | Yes | Yes | No | 148.031 |
| MM-R2V-09 | A combined | Memory + Turbo LoRA | 4 | euler | simple | 3 | 1.0 | Yes | Yes | No | 179.447 |
| MM-R2V-10 | A combined | Sol-Attn + Turbo LoRA | 4 | euler | simple | 3 | 1.0 | Yes | Yes | No | 199.032 |
| MM-R2V-11 | A combined | Spectrum + Turbo LoRA | 4 | euler | simple | 3 | 1.0 | Yes | Yes | No | 146.926 |
| MM-R2V-12 | A combined | Memory + Sol-Attn + Turbo LoRA | 4 | euler | simple | 3 | 1.0 | Yes | Yes | No | 198.186 |
| MM-R2V-13 | B steps | Best valid Phase A path | 4 | best valid | best valid | 3 | 1.0 | No | — | No | — |
| MM-R2V-14 | B steps | Best valid Phase A path | 6 | best valid | best valid | 3 | 1.0 | No | — | No | — |
| MM-R2V-15 | B steps | Best valid Phase A path | 8 | best valid | best valid | 3 | 1.0 | No | — | No | — |
| MM-R2V-16 | B steps | Best valid Phase A path | 12 | best valid | best valid | 3 | 1.0 | No | — | No | — |
| MM-R2V-17 | B sampler | Best valid Phase A path | 6 | euler | simple | 3 | 1.0 | No | — | No | — |
| MM-R2V-18 | B sampler | Best valid Phase A path | 6 | euler_cfg_pp | simple | 3 | 1.0 | No | — | No | — |
| MM-R2V-19 | B sampler | Best valid Phase A path | 6 | res_multistep | simple | 3 | 1.0 | No | — | No | — |
| MM-R2V-20 | B sampler | Best valid Phase A path | 6 | dpmpp_2m | simple | 3 | 1.0 | No | — | No | — |
| MM-R2V-21 | B scheduler | Best valid Phase A path | 6 | best valid | beta | 3 | 1.0 | No | — | No | — |
| MM-R2V-22 | B scheduler | Best valid Phase A path | 6 | best valid | sgm_uniform | 3 | 1.0 | No | — | No | — |
| MM-R2V-23 | B scheduler | Best valid Phase A path | 6 | best valid | karras | 3 | 1.0 | No | — | No | — |
| MM-R2V-24 | B balance | Best valid Phase A path | 8 | best valid | best valid | 3 | 1.0 | No | — | No | — |
| MM-R2V-25 | C duration | Best 3-second path | best | best | best | 6 | 1.0 | No | — | No | — |
| MM-R2V-26 | C duration | Best 3-second path | best | best | best | 10 | 1.0 | No | — | No | — |
| MM-R2V-27 | C duration | Best 3-second path | best | best | best | 20 | 1.0 | No | — | No | — |
| MM-R2V-28 | D upscale | Best 3-second path + MiniMax latent upscale | best | best | best | 3 | 1.0 | No | — | No | — |
| MM-R2V-29 | D upscale | Best 3-second path + RTX Super Resolution | best | best | best | 3 | 1.0 | No | — | No | — |
| MM-R2V-30 | E extend | Best valid path, concatenate two clips | best | best | best | 6 | 1.0 | No | — | No | — |
| MM-R2V-31 | E extend | Best valid path, concatenate three clips | best | best | best | 9 | 1.0 | No | — | No | — |
| MM-R2V-32 | F quality threshold | Base workflow, non-Turbo minimum quality steps | 20 | euler | simple | 3 | 1.0 | Queued | — | No | — |
| MM-R2V-33 | F quality threshold | Cache/offload path, non-Turbo minimum quality steps | 20 | euler | simple | 3 | 1.0 | Queued | — | No | — |
| MM-R2V-34 | F quality threshold | Turbo LoRA only, minimum Turbo steps | 4 | euler | simple | 3 | 1.0 | Queued | — | No | — |
| MM-R2V-35 | F quality threshold | Spectrum + Turbo LoRA, minimum Turbo steps | 4 | euler | simple | 3 | 1.0 | Queued | — | No | — |
| MM-R2V-36 | G Spectrum sweep | Spectrum only, blend weight 0.25 | 20 | euler | simple | 3 | 1.0 | Queued | — | No | — |
| MM-R2V-37 | G Spectrum sweep | Spectrum only, blend weight 0.75 | 20 | euler | simple | 3 | 1.0 | Queued | — | No | — |
| MM-R2V-38 | G Spectrum sweep | Spectrum only, warmup/tail steps 2/2 | 20 | euler | simple | 3 | 1.0 | Queued | — | No | — |
| MM-R2V-39 | G Spectrum sweep | Spectrum only, max history 16 | 20 | euler | simple | 3 | 1.0 | Queued | — | No | — |
| MM-R2V-40 | G Spectrum + Turbo | Spectrum + Turbo, blend weight 0.25 | 4 | euler | simple | 3 | 1.0 | Queued | — | No | — |
| MM-R2V-41 | G Spectrum + Turbo | Spectrum + Turbo, blend weight 0.75 | 4 | euler | simple | 3 | 1.0 | Queued | — | No | — |
| MM-R2V-42 | G Spectrum + Turbo | Spectrum + Turbo, replay disabled | 4 | euler | simple | 3 | 1.0 | Queued | — | No | — |
| MM-R2V-43 | G Spectrum + Turbo | Spectrum + Turbo, max history 16 | 4 | euler | simple | 3 | 1.0 | Queued | — | No | — |
## Result requirements
Each run must save `results/<test-id>.mp4` and matching
`results/<test-id>.json`. Metadata must include the exact reference checksum,
prompt hash, seed, resolution, duration, CFG, steps, sampler, scheduler,
active nodes, runtime, VRAM, output checksum, validity, and visual/motion
verdict. A result becomes Current Best only when it is valid and objectively
better than the existing best; keep exactly one Current Best.
Phase A collection status: rows 01 and 03–12 have valid MP4 outputs recorded; MM-R2V-05 through MM-R2V-12 were collected from the 2026-09-26 live ComfyUI history. Row 02 remains unsupported because the live SageAttention patch failed validation/runtime. Subjective visual review was not performed, so Current Best was not changed.
Phase F rule: non-Turbo configurations must use at least 20 steps; Turbo
LoRA configurations may use 4 steps. This rule is applied to the queued
quality-threshold tests above.
## Execution order
1. Run MM-R2V-01 and MM-R2V-02 as the initial paired efficiency test.
2. Run Phase A one-node and safe-combination tests on 3 seconds.
3. Optimize steps, sampler, scheduler, and quality at 3 seconds.
4. Only then test 6/10/20-second clips.
5. Test continuation/concatenation, then latent upscale and RTX Super Resolution.