Files
comfyui-workflows/optimized/R2V/minimax/README.md
T
2026-09-28 11:22:25 +00:00

13 KiB
Raw Blame History

MiniMax H3 — optimized reference-to-video

This is the MiniMax H3 R2V evaluation workflow. The current production baseline is the validated Turbo LoRA graph in api-workflow.json; the older web-editor graph remains in workflow.json for reference and is not the current baseline.

Fixed comparison inputs

  • Reference: reference.png, supplied as Picture 1
  • Prompt: prompt.txt
  • Seed: fixed within each comparison batch
  • Resolution: 864×480 (480p landscape)
  • Initial duration: 3 seconds
  • CFG: 1.0
  • Model, text encoder, VAE, batch size, and denoise: fixed
  • Audio: none for the initial R2V matrix

Only the variables in the matrix may change. Before each row is run, confirm that the named node or sampler exists on the live server. Unsupported rows must be marked Unsupported with the exact validation error; do not silently substitute another configuration.

Files

  • workflow.json — ComfyUI web workflow derived from the source graph
  • api-workflow.json — validated API graph for the current Turbo baseline
  • reference.png — fixed character reference
  • prompt.txt — fixed haunted-room investigation prompt
  • variables.json — fixed comparison variables
  • results/ — labelled outputs and matching JSON metadata

Current best

MM-R2V-58 remains the 3-second production baseline: Turbo LoRA enabled, 8 steps, Res Multistep sampler, simple scheduler, CFG 1, 864×480, and 368.746s runtime. MM-R2V-61 is the quality reference for the 10-second bright park-and-robins prompt. MM-R2V-62 is the current 10-second speed baseline: SLA attention at 0.85 sparsity / block 32, with acceptable quality and a 525.745s runtime. The 0.90 variant was slower in quality terms and is not the baseline.

Test matrix

All rows are planned; only the scheduled MM-R2V-01 and MM-R2V-02 control/ memory tests should be run first. Later phases are gated on valid 3-second results and should not be queued automatically with Phase 1.

ID Phase Efficiency / node combination Steps Sampler Scheduler Duration (s) CFG Tested? Valid? Current Best Runtime (s)
MM-R2V-01 A control Base workflow 8 workflow default workflow default 3 1.0 Yes Yes No 320.4
MM-R2V-02 A memory MemoryEfficientSageAttentionPatch 8 workflow default workflow default 3 1.0 Yes Unsupported No 5.0
MM-R2V-03 A memory Model cache/offload path only 8 workflow default workflow default 3 1.0 Yes Yes No 365.3
MM-R2V-04 A attention Sol-Attn only 4 workflow default workflow default 3 1.0 Yes Yes No 205.7
MM-R2V-05 A attention Spectrum only 4 euler simple 3 1.0 Yes Yes No 158.881
MM-R2V-06 A LoRA Turbo LoRA only 4 euler simple 3 1.0 Yes Yes No 167.078
MM-R2V-07 A combined Memory + Sol-Attn 4 euler simple 3 1.0 Yes Yes No 202.124
MM-R2V-08 A combined Memory + Spectrum 4 euler simple 3 1.0 Yes Yes No 148.031
MM-R2V-09 A combined Memory + Turbo LoRA 4 euler simple 3 1.0 Yes Yes No 179.447
MM-R2V-10 A combined Sol-Attn + Turbo LoRA 4 euler simple 3 1.0 Yes Yes No 199.032
MM-R2V-11 A combined Spectrum + Turbo LoRA 4 euler simple 3 1.0 Yes Yes No 146.926
MM-R2V-12 A combined Memory + Sol-Attn + Turbo LoRA 4 euler simple 3 1.0 Yes Yes No 198.186
MM-R2V-13 B steps Best valid Phase A path 4 best valid best valid 3 1.0 No — No —
MM-R2V-14 B steps Best valid Phase A path 6 best valid best valid 3 1.0 No — No —
MM-R2V-15 B steps Best valid Phase A path 8 best valid best valid 3 1.0 No — No —
MM-R2V-16 B steps Best valid Phase A path 12 best valid best valid 3 1.0 No — No —
MM-R2V-17 B sampler Best valid Phase A path 6 euler simple 3 1.0 No — No —
MM-R2V-18 B sampler Best valid Phase A path 6 euler_cfg_pp simple 3 1.0 No — No —
MM-R2V-19 B sampler Best valid Phase A path 6 res_multistep simple 3 1.0 No — No —
MM-R2V-20 B sampler Best valid Phase A path 6 dpmpp_2m simple 3 1.0 No — No —
MM-R2V-21 B scheduler Best valid Phase A path 6 best valid beta 3 1.0 No — No —
MM-R2V-22 B scheduler Best valid Phase A path 6 best valid sgm_uniform 3 1.0 No — No —
MM-R2V-23 B scheduler Best valid Phase A path 6 best valid karras 3 1.0 No — No —
MM-R2V-24 B balance Best valid Phase A path 8 best valid best valid 3 1.0 No — No —
MM-R2V-25 C duration Best 3-second path best best best 6 1.0 No — No —
MM-R2V-26 C duration Best 3-second path best best best 10 1.0 No — No —
MM-R2V-27 C duration Best 3-second path best best best 20 1.0 No — No —
MM-R2V-28 D upscale Best 3-second path + MiniMax latent upscale best best best 3 1.0 No — No —
MM-R2V-29 D upscale Best 3-second path + RTX Super Resolution best best best 3 1.0 No — No —
MM-R2V-30 E extend Best valid path, concatenate two clips best best best 6 1.0 No — No —
MM-R2V-31 E extend Best valid path, concatenate three clips best best best 9 1.0 No — No —
MM-R2V-32 F quality threshold 20-step graph; Sol-Attn branch present, Spectrum disabled 20 er_sde simple 3 1.0 Yes Yes No 814.3
MM-R2V-33 F quality threshold 20-step cache graph; Sol-Attn branch present, Spectrum disabled 20 er_sde simple 3 1.0 Yes Yes No 774.2
MM-R2V-34 F quality threshold Turbo LoRA only, minimum Turbo steps 4 euler simple 3 1.0 Yes Yes No 220.5
MM-R2V-35 F quality threshold Spectrum + Turbo LoRA, minimum Turbo steps 4 euler simple 3 1.0 Yes Yes No 145.6
MM-R2V-36 G Spectrum sweep Spectrum only, blend weight 0.25 20 euler simple 3 1.0 Yes Yes No 461.9
MM-R2V-37 G Spectrum sweep Spectrum only, blend weight 0.75 20 euler simple 3 1.0 Yes Yes No 452.3
MM-R2V-38 G Spectrum sweep Spectrum only, warmup/tail steps 2/2 20 euler simple 3 1.0 Yes Yes No 488.0
MM-R2V-39 G Spectrum sweep Spectrum only, max history 16 20 euler simple 3 1.0 Yes Yes No 433.8
MM-R2V-40 G Spectrum + Turbo Spectrum + Turbo, blend weight 0.25 4 euler simple 3 1.0 Yes Yes No 184.9
MM-R2V-41 G Spectrum + Turbo Spectrum + Turbo, blend weight 0.75 4 euler simple 3 1.0 Yes Yes No 181.4
MM-R2V-42 G Spectrum + Turbo Spectrum + Turbo, replay disabled 4 euler simple 3 1.0 Yes Yes No 145.9
MM-R2V-43 G Spectrum + Turbo Spectrum + Turbo, max history 16 4 euler simple 3 1.0 Yes Yes No 149.1
MM-R2V-44 H quality sweep Cache/offload + Sol-Attn 20 er_sde simple 3 1.0 Blocked — No —
MM-R2V-45 H quality sweep Cache/offload + Sol-Attn 24 er_sde simple 3 1.0 Blocked — No —
MM-R2V-46 H quality sweep Cache/offload + Sol-Attn 28 er_sde simple 3 1.0 Blocked — No —
MM-R2V-47 H quality sweep Cache/offload + Sol-Attn 32 er_sde simple 3 1.0 Blocked — No —
MM-R2V-48 H quality sweep Base/Sol-Attn path 20 er_sde simple 3 1.0 Blocked — No —
MM-R2V-49 H quality sweep Base/Sol-Attn path 24 er_sde simple 3 1.0 Blocked — No —
MM-R2V-50 H quality sweep Base/Sol-Attn path 28 er_sde simple 3 1.0 Blocked — No —
MM-R2V-51 H Turbo sweep Turbo LoRA only 8 euler simple 3 1.0 Yes Yes No 381.240
MM-R2V-52 H Turbo sweep Turbo LoRA only 12 euler simple 3 1.0 Yes Yes No 471.862
MM-R2V-53 H Turbo sweep Spectrum + Turbo LoRA 8 euler simple 3 1.0 Blocked — No —
MM-R2V-54 H Turbo sweep Spectrum + Turbo LoRA 12 euler simple 3 1.0 Blocked — No —
MM-R2V-55 I Turbo sampler/scheduler Turbo LoRA only 8 euler beta 3 1.0 Yes Yes No 372.061
MM-R2V-56 I Turbo sampler/scheduler Turbo LoRA only 8 euler_cfg_pp simple 3 1.0 Yes Yes No 432.718
MM-R2V-57 I Turbo sampler/scheduler Turbo LoRA only 8 res_multistep beta 3 1.0 Yes Yes No 369.694
MM-R2V-58 I Turbo sampler/scheduler Turbo LoRA only 8 res_multistep simple 3 1.0 Yes Yes Yes 368.746
MM-R2V-59 J Turbo step comparison Turbo LoRA only 12 res_multistep beta 3 1.0 Yes Yes No 551.740
MM-R2V-60 J Turbo step comparison Turbo LoRA only 12 res_multistep simple 3 1.0 Yes Yes No 511.753
MM-R2V-61 K duration/prompt Current Turbo baseline with bright park prompt 8 res_multistep simple 10 1.0 Yes Yes Yes 790.632
MM-R2V-62 L SLA attention MM-R2V-61 + H3 SLA Attention, sparsity 0.85, block 32 8 res_multistep simple 10 1.0 Yes Yes Yes 525.745
MM-R2V-63 L SLA attention MM-R2V-61 + H3 SLA Attention, sparsity 0.90, block 32 8 res_multistep simple 10 1.0 Yes Yes No 480.653
MM-R2V-64 M combined attention SLA 0.85 / block 32 + Sol-Attention 8 res_multistep simple 10 1.0 Yes Yes No 597.210
MM-R2V-65 M combined attention SLA 0.85 / block 32 + MiniMax Low-VRAM Attention, 4 head chunks 8 res_multistep simple 10 1.0 Yes Yes No 552.801
MM-R2V-66 N cache SLA 0.85 / block 32 + EasyCache defaults (reuse 0.2, 15–95%) 8 res_multistep simple 10 1.0 Queued — No —

Result requirements

Each run must save results/<test-id>.mp4 and matching results/<test-id>.json. Metadata must include the exact reference checksum, prompt hash, seed, resolution, duration, CFG, steps, sampler, scheduler, active nodes, runtime, VRAM, output checksum, validity, and visual/motion verdict. A result becomes Current Best only when it is valid and objectively better than the existing best; keep exactly one Current Best.

Phase A collection status: rows 01 and 03–12 have valid MP4 outputs recorded; MM-R2V-05 through MM-R2V-12 were collected from the 2026-09-26 live ComfyUI history. Row 02 remains unsupported because the live SageAttention patch failed validation/runtime. Subjective visual review was not performed, so Current Best was not changed.

Phase F rule: non-Turbo configurations must use at least 20 steps; Turbo LoRA configurations may use 4–12 steps, with 12 as the current upper limit until there is comparative evidence for higher values. This rule is applied to the queued quality-threshold and Spectrum tests above.

Phase F/G collection status: MM-R2V-32 through MM-R2V-43 all completed with valid MP4 outputs. Technical evaluation and runtime capture are complete; subjective frame-by-frame quality review is still pending. The 20-step non-Turbo graph inherited disabled Spectrum and present Sol-Attn branches, which is recorded in the matching metadata.

Rows MM-R2V-44 through MM-R2V-50 and MM-R2V-53 through MM-R2V-54 are blocked until the corresponding cache/offload, Sol-Attn, and Spectrum branches are present in the live API graph. They must not be substituted with the plain Turbo/base graph. MM-R2V-51 through MM-R2V-58 completed with the validated Turbo graph. User review promoted MM-R2V-58 for its environment quality and lower runtime; MM-R2V-59/60 did not justify the additional 12-step runtime. MM-R2V-61 was user-reviewed as clean with an acceptable reference match. MM-R2V-62 was judged acceptable but lower quality than MM-R2V-61; its faster runtime makes it the current 10-second speed baseline. MM-R2V-63 was judged acceptable but not as good as MM-R2V-62, so it was not promoted. MM-R2V-64 was user-reviewed as having no visible quality difference from the SLA-only baseline, with the added Sol-Attention cost, so it was not promoted. MM-R2V-65 was user-reviewed as having no clear quality difference from the SLA-only baseline, so it was not promoted.

Execution order

  1. Run MM-R2V-01 and MM-R2V-02 as the initial paired efficiency test.
  2. Run Phase A one-node and safe-combination tests on 3 seconds.
  3. Optimize steps, sampler, scheduler, and quality at 3 seconds.
  4. Only then test 6/10/20-second clips.
  5. Test continuation/concatenation, then latent upscale and RTX Super Resolution.