Reduce Flux 3 Klein T2I test plan

This commit is contained in:
Morpheus
2026-10-28 17:09:48 +00:00
parent 4caccae494
commit e6d3adb3ff
4 changed files with 58 additions and 43 deletions
+1 -1
View File
@@ -8,7 +8,7 @@ matrix; visual review must use the same category fixtures and resolution.
|---|---|---|---:|---|---| |---|---|---|---:|---|---|
| T2I | Flux.2 Klein | shared T2I prompt | 1088×1920 comparison target | Matrix/baseline recorded | Existing baseline | | T2I | Flux.2 Klein | shared T2I prompt | 1088×1920 comparison target | Matrix/baseline recorded | Existing baseline |
| T2I | Qwen Image 2.1 | shared T2I prompt | 1088×1920 comparison target | 88/88 recorded | Existing best recorded in category README | | T2I | Qwen Image 2.1 | shared T2I prompt | 1088×1920 comparison target | 88/88 recorded | Existing best recorded in category README |
| T2I | FLUX.3 Klein | shared T2I prompt | 1088×1920 comparison target | Fresh 432-cell sampler matrix planned (0/432) | Results pending | | T2I | FLUX.3 Klein | shared T2I prompt | 1088×1920 comparison target | Fresh 18-row focused matrix planned (0/18) | Results pending |
| T2I | Ideogram 4 | structured magazine prompt | varies by magazine matrix | 24-row matrix complete | Separate prompt family; not directly comparable to portrait rows | | T2I | Ideogram 4 | structured magazine prompt | varies by magazine matrix | 24-row matrix complete | Separate prompt family; not directly comparable to portrait rows |
| I2I | Flux.2 Klein | `character_reference.png` + shared I2I prompt | 1080×1920 category target | Matrix planned/untested | Candidate baseline | | I2I | Flux.2 Klein | `character_reference.png` + shared I2I prompt | 1080×1920 category target | Matrix planned/untested | Candidate baseline |
| I2I | Qwen Image 2.1 | `character_reference.png` + shared I2I prompt | 1080×1920 category target | 34-row matrix recorded | Existing best recorded in category README | | I2I | Qwen Image 2.1 | `character_reference.png` + shared I2I prompt | 1080×1920 category target | 34-row matrix recorded | Existing best recorded in category README |
+1 -1
View File
@@ -14,7 +14,7 @@ This summary is maintained across the model-specific test plans. A result is onl
|---|---|---:|---|---| |---|---|---:|---|---|
| Flux.2 Klein | F-T2I-03 | 220.3 s | [F-T2I-03.png](flux/results/F-T2I-03.png) | Current best; 1080×1920 target | | Flux.2 Klein | F-T2I-03 | 220.3 s | [F-T2I-03.png](flux/results/F-T2I-03.png) | Current best; 1080×1920 target |
| Qwen Image 2.1 | Q-T2I-57 | 110.2 s | [Q-T2I-57.png](qwen/results/Q-T2I-57.png) | Current best; direct 1088×1920 latent; res_multistep, beta, 25 steps, CFG 2.5 | | Qwen Image 2.1 | Q-T2I-57 | 110.2 s | [Q-T2I-57.png](qwen/results/Q-T2I-57.png) | Current best; direct 1088×1920 latent; res_multistep, beta, 25 steps, CFG 2.5 |
| FLUX.3 Klein | F3I-MATRIX | planned (0/432) | — | Fresh local matrix; canonical comparison resolution 1088×1920 | | FLUX.3 Klein | F3I-T2I-01…18 | planned (0/18) | — | Fresh focused local matrix; canonical comparison resolution 1088×1920 |
| Ideogram 4 | MAG-MATRIX-24 | 30.154 s | [MAG-MATRIX-24.png](ideogram/results/magazine-matrix/MAG-MATRIX-24.png) | Complete magazine-cover matrix; different structured prompt, not directly comparable to the shared portrait prompt | | Ideogram 4 | MAG-MATRIX-24 | 30.154 s | [MAG-MATRIX-24.png](ideogram/results/magazine-matrix/MAG-MATRIX-24.png) | Complete magazine-cover matrix; different structured prompt, not directly comparable to the shared portrait prompt |
Store each T2I test under the selected model's `results/<test-id>.png` and `results/<test-id>.json` using the table ID as the label. Store each T2I test under the selected model's `results/<test-id>.png` and `results/<test-id>.json` using the table ID as the label.
+35 -21
View File
@@ -1,7 +1,7 @@
# FLUX 3 Image / Klein # FLUX 3 Image / Klein
This is the canonical local FLUX.3 Klein text-to-image workflow and clean This is the canonical local FLUX.3 Klein text-to-image workflow and focused
sampler/scheduler test plan. Reference-based tests belong in optimization plan. Reference-based tests belong in
`optimized/I2I/flux3klein/` and `optimized/MultipleRef2I/flux3klein/`. `optimized/I2I/flux3klein/` and `optimized/MultipleRef2I/flux3klein/`.
No results have been retained for this fresh run. The workflow does not use No results have been retained for this fresh run. The workflow does not use
@@ -17,28 +17,42 @@ the remote `Flux3ImageNode` API.
- Resolution: **1088×1920** - Resolution: **1088×1920**
- References: none - References: none
- Seed: `310001` - Seed: `310001`
- Steps: `4`
- Flux Guidance: `3.5` - Flux Guidance: `3.5`
- Scheduler: `BasicScheduler` with `simple`
The graph uses `FluxGuidance`, not `CFGGuider`; therefore this T2I suite The graph uses `FluxGuidance`, not `CFGGuider`; this suite records Flux
records Flux Guidance rather than calling it CFG. Prompt, resolution, seed, Guidance rather than calling it CFG. Prompt, resolution, seed, guidance,
steps, guidance, and reference count stay fixed while sampler and scheduler scheduler, and reference count stay fixed unless a row explicitly changes
vary. steps or sampler.
## Fresh test matrix ## Focused optimization matrix
The matrix contains **48 samplers × 9 schedulers = 432 planned runs**. All This follows the practical 18-row scope used by the Flux.2 Klein plan: sampler
rows are currently **Planned**. The complete sampler and scheduler lists are comparisons first, followed by step-count comparisons. All rows are currently
stored in `variables.json`; each executed cell must receive a result record in **Planned**.
`results/` with its exact settings, runtime, output path, dimensions, and
error or visual notes.
| Matrix | Resolution | References | Seed | Guidance | Steps | Samplers | Schedulers | Status | | ID | Guidance | Steps | Sampler | Scheduler | Status | Purpose |
|---|---:|---:|---:|---:|---:|---:|---:|---| |---|---:|---:|---|---|---|---|
| F3I-MATRIX | 1088×1920 | 0 | 310001 | 3.5 | 4 | 48 | 9 | Planned (0/432) | | F3I-T2I-01 | 3.5 | 4 | euler | simple | Planned | Baseline |
| F3I-T2I-02 | 3.5 | 4 | euler_cfg_pp | simple | Planned | CFG++ sampler |
| F3I-T2I-03 | 3.5 | 4 | euler_ancestral | simple | Planned | Ancestral sampler |
| F3I-T2I-04 | 3.5 | 4 | euler_ancestral_cfg_pp | simple | Planned | Ancestral CFG++ sampler |
| F3I-T2I-05 | 3.5 | 4 | res_multistep | simple | Planned | RES multistep sampler |
| F3I-T2I-06 | 3.5 | 4 | res_multistep_cfg_pp | simple | Planned | RES multistep CFG++ sampler |
| F3I-T2I-07 | 3.5 | 4 | dpmpp_2m | simple | Planned | DPM++ sampler |
| F3I-T2I-08 | 3.5 | 4 | ddim | simple | Planned | DDIM sampler |
| F3I-T2I-09 | 3.5 | 4 | uni_pc | simple | Planned | UniPC sampler |
| F3I-T2I-10 | 3.5 | 2 | euler_cfg_pp | simple | Planned | Low-step comparison |
| F3I-T2I-11 | 3.5 | 3 | euler_cfg_pp | simple | Planned | Low-step comparison |
| F3I-T2I-12 | 3.5 | 5 | euler_cfg_pp | simple | Planned | Step-count comparison |
| F3I-T2I-13 | 3.5 | 6 | euler_cfg_pp | simple | Planned | Step-count comparison |
| F3I-T2I-14 | 3.5 | 7 | euler_cfg_pp | simple | Planned | Step-count comparison |
| F3I-T2I-15 | 3.5 | 8 | euler_cfg_pp | simple | Planned | Step-count comparison |
| F3I-T2I-16 | 3.5 | 4 | heun | simple | Planned | Heun sampler |
| F3I-T2I-17 | 3.5 | 4 | dpmpp_sde | simple | Planned | DPM++ SDE sampler |
| F3I-T2I-18 | 3.5 | 4 | dpmpp_2m_cfg_pp | simple | Planned | DPM++ CFG++ sampler |
Do not silently substitute a rejected sampler or scheduler. Record failures Record runtime, output dimensions, output path, exact settings, and visual
as results, preserve the fixed comparison inputs, and update this table only notes for every row under `results/`. Record failures rather than silently
from the actual result records. The first successful `euler + simple` cell is substituting another sampler. The first successful baseline is a compatibility
the compatibility baseline; no visual winner should be declared until the reference, not automatically the visual winner.
outputs have been reviewed under the same prompt and resolution.
+21 -20
View File
@@ -7,29 +7,30 @@
"width": 1088, "width": 1088,
"height": 1920, "height": 1920,
"guidance": 3.5, "guidance": 3.5,
"steps": 4,
"seed": 310001, "seed": 310001,
"image_references": 0, "image_references": 0,
"scheduler": "simple",
"remote_api": false "remote_api": false
}, },
"samplers": [ "tests": [
"euler", "TBG Flux2 Sampler", "pid_sde", "pid_creative_sde", {"id":"F3I-T2I-01","steps":4,"sampler":"euler","status":"planned"},
"euler_cfg_pp", "euler_ancestral", "euler_ancestral_cfg_pp", "heun", {"id":"F3I-T2I-02","steps":4,"sampler":"euler_cfg_pp","status":"planned"},
"heunpp2", "exp_heun_2_x0", "exp_heun_2_x0_sde", "dpm_2", {"id":"F3I-T2I-03","steps":4,"sampler":"euler_ancestral","status":"planned"},
"dpm_2_ancestral", "lms", "dpm_fast", "dpm_adaptive", {"id":"F3I-T2I-04","steps":4,"sampler":"euler_ancestral_cfg_pp","status":"planned"},
"dpmpp_2s_ancestral", "dpmpp_2s_ancestral_cfg_pp", "dpmpp_sde", {"id":"F3I-T2I-05","steps":4,"sampler":"res_multistep","status":"planned"},
"dpmpp_sde_gpu", "dpmpp_2m", "dpmpp_2m_cfg_pp", "dpmpp_2m_sde", {"id":"F3I-T2I-06","steps":4,"sampler":"res_multistep_cfg_pp","status":"planned"},
"dpmpp_2m_sde_gpu", "dpmpp_2m_sde_heun", "dpmpp_2m_sde_heun_gpu", {"id":"F3I-T2I-07","steps":4,"sampler":"dpmpp_2m","status":"planned"},
"dpmpp_3m_sde", "dpmpp_3m_sde_gpu", "ddpm", "lcm", "ipndm", {"id":"F3I-T2I-08","steps":4,"sampler":"ddim","status":"planned"},
"ipndm_v", "deis", "cfgpp_ud10_ab", "res_multistep", {"id":"F3I-T2I-09","steps":4,"sampler":"uni_pc","status":"planned"},
"res_multistep_cfg_pp", "res_multistep_ancestral", {"id":"F3I-T2I-10","steps":2,"sampler":"euler_cfg_pp","status":"planned"},
"res_multistep_ancestral_cfg_pp", "gradient_estimation", {"id":"F3I-T2I-11","steps":3,"sampler":"euler_cfg_pp","status":"planned"},
"gradient_estimation_cfg_pp", "er_sde", "seeds_2", "seeds_3", {"id":"F3I-T2I-12","steps":5,"sampler":"euler_cfg_pp","status":"planned"},
"sa_solver", "sa_solver_pece", "ddim", "uni_pc", "uni_pc_bh2" {"id":"F3I-T2I-13","steps":6,"sampler":"euler_cfg_pp","status":"planned"},
{"id":"F3I-T2I-14","steps":7,"sampler":"euler_cfg_pp","status":"planned"},
{"id":"F3I-T2I-15","steps":8,"sampler":"euler_cfg_pp","status":"planned"},
{"id":"F3I-T2I-16","steps":4,"sampler":"heun","status":"planned"},
{"id":"F3I-T2I-17","steps":4,"sampler":"dpmpp_sde","status":"planned"},
{"id":"F3I-T2I-18","steps":4,"sampler":"dpmpp_2m_cfg_pp","status":"planned"}
], ],
"schedulers": [ "matrix": {"planned_runs": 18, "completed_runs": 0}
"simple", "sgm_uniform", "karras", "exponential", "ddim_uniform",
"beta", "normal", "linear_quadratic", "kl_optimal"
],
"matrix": {"sampler_count": 48, "scheduler_count": 9, "planned_runs": 432, "completed_runs": 0}
} }