Reset Ideogram tests around author workflow

This commit is contained in:
Morpheus
2026-10-12 20:54:40 +00:00
parent d94676181c
commit 65bd173190
3 changed files with 69 additions and 40 deletions
+42 -40
View File
@@ -1,21 +1,19 @@
# Ideogram 4 — optimized local T2I
# Ideogram 4 — author-informed T2I tests
Local Ideogram 4 text-to-image workflow for the RTX 3070 server. It is
especially useful for posters, magazine covers, labels, and other images where
the prompt includes literal text.
This section follows the model card and author workflow: structured Ideogram 4
JSON captions, AuraFlow shift 5.25, StarSampler, and CFG 1.0. It is intended
for controlled quality/time comparisons on the RTX 3070 server.
## Baseline
## Current direction
- Main model: `ideogram4_int8_convrot.safetensors`
- Unconditional companion: `ideogram4_unconditional_int8_convrot.safetensors`
- Main models: `ideogram4_int8_convrot.safetensors` and
`Fal_Ideo_4_NSFW-int8_convrot.safetensors`, tested separately
- Text encoder: `qwen3vl_8b_w4a8.safetensors`, type `ideogram4`
- VAE: `flux2-vae.safetensors`
- Latent/output: 768×1024 portrait
- Sampler: Euler
- Scheduler: Ideogram 4 Scheduler, `mu=0.5`, `std=1.75`
- Steps: 8
- CFG: 7.0
- CFG override: 3.0 from 70% to 100%
- Prompt: Ideogram 4 structured JSON caption
- Sampling: AuraFlow shift `5.25`; StarSampler, Euler, simple scheduler
- Steps: author workflow 8; model-card reference 10
- CFG: `1.0`
- Seed: 20261012 for the controlled baseline
The Fal model is retained as a comparison only; it produced more stylised,
@@ -58,38 +56,42 @@ fine-tuning details should not be treated as verified claims.
- The 8-step Fal run completed in about 5 minutes 18 seconds, but remained
painterly and noisy.
## Quality/time test matrix
## Current smoke tests
The first smoke tests use the same 512×512 structured caption and seed before
full-size tests are queued. Exact prompt IDs are recorded in `smoke-tests.json`.
| ID | Model | Steps | Sampler | Scheduler | Shift | CFG | Status |
|---|---|---:|---|---|---:|---:|---|
| IDEO-SMOKE-FAL-10 | Fal Ideogram | 10 | Euler | simple | 5.25 | 1 | Running |
| IDEO-SMOKE-LOCAL-08 | Local Ideogram | 8 | Euler | simple | 5.25 | 1 | Queued |
## Revised quality/time matrix
The previous free-form-prompt/dual-guider queue was stopped because its
outputs did not meet the quality bar. Those IDs remain historical in
`submissions.json`; they are not part of this new matrix.
Keep the prompt and seed fixed for sampler tests. Keep all other settings fixed
when changing steps or resolution. A row is not promoted until its output is
visually reviewed for typography, anatomy, texture, and artefacts.
| ID | Resolution | Steps | Sampler | mu/std | CFG | Purpose | Status |
|---|---:|---:|---|---|---:|---|---|
| IDEO-T2I-01 | 768×1024 | 8 | Euler | 0.5/1.75 | 7 | Baseline speed/quality | Queued |
| IDEO-T2I-02 | 768×1024 | 6 | Euler | 0.5/1.75 | 7 | Faster lower bound | Queued |
| IDEO-T2I-03 | 768×1024 | 10 | Euler | 0.5/1.75 | 7 | Quality increase | Queued |
| IDEO-T2I-04 | 768×1024 | 12 | Euler | 0.5/1.75 | 7 | Existing quality reference | Complete |
| IDEO-T2I-05 | 768×1024 | 8 | Euler CFG++ | 0.5/1.75 | 7 | Sampler comparison | Queued |
| IDEO-T2I-06 | 768×1024 | 8 | Euler ancestral | 0.5/1.75 | 7 | Sampler comparison | Queued |
| IDEO-T2I-07 | 768×1024 | 8 | res_multistep | 0.5/1.75 | 7 | Sampler comparison | Queued |
| IDEO-T2I-08 | 512×768 | 8 | Euler | 0.5/1.75 | 7 | Portrait speed test | Queued |
| IDEO-T2I-09 | 1024×1024 | 8 | Euler | 0.5/1.75 | 7 | Square quality test | Queued |
| IDEO-T2I-10 | 768×1024 | 8 | Euler | 0.0/1.75 | 7 | Scheduler mu comparison | Queued |
### Author-inspired comparison matrix
| ID | Resolution | Model | Prompt path | Sampling | Purpose | Status |
|---|---:|---|---|---|---|---|
| IDEO-AUTHOR-01 | 768×1024 | Fal Ideogram | Free-form prompt | AuraFlow 5.25, StarSampler 8/Euler/simple, CFG 1 | Reproduce the author's core sampling approach | Planned |
| IDEO-AUTHOR-02 | 768×1024 | Fal Ideogram | `Ideogram4PromptBuilderKJ` | AuraFlow 5.25, StarSampler 8/Euler/simple, CFG 1 | Test structured prompt construction separately | Planned |
| IDEO-AUTHOR-03 | 768×1024 | Fal Ideogram | Structured JSON caption | Model-card reference: 10 steps, guidance 1 | Compare the documented 10-step setting | Planned |
when changing one variable. A row is not promoted until detail, anatomy,
composition, text fidelity, artefacts, and runtime are reviewed.
| ID | Model | Resolution | Steps | Sampler | Scheduler | Shift | CFG | Purpose | Status |
|---|---|---:|---:|---|---|---:|---:|---|---|
| IDEO-AUTHOR-01 | Fal | 768×1024 | 8 | Euler | simple | 5.25 | 1 | Author sampling | Planned |
| IDEO-AUTHOR-02 | Local | 768×1024 | 8 | Euler | simple | 5.25 | 1 | Local author sampling | Planned |
| IDEO-CARD-10 | Local | 768×1024 | 10 | Euler | simple | 5.25 | 1 | Model-card step count | Planned |
| IDEO-SAMPLER-01 | Local | 768×1024 | 8 | res_multistep | simple | 5.25 | 1 | Sampler comparison | Planned |
| IDEO-SAMPLER-02 | Local | 768×1024 | 8 | euler_ancestral | simple | 5.25 | 1 | Sampler comparison | Planned |
| IDEO-SCHED-01 | Local | 768×1024 | 8 | Euler | beta | 5.25 | 1 | Scheduler comparison | Planned |
| IDEO-SHIFT-01 | Local | 768×1024 | 8 | Euler | simple | 3.0 | 1 | Shift comparison | Planned |
| IDEO-SHIFT-02 | Local | 768×1024 | 8 | Euler | simple | 7.0 | 1 | Shift comparison | Planned |
| IDEO-STEPS-01 | Local | 768×1024 | 6 | Euler | simple | 5.25 | 1 | Speed lower bound | Planned |
Results belong in `results/<test-id>.png` with a matching JSON record containing
the exact prompt, seed, resolution, settings, runtime, and visual verdict.
## Reuse
Replace `REPLACE_PROMPT` in `workflow.json` and `variables.json`, then preserve
the technical baseline unless the test matrix calls for a change. For literal
text, use short exact quoted strings and explicitly forbid extra words.
Replace `STRUCTURED_JSON_CAPTION` in `workflow-author-inspired.json` with the
caption from `smoke-tests.json` or a new test caption. Keep the seed and all
other settings fixed while changing one matrix variable.
+17
View File
@@ -0,0 +1,17 @@
{
"prompt_format": "Ideogram 4 structured JSON caption",
"caption": {
"high_level_description": "A premium cinematic fantasy editorial image of an emerald dragon protecting an adult woman in a mountain pass at sunrise.",
"compositional_deconstruction": {
"background": "A windswept mountain pass at sunrise with warm golden light and distant mist.",
"elements": [
{"type": "obj", "desc": "a majestic emerald dragon with believable anatomy, detailed scales, folded wings and a calm protective expression"},
{"type": "obj", "desc": "an adult woman in a practical dark-blue travel outfit standing safely beside the dragon"}
]
}
},
"tests": [
{"id": "IDEO-SMOKE-FAL-10", "prompt_id": "9e517491-cf82-4108-a818-911fc1e8fc0f", "model": "Fal_Ideo_4_NSFW-int8_convrot.safetensors", "resolution": "512x512", "steps": 10, "cfg": 1.0, "sampler": "euler", "scheduler": "simple", "aura_shift": 5.25, "status": "running"},
{"id": "IDEO-SMOKE-LOCAL-08", "prompt_id": "9285d125-f931-4e30-b0cc-9b5ff89fe236", "model": "ideogram4_int8_convrot.safetensors", "resolution": "512x512", "steps": 8, "cfg": 1.0, "sampler": "euler", "scheduler": "simple", "aura_shift": 5.25, "status": "queued"}
]
}
@@ -0,0 +1,10 @@
{
"1": {"class_type": "VAELoader", "inputs": {"vae_name": "flux2-vae.safetensors"}},
"2": {"class_type": "CLIPLoader", "inputs": {"clip_name": "qwen3vl_8b_w4a8.safetensors", "type": "ideogram4", "device": "default"}},
"3": {"class_type": "CLIPTextEncode", "inputs": {"text": "STRUCTURED_JSON_CAPTION", "clip": ["2", 0]}},
"4": {"class_type": "UNETLoader", "inputs": {"unet_name": "ideogram4_int8_convrot.safetensors", "weight_dtype": "default"}},
"5": {"class_type": "ModelSamplingAuraFlow", "inputs": {"model": ["4", 0], "shift": 5.25}},
"6": {"class_type": "EmptyFlux2LatentImage", "inputs": {"width": 768, "height": 1024, "batch_size": 1}},
"7": {"class_type": "StarSampler", "inputs": {"model": ["5", 0], "positive": ["3", 0], "latent": ["6", 0], "seed": 20261012, "steps": 8, "cfg": 1.0, "sampler_name": "euler", "scheduler": "simple", "use_ltx_scheduler": false, "denoise": 1.0, "vae": ["1", 0], "decode_image": true, "tiled_vae_decoding": false}},
"8": {"class_type": "SaveImage", "inputs": {"images": ["7", 4], "filename_prefix": "ideogram-author-inspired"}}
}