Reset Ideogram tests around author workflow
This commit is contained in:
@@ -1,21 +1,19 @@
|
|||||||
# Ideogram 4 — optimized local T2I
|
# Ideogram 4 — author-informed T2I tests
|
||||||
|
|
||||||
Local Ideogram 4 text-to-image workflow for the RTX 3070 server. It is
|
This section follows the model card and author workflow: structured Ideogram 4
|
||||||
especially useful for posters, magazine covers, labels, and other images where
|
JSON captions, AuraFlow shift 5.25, StarSampler, and CFG 1.0. It is intended
|
||||||
the prompt includes literal text.
|
for controlled quality/time comparisons on the RTX 3070 server.
|
||||||
|
|
||||||
## Baseline
|
## Current direction
|
||||||
|
|
||||||
- Main model: `ideogram4_int8_convrot.safetensors`
|
- Main models: `ideogram4_int8_convrot.safetensors` and
|
||||||
- Unconditional companion: `ideogram4_unconditional_int8_convrot.safetensors`
|
`Fal_Ideo_4_NSFW-int8_convrot.safetensors`, tested separately
|
||||||
- Text encoder: `qwen3vl_8b_w4a8.safetensors`, type `ideogram4`
|
- Text encoder: `qwen3vl_8b_w4a8.safetensors`, type `ideogram4`
|
||||||
- VAE: `flux2-vae.safetensors`
|
- VAE: `flux2-vae.safetensors`
|
||||||
- Latent/output: 768×1024 portrait
|
- Prompt: Ideogram 4 structured JSON caption
|
||||||
- Sampler: Euler
|
- Sampling: AuraFlow shift `5.25`; StarSampler, Euler, simple scheduler
|
||||||
- Scheduler: Ideogram 4 Scheduler, `mu=0.5`, `std=1.75`
|
- Steps: author workflow 8; model-card reference 10
|
||||||
- Steps: 8
|
- CFG: `1.0`
|
||||||
- CFG: 7.0
|
|
||||||
- CFG override: 3.0 from 70% to 100%
|
|
||||||
- Seed: 20261012 for the controlled baseline
|
- Seed: 20261012 for the controlled baseline
|
||||||
|
|
||||||
The Fal model is retained as a comparison only; it produced more stylised,
|
The Fal model is retained as a comparison only; it produced more stylised,
|
||||||
@@ -58,38 +56,42 @@ fine-tuning details should not be treated as verified claims.
|
|||||||
- The 8-step Fal run completed in about 5 minutes 18 seconds, but remained
|
- The 8-step Fal run completed in about 5 minutes 18 seconds, but remained
|
||||||
painterly and noisy.
|
painterly and noisy.
|
||||||
|
|
||||||
## Quality/time test matrix
|
## Current smoke tests
|
||||||
|
|
||||||
|
The first smoke tests use the same 512×512 structured caption and seed before
|
||||||
|
full-size tests are queued. Exact prompt IDs are recorded in `smoke-tests.json`.
|
||||||
|
|
||||||
|
| ID | Model | Steps | Sampler | Scheduler | Shift | CFG | Status |
|
||||||
|
|---|---|---:|---|---|---:|---:|---|
|
||||||
|
| IDEO-SMOKE-FAL-10 | Fal Ideogram | 10 | Euler | simple | 5.25 | 1 | Running |
|
||||||
|
| IDEO-SMOKE-LOCAL-08 | Local Ideogram | 8 | Euler | simple | 5.25 | 1 | Queued |
|
||||||
|
|
||||||
|
## Revised quality/time matrix
|
||||||
|
|
||||||
|
The previous free-form-prompt/dual-guider queue was stopped because its
|
||||||
|
outputs did not meet the quality bar. Those IDs remain historical in
|
||||||
|
`submissions.json`; they are not part of this new matrix.
|
||||||
|
|
||||||
Keep the prompt and seed fixed for sampler tests. Keep all other settings fixed
|
Keep the prompt and seed fixed for sampler tests. Keep all other settings fixed
|
||||||
when changing steps or resolution. A row is not promoted until its output is
|
when changing one variable. A row is not promoted until detail, anatomy,
|
||||||
visually reviewed for typography, anatomy, texture, and artefacts.
|
composition, text fidelity, artefacts, and runtime are reviewed.
|
||||||
|
|
||||||
| ID | Resolution | Steps | Sampler | mu/std | CFG | Purpose | Status |
|
|
||||||
|---|---:|---:|---|---|---:|---|---|
|
|
||||||
| IDEO-T2I-01 | 768×1024 | 8 | Euler | 0.5/1.75 | 7 | Baseline speed/quality | Queued |
|
|
||||||
| IDEO-T2I-02 | 768×1024 | 6 | Euler | 0.5/1.75 | 7 | Faster lower bound | Queued |
|
|
||||||
| IDEO-T2I-03 | 768×1024 | 10 | Euler | 0.5/1.75 | 7 | Quality increase | Queued |
|
|
||||||
| IDEO-T2I-04 | 768×1024 | 12 | Euler | 0.5/1.75 | 7 | Existing quality reference | Complete |
|
|
||||||
| IDEO-T2I-05 | 768×1024 | 8 | Euler CFG++ | 0.5/1.75 | 7 | Sampler comparison | Queued |
|
|
||||||
| IDEO-T2I-06 | 768×1024 | 8 | Euler ancestral | 0.5/1.75 | 7 | Sampler comparison | Queued |
|
|
||||||
| IDEO-T2I-07 | 768×1024 | 8 | res_multistep | 0.5/1.75 | 7 | Sampler comparison | Queued |
|
|
||||||
| IDEO-T2I-08 | 512×768 | 8 | Euler | 0.5/1.75 | 7 | Portrait speed test | Queued |
|
|
||||||
| IDEO-T2I-09 | 1024×1024 | 8 | Euler | 0.5/1.75 | 7 | Square quality test | Queued |
|
|
||||||
| IDEO-T2I-10 | 768×1024 | 8 | Euler | 0.0/1.75 | 7 | Scheduler mu comparison | Queued |
|
|
||||||
|
|
||||||
### Author-inspired comparison matrix
|
|
||||||
|
|
||||||
| ID | Resolution | Model | Prompt path | Sampling | Purpose | Status |
|
|
||||||
|---|---:|---|---|---|---|---|
|
|
||||||
| IDEO-AUTHOR-01 | 768×1024 | Fal Ideogram | Free-form prompt | AuraFlow 5.25, StarSampler 8/Euler/simple, CFG 1 | Reproduce the author's core sampling approach | Planned |
|
|
||||||
| IDEO-AUTHOR-02 | 768×1024 | Fal Ideogram | `Ideogram4PromptBuilderKJ` | AuraFlow 5.25, StarSampler 8/Euler/simple, CFG 1 | Test structured prompt construction separately | Planned |
|
|
||||||
| IDEO-AUTHOR-03 | 768×1024 | Fal Ideogram | Structured JSON caption | Model-card reference: 10 steps, guidance 1 | Compare the documented 10-step setting | Planned |
|
|
||||||
|
|
||||||
|
| ID | Model | Resolution | Steps | Sampler | Scheduler | Shift | CFG | Purpose | Status |
|
||||||
|
|---|---|---:|---:|---|---|---:|---:|---|---|
|
||||||
|
| IDEO-AUTHOR-01 | Fal | 768×1024 | 8 | Euler | simple | 5.25 | 1 | Author sampling | Planned |
|
||||||
|
| IDEO-AUTHOR-02 | Local | 768×1024 | 8 | Euler | simple | 5.25 | 1 | Local author sampling | Planned |
|
||||||
|
| IDEO-CARD-10 | Local | 768×1024 | 10 | Euler | simple | 5.25 | 1 | Model-card step count | Planned |
|
||||||
|
| IDEO-SAMPLER-01 | Local | 768×1024 | 8 | res_multistep | simple | 5.25 | 1 | Sampler comparison | Planned |
|
||||||
|
| IDEO-SAMPLER-02 | Local | 768×1024 | 8 | euler_ancestral | simple | 5.25 | 1 | Sampler comparison | Planned |
|
||||||
|
| IDEO-SCHED-01 | Local | 768×1024 | 8 | Euler | beta | 5.25 | 1 | Scheduler comparison | Planned |
|
||||||
|
| IDEO-SHIFT-01 | Local | 768×1024 | 8 | Euler | simple | 3.0 | 1 | Shift comparison | Planned |
|
||||||
|
| IDEO-SHIFT-02 | Local | 768×1024 | 8 | Euler | simple | 7.0 | 1 | Shift comparison | Planned |
|
||||||
|
| IDEO-STEPS-01 | Local | 768×1024 | 6 | Euler | simple | 5.25 | 1 | Speed lower bound | Planned |
|
||||||
Results belong in `results/<test-id>.png` with a matching JSON record containing
|
Results belong in `results/<test-id>.png` with a matching JSON record containing
|
||||||
the exact prompt, seed, resolution, settings, runtime, and visual verdict.
|
the exact prompt, seed, resolution, settings, runtime, and visual verdict.
|
||||||
|
|
||||||
## Reuse
|
## Reuse
|
||||||
|
|
||||||
Replace `REPLACE_PROMPT` in `workflow.json` and `variables.json`, then preserve
|
Replace `STRUCTURED_JSON_CAPTION` in `workflow-author-inspired.json` with the
|
||||||
the technical baseline unless the test matrix calls for a change. For literal
|
caption from `smoke-tests.json` or a new test caption. Keep the seed and all
|
||||||
text, use short exact quoted strings and explicitly forbid extra words.
|
other settings fixed while changing one matrix variable.
|
||||||
|
|||||||
@@ -0,0 +1,17 @@
|
|||||||
|
{
|
||||||
|
"prompt_format": "Ideogram 4 structured JSON caption",
|
||||||
|
"caption": {
|
||||||
|
"high_level_description": "A premium cinematic fantasy editorial image of an emerald dragon protecting an adult woman in a mountain pass at sunrise.",
|
||||||
|
"compositional_deconstruction": {
|
||||||
|
"background": "A windswept mountain pass at sunrise with warm golden light and distant mist.",
|
||||||
|
"elements": [
|
||||||
|
{"type": "obj", "desc": "a majestic emerald dragon with believable anatomy, detailed scales, folded wings and a calm protective expression"},
|
||||||
|
{"type": "obj", "desc": "an adult woman in a practical dark-blue travel outfit standing safely beside the dragon"}
|
||||||
|
]
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"tests": [
|
||||||
|
{"id": "IDEO-SMOKE-FAL-10", "prompt_id": "9e517491-cf82-4108-a818-911fc1e8fc0f", "model": "Fal_Ideo_4_NSFW-int8_convrot.safetensors", "resolution": "512x512", "steps": 10, "cfg": 1.0, "sampler": "euler", "scheduler": "simple", "aura_shift": 5.25, "status": "running"},
|
||||||
|
{"id": "IDEO-SMOKE-LOCAL-08", "prompt_id": "9285d125-f931-4e30-b0cc-9b5ff89fe236", "model": "ideogram4_int8_convrot.safetensors", "resolution": "512x512", "steps": 8, "cfg": 1.0, "sampler": "euler", "scheduler": "simple", "aura_shift": 5.25, "status": "queued"}
|
||||||
|
]
|
||||||
|
}
|
||||||
@@ -0,0 +1,10 @@
|
|||||||
|
{
|
||||||
|
"1": {"class_type": "VAELoader", "inputs": {"vae_name": "flux2-vae.safetensors"}},
|
||||||
|
"2": {"class_type": "CLIPLoader", "inputs": {"clip_name": "qwen3vl_8b_w4a8.safetensors", "type": "ideogram4", "device": "default"}},
|
||||||
|
"3": {"class_type": "CLIPTextEncode", "inputs": {"text": "STRUCTURED_JSON_CAPTION", "clip": ["2", 0]}},
|
||||||
|
"4": {"class_type": "UNETLoader", "inputs": {"unet_name": "ideogram4_int8_convrot.safetensors", "weight_dtype": "default"}},
|
||||||
|
"5": {"class_type": "ModelSamplingAuraFlow", "inputs": {"model": ["4", 0], "shift": 5.25}},
|
||||||
|
"6": {"class_type": "EmptyFlux2LatentImage", "inputs": {"width": 768, "height": 1024, "batch_size": 1}},
|
||||||
|
"7": {"class_type": "StarSampler", "inputs": {"model": ["5", 0], "positive": ["3", 0], "latent": ["6", 0], "seed": 20261012, "steps": 8, "cfg": 1.0, "sampler_name": "euler", "scheduler": "simple", "use_ltx_scheduler": false, "denoise": 1.0, "vae": ["1", 0], "decode_image": true, "tiled_vae_decoding": false}},
|
||||||
|
"8": {"class_type": "SaveImage", "inputs": {"images": ["7", 4], "filename_prefix": "ideogram-author-inspired"}}
|
||||||
|
}
|
||||||
Reference in New Issue
Block a user