Add local Ideogram 4 T2I workflow and test matrix
This commit is contained in:
@@ -1,6 +1,6 @@
|
|||||||
# T2I workflows
|
# T2I workflows
|
||||||
|
|
||||||
Use [`flux/`](flux/) or [`qwen/`](qwen/) for the best tested text-to-image baseline. Prompts, seeds, and dimensions are intended to be replaced per task; sampler, scheduler, CFG, and steps are the optimization controls.
|
Use [`flux/`](flux/), [`qwen/`](qwen/), or [`ideogram/`](ideogram/) for the best tested text-to-image baseline. Prompts, seeds, and dimensions are intended to be replaced per task; sampler, scheduler, CFG, and steps are the optimization controls.
|
||||||
|
|
||||||
Static variables are recorded in [`variables.json`](variables.json). The test plans live in each model README.
|
Static variables are recorded in [`variables.json`](variables.json). The test plans live in each model README.
|
||||||
|
|
||||||
|
|||||||
@@ -0,0 +1,59 @@
|
|||||||
|
# Ideogram 4 — optimized local T2I
|
||||||
|
|
||||||
|
Local Ideogram 4 text-to-image workflow for the RTX 3070 server. It is
|
||||||
|
especially useful for posters, magazine covers, labels, and other images where
|
||||||
|
the prompt includes literal text.
|
||||||
|
|
||||||
|
## Baseline
|
||||||
|
|
||||||
|
- Main model: `ideogram4_int8_convrot.safetensors`
|
||||||
|
- Unconditional companion: `ideogram4_unconditional_int8_convrot.safetensors`
|
||||||
|
- Text encoder: `qwen3vl_8b_w4a8.safetensors`, type `ideogram4`
|
||||||
|
- VAE: `flux2-vae.safetensors`
|
||||||
|
- Latent/output: 768×1024 portrait
|
||||||
|
- Sampler: Euler
|
||||||
|
- Scheduler: Ideogram 4 Scheduler, `mu=0.5`, `std=1.75`
|
||||||
|
- Steps: 8
|
||||||
|
- CFG: 7.0
|
||||||
|
- CFG override: 3.0 from 70% to 100%
|
||||||
|
- Seed: 20261012 for the controlled baseline
|
||||||
|
|
||||||
|
The Fal model is retained as a comparison only; it produced more stylised,
|
||||||
|
noisier results. The hosted `IdeogramV4` API node was not used because this
|
||||||
|
server is not authenticated for Comfy API partner nodes.
|
||||||
|
|
||||||
|
## Initial observations
|
||||||
|
|
||||||
|
- The 512×512 local smoke test completed successfully.
|
||||||
|
- The 768×1024 standard Ideogram 4 run took about 6 minutes at 12 steps.
|
||||||
|
- The 768×1024 Fal comparison took about 7 minutes at 12 steps.
|
||||||
|
- The 8-step Fal run completed in about 5 minutes 18 seconds, but remained
|
||||||
|
painterly and noisy.
|
||||||
|
|
||||||
|
## Quality/time test matrix
|
||||||
|
|
||||||
|
Keep the prompt and seed fixed for sampler tests. Keep all other settings fixed
|
||||||
|
when changing steps or resolution. A row is not promoted until its output is
|
||||||
|
visually reviewed for typography, anatomy, texture, and artefacts.
|
||||||
|
|
||||||
|
| ID | Resolution | Steps | Sampler | mu/std | CFG | Purpose | Status |
|
||||||
|
|---|---:|---:|---|---|---:|---|---|
|
||||||
|
| IDEO-T2I-01 | 768×1024 | 8 | Euler | 0.5/1.75 | 7 | Baseline speed/quality | Queued |
|
||||||
|
| IDEO-T2I-02 | 768×1024 | 6 | Euler | 0.5/1.75 | 7 | Faster lower bound | Queued |
|
||||||
|
| IDEO-T2I-03 | 768×1024 | 10 | Euler | 0.5/1.75 | 7 | Quality increase | Queued |
|
||||||
|
| IDEO-T2I-04 | 768×1024 | 12 | Euler | 0.5/1.75 | 7 | Existing quality reference | Complete |
|
||||||
|
| IDEO-T2I-05 | 768×1024 | 8 | Euler CFG++ | 0.5/1.75 | 7 | Sampler comparison | Planned |
|
||||||
|
| IDEO-T2I-06 | 768×1024 | 8 | Euler ancestral | 0.5/1.75 | 7 | Sampler comparison | Planned |
|
||||||
|
| IDEO-T2I-07 | 768×1024 | 8 | res_multistep | 0.5/1.75 | 7 | Sampler comparison | Planned |
|
||||||
|
| IDEO-T2I-08 | 512×768 | 8 | Euler | 0.5/1.75 | 7 | Portrait speed test | Planned |
|
||||||
|
| IDEO-T2I-09 | 1024×1024 | 8 | Euler | 0.5/1.75 | 7 | Square quality test | Planned |
|
||||||
|
| IDEO-T2I-10 | 768×1024 | 8 | Euler | 0.0/1.75 | 7 | Scheduler mu comparison | Planned |
|
||||||
|
|
||||||
|
Results belong in `results/<test-id>.png` with a matching JSON record containing
|
||||||
|
the exact prompt, seed, resolution, settings, runtime, and visual verdict.
|
||||||
|
|
||||||
|
## Reuse
|
||||||
|
|
||||||
|
Replace `REPLACE_PROMPT` in `workflow.json` and `variables.json`, then preserve
|
||||||
|
the technical baseline unless the test matrix calls for a change. For literal
|
||||||
|
text, use short exact quoted strings and explicitly forbid extra words.
|
||||||
@@ -0,0 +1,11 @@
|
|||||||
|
{
|
||||||
|
"prompt": "REPLACE_PROMPT",
|
||||||
|
"negative_prompt": "Not used by this Ideogram 4 graph; negative conditioning is zeroed.",
|
||||||
|
"seed": 20261012,
|
||||||
|
"width": 768,
|
||||||
|
"height": 1024,
|
||||||
|
"model": "ideogram4_int8_convrot.safetensors",
|
||||||
|
"unconditional_model": "ideogram4_unconditional_int8_convrot.safetensors",
|
||||||
|
"clip": "qwen3vl_8b_w4a8.safetensors",
|
||||||
|
"vae": "flux2-vae.safetensors"
|
||||||
|
}
|
||||||
@@ -0,0 +1,17 @@
|
|||||||
|
{
|
||||||
|
"1": {"class_type": "VAELoader", "inputs": {"vae_name": "flux2-vae.safetensors"}},
|
||||||
|
"2": {"class_type": "CLIPLoader", "inputs": {"clip_name": "qwen3vl_8b_w4a8.safetensors", "type": "ideogram4", "device": "default"}},
|
||||||
|
"3": {"class_type": "CLIPTextEncode", "inputs": {"text": "REPLACE_PROMPT", "clip": ["2", 0]}},
|
||||||
|
"4": {"class_type": "ConditioningZeroOut", "inputs": {"conditioning": ["3", 0]}},
|
||||||
|
"5": {"class_type": "UNETLoader", "inputs": {"unet_name": "ideogram4_int8_convrot.safetensors", "weight_dtype": "default"}},
|
||||||
|
"6": {"class_type": "UNETLoader", "inputs": {"unet_name": "ideogram4_unconditional_int8_convrot.safetensors", "weight_dtype": "default"}},
|
||||||
|
"7": {"class_type": "CFGOverride", "inputs": {"model": ["5", 0], "cfg": 3.0, "start_percent": 0.7, "end_percent": 1.0}},
|
||||||
|
"8": {"class_type": "DualModelGuider", "inputs": {"model": ["7", 0], "positive": ["3", 0], "model_negative": ["6", 0], "negative": ["4", 0], "cfg": 7.0}},
|
||||||
|
"9": {"class_type": "EmptyFlux2LatentImage", "inputs": {"width": 768, "height": 1024, "batch_size": 1}},
|
||||||
|
"10": {"class_type": "KSamplerSelect", "inputs": {"sampler_name": "euler"}},
|
||||||
|
"11": {"class_type": "Ideogram4Scheduler", "inputs": {"steps": 8, "width": 768, "height": 1024, "mu": 0.5, "std": 1.75}},
|
||||||
|
"12": {"class_type": "RandomNoise", "inputs": {"noise_seed": 20261012}},
|
||||||
|
"13": {"class_type": "SamplerCustomAdvanced", "inputs": {"noise": ["12", 0], "guider": ["8", 0], "sampler": ["10", 0], "sigmas": ["11", 0], "latent_image": ["9", 0]}},
|
||||||
|
"14": {"class_type": "VAEDecode", "inputs": {"samples": ["13", 0], "vae": ["1", 0]}},
|
||||||
|
"15": {"class_type": "SaveImage", "inputs": {"images": ["14", 0], "filename_prefix": "ideogram4-t2i"}}
|
||||||
|
}
|
||||||
Reference in New Issue
Block a user