98 lines
4.9 KiB
Markdown
98 lines
4.9 KiB
Markdown
# Ideogram 4 — author-informed T2I tests
|
||
|
||
This section follows the model card and author workflow: structured Ideogram 4
|
||
JSON captions, AuraFlow shift 5.25, StarSampler, and CFG 1.0. It is intended
|
||
for controlled quality/time comparisons on the RTX 3070 server.
|
||
|
||
## Current direction
|
||
|
||
- Main models: `ideogram4_int8_convrot.safetensors` and
|
||
`Fal_Ideo_4_NSFW-int8_convrot.safetensors`, tested separately
|
||
- Text encoder: `qwen3vl_8b_w4a8.safetensors`, type `ideogram4`
|
||
- VAE: `flux2-vae.safetensors`
|
||
- Prompt: Ideogram 4 structured JSON caption
|
||
- Sampling: AuraFlow shift `5.25`; StarSampler, Euler, simple scheduler
|
||
- Steps: author workflow 8; model-card reference 10
|
||
- CFG: `1.0`
|
||
- Seed: 20261012 for the controlled baseline
|
||
|
||
The Fal model is retained as a comparison only; it produced more stylised,
|
||
noisier results. The hosted `IdeogramV4` API node was not used because this
|
||
server is not authenticated for Comfy API partner nodes.
|
||
|
||
## Author-inspired comparison
|
||
|
||
The model author publishes a workflow at
|
||
[`Winnougan/Ideogram_Instant_NSFW`](https://huggingface.co/Winnougan/Ideogram_Instant_NSFW).
|
||
It suggests a useful comparison branch rather than a replacement for the
|
||
local baseline:
|
||
|
||
- `Ideogram4PromptBuilderKJ` for structured prompt construction
|
||
- `ModelSamplingAuraFlow` with `shift=5.25`
|
||
- `StarSampler` with 8 steps, Euler, simple schedule, and CFG 1.0
|
||
- Fal Ideogram checkpoint with the local `flux2-vae.safetensors`
|
||
|
||
The author's graph references `Boogu\\qwen3vl_8b_int8_convrot.safetensors`, which
|
||
is not installed here, so the comparison uses the available
|
||
`qwen3vl_8b_w4a8.safetensors`. Complete settings are recorded in
|
||
[`author-inspired-settings.json`](author-inspired-settings.json).
|
||
|
||
These settings remain comparison-only until a fixed prompt and seed are tested
|
||
at 768×1024 and reviewed for typography, anatomy, texture, composition, and
|
||
runtime.
|
||
|
||
The model card also states that the fine-tune expects a structured JSON caption
|
||
with `high_level_description` and `compositional_deconstruction` fields, and
|
||
gives 10 steps with guidance scale 1.0 as its reference usage. The published
|
||
ComfyUI graph uses 8 steps, so both settings are worth measuring separately.
|
||
The card contains several unfinished placeholder sections, so its training and
|
||
fine-tuning details should not be treated as verified claims.
|
||
|
||
## Initial observations
|
||
|
||
- The 512×512 local smoke test completed successfully.
|
||
- The 768×1024 standard Ideogram 4 run took about 6 minutes at 12 steps.
|
||
- The 768×1024 Fal comparison took about 7 minutes at 12 steps.
|
||
- The 8-step Fal run completed in about 5 minutes 18 seconds, but remained
|
||
painterly and noisy.
|
||
|
||
## Current smoke tests
|
||
|
||
The first smoke tests use the same 512×512 structured caption and seed before
|
||
full-size tests are queued. Exact prompt IDs are recorded in `smoke-tests.json`.
|
||
|
||
| ID | Model | Steps | Sampler | Scheduler | Shift | CFG | Status |
|
||
|---|---|---:|---|---|---:|---:|---|
|
||
| IDEO-SMOKE-FAL-10 | Fal Ideogram | 10 | Euler | simple | 5.25 | 1 | Running |
|
||
| IDEO-SMOKE-LOCAL-08 | Local Ideogram | 8 | Euler | simple | 5.25 | 1 | Queued |
|
||
|
||
## Revised quality/time matrix
|
||
|
||
The previous free-form-prompt/dual-guider queue was stopped because its
|
||
outputs did not meet the quality bar. Those IDs remain historical in
|
||
`submissions.json`; they are not part of this new matrix.
|
||
|
||
Keep the prompt and seed fixed for sampler tests. Keep all other settings fixed
|
||
when changing one variable. A row is not promoted until detail, anatomy,
|
||
composition, text fidelity, artefacts, and runtime are reviewed.
|
||
|
||
| ID | Model | Resolution | Steps | Sampler | Scheduler | Shift | CFG | Purpose | Status |
|
||
|---|---|---:|---:|---|---|---:|---:|---|---|
|
||
| IDEO-AUTHOR-01 | Fal | 768×1024 | 8 | Euler | simple | 5.25 | 1 | Author sampling | Planned |
|
||
| IDEO-AUTHOR-02 | Local | 768×1024 | 8 | Euler | simple | 5.25 | 1 | Local author sampling | Planned |
|
||
| IDEO-CARD-10 | Local | 768×1024 | 10 | Euler | simple | 5.25 | 1 | Model-card step count | Planned |
|
||
| IDEO-SAMPLER-01 | Local | 768×1024 | 8 | res_multistep | simple | 5.25 | 1 | Sampler comparison | Planned |
|
||
| IDEO-SAMPLER-02 | Local | 768×1024 | 8 | euler_ancestral | simple | 5.25 | 1 | Sampler comparison | Planned |
|
||
| IDEO-SCHED-01 | Local | 768×1024 | 8 | Euler | beta | 5.25 | 1 | Scheduler comparison | Planned |
|
||
| IDEO-SHIFT-01 | Local | 768×1024 | 8 | Euler | simple | 3.0 | 1 | Shift comparison | Planned |
|
||
| IDEO-SHIFT-02 | Local | 768×1024 | 8 | Euler | simple | 7.0 | 1 | Shift comparison | Planned |
|
||
| IDEO-STEPS-01 | Local | 768×1024 | 6 | Euler | simple | 5.25 | 1 | Speed lower bound | Planned |
|
||
Results belong in `results/<test-id>.png` with a matching JSON record containing
|
||
the exact prompt, seed, resolution, settings, runtime, and visual verdict.
|
||
|
||
## Reuse
|
||
|
||
Replace `STRUCTURED_JSON_CAPTION` in `workflow-author-inspired.json` with the
|
||
caption from `smoke-tests.json` or a new test caption. Keep the seed and all
|
||
other settings fixed while changing one matrix variable.
|