Add Flux 3 Image workflow test plan
This commit is contained in:
@@ -0,0 +1,49 @@
|
|||||||
|
# FLUX 3 Image
|
||||||
|
|
||||||
|
This directory contains the first controlled workflow and test plan for the
|
||||||
|
server's newly available `Flux3ImageNode` API node.
|
||||||
|
|
||||||
|
## Workflow
|
||||||
|
|
||||||
|
- `workflow.json` — API-format prompt for `/prompt` automation.
|
||||||
|
- `prompt.txt` — fixed baseline prompt.
|
||||||
|
- `variables.json` — fixed values and allowed test variables.
|
||||||
|
- `results/` — output images and matching metadata records.
|
||||||
|
|
||||||
|
The node is an API-backed image generator, not a local checkpoint sampler. It
|
||||||
|
accepts up to ten optional reference images, supports automatic or explicit
|
||||||
|
aspect ratios, and offers `0.75K`, `1K`, `1.5K`, `2K`, and `4K` output tiers.
|
||||||
|
|
||||||
|
## Test matrix
|
||||||
|
|
||||||
|
The first pass changes one variable at a time. The prompt, aspect ratio,
|
||||||
|
grounding state, safety tolerance, and reference count remain fixed unless a
|
||||||
|
row explicitly changes them.
|
||||||
|
|
||||||
|
| ID | Purpose | Resolution | References | Grounding | Seed | Status | Runtime (s) | Verdict |
|
||||||
|
|---|---|---:|---:|---|---:|---|---:|---|
|
||||||
|
| F3I-T2I-01 | Baseline text-to-image | 1K | 0 | Off | 310001 | Blocked: authentication | 0.0 | Not evaluated |
|
||||||
|
| F3I-T2I-02 | Lower-cost output comparison | 0.75K | 0 | Off | 310002 | Planned | — | — |
|
||||||
|
| F3I-T2I-03 | Detail/quality comparison | 1.5K | 0 | Off | 310003 | Planned | — | — |
|
||||||
|
| F3I-T2I-04 | Higher-resolution feasibility | 2K | 0 | Off | 310004 | Planned | — | — |
|
||||||
|
| F3I-T2I-05 | Grounded prompt comparison | 1K | 0 | On | 310005 | Planned | — | — |
|
||||||
|
| F3I-I2I-01 | Single-reference edit | 1K | 1 | Off | 310006 | Planned | — | — |
|
||||||
|
|
||||||
|
## Evaluation
|
||||||
|
|
||||||
|
Record the exact prompt, seed, resolution, reference filename/hash, runtime,
|
||||||
|
output dimensions, success/failure, and visual notes in `results/<test-id>.json`.
|
||||||
|
Keep the first successful baseline as the comparison target. Do not promote a
|
||||||
|
larger resolution solely because it is larger; judge detail, composition,
|
||||||
|
prompt adherence, artifacts, and cost/runtime together.
|
||||||
|
|
||||||
|
The API node's seed controls rerun identity but the service may remain
|
||||||
|
nondeterministic. That is recorded as a property of the test, not treated as a
|
||||||
|
failure.
|
||||||
|
|
||||||
|
## Initial run
|
||||||
|
|
||||||
|
`F3I-T2I-01` was accepted by ComfyUI with no workflow validation errors, but
|
||||||
|
the node returned `Unauthorized: Please login first to use this node.` before
|
||||||
|
generation. The server must be logged into the Comfy API service before the
|
||||||
|
matrix can proceed. No image or runtime-quality result was produced.
|
||||||
@@ -0,0 +1 @@
|
|||||||
|
A highly detailed editorial photograph of a red fox standing on a moss-covered stone in a quiet temperate forest after rain. Soft overcast light, wet leaves, natural fur detail, shallow depth of field, realistic colors, no text, no logo.
|
||||||
@@ -0,0 +1,21 @@
|
|||||||
|
{
|
||||||
|
"test_id": "F3I-T2I-01",
|
||||||
|
"status": "failed",
|
||||||
|
"verdict": "Blocked by Comfy API authentication before generation",
|
||||||
|
"prompt_id": "65659b7d-a050-4076-8d8f-1abb461a94db",
|
||||||
|
"configuration": {
|
||||||
|
"resolution": "1K",
|
||||||
|
"aspect_ratio": "1:1",
|
||||||
|
"grounding": false,
|
||||||
|
"safety_tolerance": 4,
|
||||||
|
"seed": 310001,
|
||||||
|
"references": 0
|
||||||
|
},
|
||||||
|
"error": {
|
||||||
|
"node_id": "1",
|
||||||
|
"node_type": "Flux3ImageNode",
|
||||||
|
"message": "Unauthorized: Please login first to use this node."
|
||||||
|
},
|
||||||
|
"runtime_seconds": 0.0,
|
||||||
|
"output": null
|
||||||
|
}
|
||||||
@@ -0,0 +1,23 @@
|
|||||||
|
{
|
||||||
|
"model": "Flux3ImageNode",
|
||||||
|
"fixed": {
|
||||||
|
"prompt_file": "prompt.txt",
|
||||||
|
"aspect_ratio": "1:1",
|
||||||
|
"grounding": false,
|
||||||
|
"safety_tolerance": 4,
|
||||||
|
"image_references": 0
|
||||||
|
},
|
||||||
|
"test_ids": [
|
||||||
|
"F3I-T2I-01",
|
||||||
|
"F3I-T2I-02",
|
||||||
|
"F3I-T2I-03",
|
||||||
|
"F3I-T2I-04",
|
||||||
|
"F3I-T2I-05",
|
||||||
|
"F3I-I2I-01"
|
||||||
|
],
|
||||||
|
"allowed_variables": {
|
||||||
|
"resolution": ["0.75K", "1K", "1.5K", "2K", "4K"],
|
||||||
|
"seed": "controlled per test",
|
||||||
|
"reference_images": "0 or 1"
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,21 @@
|
|||||||
|
{
|
||||||
|
"1": {
|
||||||
|
"class_type": "Flux3ImageNode",
|
||||||
|
"inputs": {
|
||||||
|
"prompt": "A highly detailed editorial photograph of a red fox standing on a moss-covered stone in a quiet temperate forest after rain. Soft overcast light, wet leaves, natural fur detail, shallow depth of field, realistic colors, no text, no logo.",
|
||||||
|
"images": [],
|
||||||
|
"aspect_ratio": "1:1",
|
||||||
|
"resolution": "1K",
|
||||||
|
"grounding": false,
|
||||||
|
"safety_tolerance": 4,
|
||||||
|
"seed": 310001
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"2": {
|
||||||
|
"class_type": "SaveImage",
|
||||||
|
"inputs": {
|
||||||
|
"filename_prefix": "fluxExperiments/flux3image/F3I-T2I-01",
|
||||||
|
"images": ["1", 0]
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
Reference in New Issue
Block a user