Add Flux 3 Image workflow test plan
This commit is contained in:
@@ -0,0 +1,49 @@
|
||||
# FLUX 3 Image
|
||||
|
||||
This directory contains the first controlled workflow and test plan for the
|
||||
server's newly available `Flux3ImageNode` API node.
|
||||
|
||||
## Workflow
|
||||
|
||||
- `workflow.json` — API-format prompt for `/prompt` automation.
|
||||
- `prompt.txt` — fixed baseline prompt.
|
||||
- `variables.json` — fixed values and allowed test variables.
|
||||
- `results/` — output images and matching metadata records.
|
||||
|
||||
The node is an API-backed image generator, not a local checkpoint sampler. It
|
||||
accepts up to ten optional reference images, supports automatic or explicit
|
||||
aspect ratios, and offers `0.75K`, `1K`, `1.5K`, `2K`, and `4K` output tiers.
|
||||
|
||||
## Test matrix
|
||||
|
||||
The first pass changes one variable at a time. The prompt, aspect ratio,
|
||||
grounding state, safety tolerance, and reference count remain fixed unless a
|
||||
row explicitly changes them.
|
||||
|
||||
| ID | Purpose | Resolution | References | Grounding | Seed | Status | Runtime (s) | Verdict |
|
||||
|---|---|---:|---:|---|---:|---|---:|---|
|
||||
| F3I-T2I-01 | Baseline text-to-image | 1K | 0 | Off | 310001 | Blocked: authentication | 0.0 | Not evaluated |
|
||||
| F3I-T2I-02 | Lower-cost output comparison | 0.75K | 0 | Off | 310002 | Planned | — | — |
|
||||
| F3I-T2I-03 | Detail/quality comparison | 1.5K | 0 | Off | 310003 | Planned | — | — |
|
||||
| F3I-T2I-04 | Higher-resolution feasibility | 2K | 0 | Off | 310004 | Planned | — | — |
|
||||
| F3I-T2I-05 | Grounded prompt comparison | 1K | 0 | On | 310005 | Planned | — | — |
|
||||
| F3I-I2I-01 | Single-reference edit | 1K | 1 | Off | 310006 | Planned | — | — |
|
||||
|
||||
## Evaluation
|
||||
|
||||
Record the exact prompt, seed, resolution, reference filename/hash, runtime,
|
||||
output dimensions, success/failure, and visual notes in `results/<test-id>.json`.
|
||||
Keep the first successful baseline as the comparison target. Do not promote a
|
||||
larger resolution solely because it is larger; judge detail, composition,
|
||||
prompt adherence, artifacts, and cost/runtime together.
|
||||
|
||||
The API node's seed controls rerun identity but the service may remain
|
||||
nondeterministic. That is recorded as a property of the test, not treated as a
|
||||
failure.
|
||||
|
||||
## Initial run
|
||||
|
||||
`F3I-T2I-01` was accepted by ComfyUI with no workflow validation errors, but
|
||||
the node returned `Unauthorized: Please login first to use this node.` before
|
||||
generation. The server must be logged into the Comfy API service before the
|
||||
matrix can proceed. No image or runtime-quality result was produced.
|
||||
@@ -0,0 +1 @@
|
||||
A highly detailed editorial photograph of a red fox standing on a moss-covered stone in a quiet temperate forest after rain. Soft overcast light, wet leaves, natural fur detail, shallow depth of field, realistic colors, no text, no logo.
|
||||
@@ -0,0 +1,21 @@
|
||||
{
|
||||
"test_id": "F3I-T2I-01",
|
||||
"status": "failed",
|
||||
"verdict": "Blocked by Comfy API authentication before generation",
|
||||
"prompt_id": "65659b7d-a050-4076-8d8f-1abb461a94db",
|
||||
"configuration": {
|
||||
"resolution": "1K",
|
||||
"aspect_ratio": "1:1",
|
||||
"grounding": false,
|
||||
"safety_tolerance": 4,
|
||||
"seed": 310001,
|
||||
"references": 0
|
||||
},
|
||||
"error": {
|
||||
"node_id": "1",
|
||||
"node_type": "Flux3ImageNode",
|
||||
"message": "Unauthorized: Please login first to use this node."
|
||||
},
|
||||
"runtime_seconds": 0.0,
|
||||
"output": null
|
||||
}
|
||||
@@ -0,0 +1,23 @@
|
||||
{
|
||||
"model": "Flux3ImageNode",
|
||||
"fixed": {
|
||||
"prompt_file": "prompt.txt",
|
||||
"aspect_ratio": "1:1",
|
||||
"grounding": false,
|
||||
"safety_tolerance": 4,
|
||||
"image_references": 0
|
||||
},
|
||||
"test_ids": [
|
||||
"F3I-T2I-01",
|
||||
"F3I-T2I-02",
|
||||
"F3I-T2I-03",
|
||||
"F3I-T2I-04",
|
||||
"F3I-T2I-05",
|
||||
"F3I-I2I-01"
|
||||
],
|
||||
"allowed_variables": {
|
||||
"resolution": ["0.75K", "1K", "1.5K", "2K", "4K"],
|
||||
"seed": "controlled per test",
|
||||
"reference_images": "0 or 1"
|
||||
}
|
||||
}
|
||||
@@ -0,0 +1,21 @@
|
||||
{
|
||||
"1": {
|
||||
"class_type": "Flux3ImageNode",
|
||||
"inputs": {
|
||||
"prompt": "A highly detailed editorial photograph of a red fox standing on a moss-covered stone in a quiet temperate forest after rain. Soft overcast light, wet leaves, natural fur detail, shallow depth of field, realistic colors, no text, no logo.",
|
||||
"images": [],
|
||||
"aspect_ratio": "1:1",
|
||||
"resolution": "1K",
|
||||
"grounding": false,
|
||||
"safety_tolerance": 4,
|
||||
"seed": 310001
|
||||
}
|
||||
},
|
||||
"2": {
|
||||
"class_type": "SaveImage",
|
||||
"inputs": {
|
||||
"filename_prefix": "fluxExperiments/flux3image/F3I-T2I-01",
|
||||
"images": ["1", 0]
|
||||
}
|
||||
}
|
||||
}
|
||||
Reference in New Issue
Block a user