Add Flux 3 Image workflow test plan

This commit is contained in:
Morpheus
2026-10-22 16:21:27 +00:00
parent f443547970
commit cd6f0fc503
5 changed files with 115 additions and 0 deletions
+49
View File
@@ -0,0 +1,49 @@
# FLUX 3 Image
This directory contains the first controlled workflow and test plan for the
server's newly available `Flux3ImageNode` API node.
## Workflow
- `workflow.json` — API-format prompt for `/prompt` automation.
- `prompt.txt` — fixed baseline prompt.
- `variables.json` — fixed values and allowed test variables.
- `results/` — output images and matching metadata records.
The node is an API-backed image generator, not a local checkpoint sampler. It
accepts up to ten optional reference images, supports automatic or explicit
aspect ratios, and offers `0.75K`, `1K`, `1.5K`, `2K`, and `4K` output tiers.
## Test matrix
The first pass changes one variable at a time. The prompt, aspect ratio,
grounding state, safety tolerance, and reference count remain fixed unless a
row explicitly changes them.
| ID | Purpose | Resolution | References | Grounding | Seed | Status | Runtime (s) | Verdict |
|---|---|---:|---:|---|---:|---|---:|---|
| F3I-T2I-01 | Baseline text-to-image | 1K | 0 | Off | 310001 | Blocked: authentication | 0.0 | Not evaluated |
| F3I-T2I-02 | Lower-cost output comparison | 0.75K | 0 | Off | 310002 | Planned | — | — |
| F3I-T2I-03 | Detail/quality comparison | 1.5K | 0 | Off | 310003 | Planned | — | — |
| F3I-T2I-04 | Higher-resolution feasibility | 2K | 0 | Off | 310004 | Planned | — | — |
| F3I-T2I-05 | Grounded prompt comparison | 1K | 0 | On | 310005 | Planned | — | — |
| F3I-I2I-01 | Single-reference edit | 1K | 1 | Off | 310006 | Planned | — | — |
## Evaluation
Record the exact prompt, seed, resolution, reference filename/hash, runtime,
output dimensions, success/failure, and visual notes in `results/<test-id>.json`.
Keep the first successful baseline as the comparison target. Do not promote a
larger resolution solely because it is larger; judge detail, composition,
prompt adherence, artifacts, and cost/runtime together.
The API node's seed controls rerun identity but the service may remain
nondeterministic. That is recorded as a property of the test, not treated as a
failure.
## Initial run
`F3I-T2I-01` was accepted by ComfyUI with no workflow validation errors, but
the node returned `Unauthorized: Please login first to use this node.` before
generation. The server must be logged into the Comfy API service before the
matrix can proceed. No image or runtime-quality result was produced.
+1
View File
@@ -0,0 +1 @@
A highly detailed editorial photograph of a red fox standing on a moss-covered stone in a quiet temperate forest after rain. Soft overcast light, wet leaves, natural fur detail, shallow depth of field, realistic colors, no text, no logo.
@@ -0,0 +1,21 @@
{
"test_id": "F3I-T2I-01",
"status": "failed",
"verdict": "Blocked by Comfy API authentication before generation",
"prompt_id": "65659b7d-a050-4076-8d8f-1abb461a94db",
"configuration": {
"resolution": "1K",
"aspect_ratio": "1:1",
"grounding": false,
"safety_tolerance": 4,
"seed": 310001,
"references": 0
},
"error": {
"node_id": "1",
"node_type": "Flux3ImageNode",
"message": "Unauthorized: Please login first to use this node."
},
"runtime_seconds": 0.0,
"output": null
}
+23
View File
@@ -0,0 +1,23 @@
{
"model": "Flux3ImageNode",
"fixed": {
"prompt_file": "prompt.txt",
"aspect_ratio": "1:1",
"grounding": false,
"safety_tolerance": 4,
"image_references": 0
},
"test_ids": [
"F3I-T2I-01",
"F3I-T2I-02",
"F3I-T2I-03",
"F3I-T2I-04",
"F3I-T2I-05",
"F3I-I2I-01"
],
"allowed_variables": {
"resolution": ["0.75K", "1K", "1.5K", "2K", "4K"],
"seed": "controlled per test",
"reference_images": "0 or 1"
}
}
+21
View File
@@ -0,0 +1,21 @@
{
"1": {
"class_type": "Flux3ImageNode",
"inputs": {
"prompt": "A highly detailed editorial photograph of a red fox standing on a moss-covered stone in a quiet temperate forest after rain. Soft overcast light, wet leaves, natural fur detail, shallow depth of field, realistic colors, no text, no logo.",
"images": [],
"aspect_ratio": "1:1",
"resolution": "1K",
"grounding": false,
"safety_tolerance": 4,
"seed": 310001
}
},
"2": {
"class_type": "SaveImage",
"inputs": {
"filename_prefix": "fluxExperiments/flux3image/F3I-T2I-01",
"images": ["1", 0]
}
}
}