Add static variables and optimization test matrices

This commit is contained in:
Morpheus
2026-09-23 09:04:14 +00:00
parent 7ff0b7547a
commit 910d0f2e12
15 changed files with 153 additions and 2 deletions
+2
View File
@@ -1,3 +1,5 @@
# I2I workflows
Use [`flux/`](flux/) or [`qwen/`](qwen/) for one-reference-image transformations. The workflows infer the subject from the input image instead of naming a specific character or scene.
The shared reference asset and static variables are recorded in [`variables.json`](variables.json) and `character_reference.png`. The test plans live in each model README.
Binary file not shown.

After

Width:  |  Height:  |  Size: 647 KiB

+15
View File
@@ -18,3 +18,18 @@ Files:
- `workflow.json` — API-format prompt.
- `ui-workflow.json` — native ComfyUI web-editor workflow.
## Planned optimization matrix
All rows are intentionally **Untested**. Keep the reference image, prompt, seed, and input-derived resolution fixed. Flux2Scheduler does not expose a selectable scheduler, so that value remains fixed.
| ID | CFG | Steps | Sampler | Scheduler | Tested? |
|---|---:|---:|---|---|---|
| F-I2I-01 baseline | 1.0 | 4 | euler | Flux2Scheduler | No |
| F-I2I-02 | 1.0 | 4 | euler_cfg_pp | Flux2Scheduler | No |
| F-I2I-03 | 1.0 | 6 | euler | Flux2Scheduler | No |
| F-I2I-04 | 1.0 | 6 | euler_cfg_pp | Flux2Scheduler | No |
| F-I2I-05 | 1.0 | 4 | res_multistep | Flux2Scheduler | No |
| F-I2I-06 | 0.8 | 4 | euler | Flux2Scheduler | No |
| F-I2I-07 | 1.2 | 4 | euler | Flux2Scheduler | No |
| F-I2I-08 | 1.0 | 8 | euler_cfg_pp | Flux2Scheduler | No |
+18 -1
View File
@@ -4,7 +4,7 @@ Converts any supplied reference image into a photorealistic image of the same su
## Reusable inputs
- `input.png` in node `4` — replace with the reference image.
- `character_reference.png` in node `4` — replace with the reference image.
- Node `7` positive and negative prompts — adapt the transformation without describing a specific subject.
- Node `10` seed — change for alternate results or keep fixed for comparisons.
- Nodes `5` and `14` — change the generation and output dimensions. The default is portrait 1080×1920 for person-focused images.
@@ -21,3 +21,20 @@ Converts any supplied reference image into a photorealistic image of the same su
The workflow uses the installed Qwen Image 2.1 stack and the flattened `images.image_1` reference input required by the API workflow.
- `workflow.json` — API-format workflow.
## Planned optimization matrix
All rows are intentionally **Untested**. Keep the reference image, prompt, seed, and dimensions from [`../variables.json`](../variables.json) fixed.
| ID | CFG | Steps | Sampler | Scheduler | Tested? |
|---|---:|---:|---|---|---|
| Q-I2I-01 baseline | 3.5 | 40 | euler_cfg_pp | beta | No |
| Q-I2I-02 | 2.5 | 24 | euler_cfg_pp | beta | No |
| Q-I2I-03 | 2.5 | 30 | euler_cfg_pp | beta | No |
| Q-I2I-04 | 2.5 | 40 | euler_cfg_pp | beta | No |
| Q-I2I-05 | 3.5 | 40 | euler | beta | No |
| Q-I2I-06 | 3.5 | 40 | res_multistep | beta | No |
| Q-I2I-07 | 3.0 | 30 | euler_cfg_pp | simple | No |
| Q-I2I-08 | 4.0 | 30 | euler_cfg_pp | beta | No |
| Q-I2I-09 | 3.5 | 50 | euler_cfg_pp | beta | No |
| Q-I2I-10 | 3.5 | 40 | euler_cfg_pp | sgm_uniform | No |
+1 -1
View File
@@ -2,7 +2,7 @@
"1": {"class_type":"UNETLoader","inputs":{"unet_name":"qwen_image_2.1_int8_convrot.safetensors","weight_dtype":"default"}},
"2": {"class_type":"CLIPLoader","inputs":{"clip_name":"qwen3vl_8b_w4a8.safetensors","type":"qwen_image","device":"default"}},
"3": {"class_type":"VAELoader","inputs":{"vae_name":"qwen_image_2.1_vae_bf16.safetensors"}},
"4": {"class_type":"LoadImage","inputs":{"image":"input.png"}},
"4": {"class_type":"LoadImage","inputs":{"image":"character_reference.png"}},
"5": {"class_type":"ResizeAndPadImage","inputs":{"image":["4",0],"target_width":576,"target_height":1024,"padding_color":"white","interpolation":"lanczos"}},
"6": {"class_type":"QwenImage21Cache","inputs":{"model":["1",0],"device":"auto","dtype":"int8"}},
"7": {"class_type":"TextEncodeQwenImage21","inputs":{"clip":["2",0],"prompt":"Transform the supplied reference image into a photorealistic image of the same subject. Infer identity, facial features, skin tone, hairstyle, clothing, accessories, colors, pose, body proportions, composition, and framing directly from the reference. Preserve those visual attributes faithfully while replacing the original rendering style with natural human anatomy, realistic skin and hair texture, physically accurate materials, believable fabric and surface detail, natural hands and fingers, cinematic soft light, realistic shadows, coherent perspective, premium editorial photography, high dynamic range, photorealistic, highly detailed. Do not redesign, restyle, substitute, add, remove, mirror, or crop the subject. No text or logos.","negative_prompt":"different person, changed identity, changed face, changed hairstyle, changed clothing, changed colors, altered accessories, changed pose, different composition, extra person, duplicate person, extra limbs, malformed hands, fused fingers, distorted anatomy, cropped head, cropped feet, mirrored image, cartoon, illustration, anime, CGI, plastic skin, waxy skin, blurry, low detail, text, logo, watermark","resolution":0,"images.image_1":["5",0],"vae":["3",0]}},
+26
View File
@@ -0,0 +1,26 @@
{
"description": "Static variables for controlled single-reference I2I experiments.",
"base_images": {
"character_reference.png": "character_reference.png"
},
"workflows": {
"flux": {
"prompt_node": "74.text",
"seed_node": "73.noise_seed",
"seed": 20260921,
"input_node": "1.image",
"input_image": "character_reference.png",
"resolution": "inferred from input; default input is portrait"
},
"qwen": {
"prompt_node": "7.prompt",
"negative_prompt_node": "7.negative_prompt",
"seed_node": "10.noise_seed",
"seed": 20260921,
"input_node": "4.image",
"input_image": "character_reference.png",
"generation_resolution": [576, 1024],
"output_resolution": [1080, 1920]
}
}
}