Add static variables and optimization test matrices
This commit is contained in:
@@ -1,3 +1,5 @@
|
||||
# I2I workflows
|
||||
|
||||
Use [`flux/`](flux/) or [`qwen/`](qwen/) for one-reference-image transformations. The workflows infer the subject from the input image instead of naming a specific character or scene.
|
||||
|
||||
The shared reference asset and static variables are recorded in [`variables.json`](variables.json) and `character_reference.png`. The test plans live in each model README.
|
||||
|
||||
Binary file not shown.
|
After Width: | Height: | Size: 647 KiB |
@@ -18,3 +18,18 @@ Files:
|
||||
|
||||
- `workflow.json` — API-format prompt.
|
||||
- `ui-workflow.json` — native ComfyUI web-editor workflow.
|
||||
|
||||
## Planned optimization matrix
|
||||
|
||||
All rows are intentionally **Untested**. Keep the reference image, prompt, seed, and input-derived resolution fixed. Flux2Scheduler does not expose a selectable scheduler, so that value remains fixed.
|
||||
|
||||
| ID | CFG | Steps | Sampler | Scheduler | Tested? |
|
||||
|---|---:|---:|---|---|---|
|
||||
| F-I2I-01 baseline | 1.0 | 4 | euler | Flux2Scheduler | No |
|
||||
| F-I2I-02 | 1.0 | 4 | euler_cfg_pp | Flux2Scheduler | No |
|
||||
| F-I2I-03 | 1.0 | 6 | euler | Flux2Scheduler | No |
|
||||
| F-I2I-04 | 1.0 | 6 | euler_cfg_pp | Flux2Scheduler | No |
|
||||
| F-I2I-05 | 1.0 | 4 | res_multistep | Flux2Scheduler | No |
|
||||
| F-I2I-06 | 0.8 | 4 | euler | Flux2Scheduler | No |
|
||||
| F-I2I-07 | 1.2 | 4 | euler | Flux2Scheduler | No |
|
||||
| F-I2I-08 | 1.0 | 8 | euler_cfg_pp | Flux2Scheduler | No |
|
||||
|
||||
@@ -4,7 +4,7 @@ Converts any supplied reference image into a photorealistic image of the same su
|
||||
|
||||
## Reusable inputs
|
||||
|
||||
- `input.png` in node `4` — replace with the reference image.
|
||||
- `character_reference.png` in node `4` — replace with the reference image.
|
||||
- Node `7` positive and negative prompts — adapt the transformation without describing a specific subject.
|
||||
- Node `10` seed — change for alternate results or keep fixed for comparisons.
|
||||
- Nodes `5` and `14` — change the generation and output dimensions. The default is portrait 1080×1920 for person-focused images.
|
||||
@@ -21,3 +21,20 @@ Converts any supplied reference image into a photorealistic image of the same su
|
||||
The workflow uses the installed Qwen Image 2.1 stack and the flattened `images.image_1` reference input required by the API workflow.
|
||||
|
||||
- `workflow.json` — API-format workflow.
|
||||
|
||||
## Planned optimization matrix
|
||||
|
||||
All rows are intentionally **Untested**. Keep the reference image, prompt, seed, and dimensions from [`../variables.json`](../variables.json) fixed.
|
||||
|
||||
| ID | CFG | Steps | Sampler | Scheduler | Tested? |
|
||||
|---|---:|---:|---|---|---|
|
||||
| Q-I2I-01 baseline | 3.5 | 40 | euler_cfg_pp | beta | No |
|
||||
| Q-I2I-02 | 2.5 | 24 | euler_cfg_pp | beta | No |
|
||||
| Q-I2I-03 | 2.5 | 30 | euler_cfg_pp | beta | No |
|
||||
| Q-I2I-04 | 2.5 | 40 | euler_cfg_pp | beta | No |
|
||||
| Q-I2I-05 | 3.5 | 40 | euler | beta | No |
|
||||
| Q-I2I-06 | 3.5 | 40 | res_multistep | beta | No |
|
||||
| Q-I2I-07 | 3.0 | 30 | euler_cfg_pp | simple | No |
|
||||
| Q-I2I-08 | 4.0 | 30 | euler_cfg_pp | beta | No |
|
||||
| Q-I2I-09 | 3.5 | 50 | euler_cfg_pp | beta | No |
|
||||
| Q-I2I-10 | 3.5 | 40 | euler_cfg_pp | sgm_uniform | No |
|
||||
|
||||
@@ -2,7 +2,7 @@
|
||||
"1": {"class_type":"UNETLoader","inputs":{"unet_name":"qwen_image_2.1_int8_convrot.safetensors","weight_dtype":"default"}},
|
||||
"2": {"class_type":"CLIPLoader","inputs":{"clip_name":"qwen3vl_8b_w4a8.safetensors","type":"qwen_image","device":"default"}},
|
||||
"3": {"class_type":"VAELoader","inputs":{"vae_name":"qwen_image_2.1_vae_bf16.safetensors"}},
|
||||
"4": {"class_type":"LoadImage","inputs":{"image":"input.png"}},
|
||||
"4": {"class_type":"LoadImage","inputs":{"image":"character_reference.png"}},
|
||||
"5": {"class_type":"ResizeAndPadImage","inputs":{"image":["4",0],"target_width":576,"target_height":1024,"padding_color":"white","interpolation":"lanczos"}},
|
||||
"6": {"class_type":"QwenImage21Cache","inputs":{"model":["1",0],"device":"auto","dtype":"int8"}},
|
||||
"7": {"class_type":"TextEncodeQwenImage21","inputs":{"clip":["2",0],"prompt":"Transform the supplied reference image into a photorealistic image of the same subject. Infer identity, facial features, skin tone, hairstyle, clothing, accessories, colors, pose, body proportions, composition, and framing directly from the reference. Preserve those visual attributes faithfully while replacing the original rendering style with natural human anatomy, realistic skin and hair texture, physically accurate materials, believable fabric and surface detail, natural hands and fingers, cinematic soft light, realistic shadows, coherent perspective, premium editorial photography, high dynamic range, photorealistic, highly detailed. Do not redesign, restyle, substitute, add, remove, mirror, or crop the subject. No text or logos.","negative_prompt":"different person, changed identity, changed face, changed hairstyle, changed clothing, changed colors, altered accessories, changed pose, different composition, extra person, duplicate person, extra limbs, malformed hands, fused fingers, distorted anatomy, cropped head, cropped feet, mirrored image, cartoon, illustration, anime, CGI, plastic skin, waxy skin, blurry, low detail, text, logo, watermark","resolution":0,"images.image_1":["5",0],"vae":["3",0]}},
|
||||
|
||||
@@ -0,0 +1,26 @@
|
||||
{
|
||||
"description": "Static variables for controlled single-reference I2I experiments.",
|
||||
"base_images": {
|
||||
"character_reference.png": "character_reference.png"
|
||||
},
|
||||
"workflows": {
|
||||
"flux": {
|
||||
"prompt_node": "74.text",
|
||||
"seed_node": "73.noise_seed",
|
||||
"seed": 20260921,
|
||||
"input_node": "1.image",
|
||||
"input_image": "character_reference.png",
|
||||
"resolution": "inferred from input; default input is portrait"
|
||||
},
|
||||
"qwen": {
|
||||
"prompt_node": "7.prompt",
|
||||
"negative_prompt_node": "7.negative_prompt",
|
||||
"seed_node": "10.noise_seed",
|
||||
"seed": 20260921,
|
||||
"input_node": "4.image",
|
||||
"input_image": "character_reference.png",
|
||||
"generation_resolution": [576, 1024],
|
||||
"output_resolution": [1080, 1920]
|
||||
}
|
||||
}
|
||||
}
|
||||
Reference in New Issue
Block a user