From 7ff0b7547ad9df85f2533d003d56e83d8ecd8789 Mon Sep 17 00:00:00 2001 From: Morpheus Date: Wed, 23 Sep 2026 08:47:12 +0000 Subject: [PATCH] Organize optimized workflows by reusable type --- optimized/I2I/README.md | 3 ++ .../flux}/README.md | 2 +- .../flux}/ui-workflow.json | 0 .../flux}/workflow.json | 0 optimized/I2I/qwen/README.md | 23 +++++++++++ optimized/I2I/qwen/workflow.json | 17 ++++++++ optimized/MultipleRef2I/README.md | 3 ++ .../flux}/README.md | 2 +- .../flux}/workflow.json | 0 optimized/README.md | 40 +++++++++++++++---- optimized/T2I/README.md | 3 ++ .../flux}/README.md | 4 +- .../flux}/ui-workflow.json | 0 .../flux}/workflow.json | 0 .../qwen}/README.md | 7 ++-- .../qwen}/ui-workflow.json | 0 .../qwen}/workflow.json | 0 .../flux-character-sheet-4view}/README.md | 0 .../ui-workflow.json | 0 .../flux-character-sheet-4view}/workflow.json | 0 .../flux-portrait}/README.md | 0 .../flux-portrait}/workflow.json | 0 .../qwen-character-sheet-t2i}/README.md | 0 .../ui-workflow.json | 0 .../qwen-character-sheet-t2i}/workflow.json | 0 .../qwen-character-sheet}/README.md | 0 .../qwen-character-sheet}/ui-workflow.json | 0 .../qwen-character-sheet}/workflow.json | 0 optimized/image-edit/README.md | 3 -- optimized/text-to-image/README.md | 3 -- 30 files changed, 88 insertions(+), 22 deletions(-) create mode 100644 optimized/I2I/README.md rename optimized/{image-edit/flux2klein-9b-photorealistic-character => I2I/flux}/README.md (92%) rename optimized/{image-edit/flux2klein-9b-photorealistic-character => I2I/flux}/ui-workflow.json (100%) rename optimized/{image-edit/flux2klein-9b-photorealistic-character => I2I/flux}/workflow.json (100%) create mode 100644 optimized/I2I/qwen/README.md create mode 100644 optimized/I2I/qwen/workflow.json create mode 100644 optimized/MultipleRef2I/README.md rename optimized/{image-edit/flux2klein-9b-multi-reference-composite => MultipleRef2I/flux}/README.md (93%) rename optimized/{image-edit/flux2klein-9b-multi-reference-composite => MultipleRef2I/flux}/workflow.json (100%) create mode 100644 optimized/T2I/README.md rename optimized/{text-to-image/flux2klein-9b-3070-best => T2I/flux}/README.md (78%) rename optimized/{text-to-image/flux2klein-9b-3070-best => T2I/flux}/ui-workflow.json (100%) rename optimized/{text-to-image/flux2klein-9b-3070-best => T2I/flux}/workflow.json (100%) rename optimized/{text-to-image/qwen-image-2.1-spaceship-canteen => T2I/qwen}/README.md (59%) rename optimized/{text-to-image/qwen-image-2.1-spaceship-canteen => T2I/qwen}/ui-workflow.json (100%) rename optimized/{text-to-image/qwen-image-2.1-spaceship-canteen => T2I/qwen}/workflow.json (100%) rename optimized/{image-edit/flux2klein-9b-character-sheet-4view => archive/flux-character-sheet-4view}/README.md (100%) rename optimized/{image-edit/flux2klein-9b-character-sheet-4view => archive/flux-character-sheet-4view}/ui-workflow.json (100%) rename optimized/{image-edit/flux2klein-9b-character-sheet-4view => archive/flux-character-sheet-4view}/workflow.json (100%) rename optimized/{text-to-image/flux2klein-9b-portrait => archive/flux-portrait}/README.md (100%) rename optimized/{text-to-image/flux2klein-9b-portrait => archive/flux-portrait}/workflow.json (100%) rename optimized/{text-to-image/qwen-image-2.1-character-sheet => archive/qwen-character-sheet-t2i}/README.md (100%) rename optimized/{text-to-image/qwen-image-2.1-character-sheet => archive/qwen-character-sheet-t2i}/ui-workflow.json (100%) rename optimized/{text-to-image/qwen-image-2.1-character-sheet => archive/qwen-character-sheet-t2i}/workflow.json (100%) rename optimized/{image-edit/qwen-image-2.1-character-sheet => archive/qwen-character-sheet}/README.md (100%) rename optimized/{image-edit/qwen-image-2.1-character-sheet => archive/qwen-character-sheet}/ui-workflow.json (100%) rename optimized/{image-edit/qwen-image-2.1-character-sheet => archive/qwen-character-sheet}/workflow.json (100%) delete mode 100644 optimized/image-edit/README.md delete mode 100644 optimized/text-to-image/README.md diff --git a/optimized/I2I/README.md b/optimized/I2I/README.md new file mode 100644 index 0000000..bd4e396 --- /dev/null +++ b/optimized/I2I/README.md @@ -0,0 +1,3 @@ +# I2I workflows + +Use [`flux/`](flux/) or [`qwen/`](qwen/) for one-reference-image transformations. The workflows infer the subject from the input image instead of naming a specific character or scene. diff --git a/optimized/image-edit/flux2klein-9b-photorealistic-character/README.md b/optimized/I2I/flux/README.md similarity index 92% rename from optimized/image-edit/flux2klein-9b-photorealistic-character/README.md rename to optimized/I2I/flux/README.md index 174707c..c1cc3e4 100644 --- a/optimized/image-edit/flux2klein-9b-photorealistic-character/README.md +++ b/optimized/I2I/flux/README.md @@ -1,4 +1,4 @@ -# Flux.2 Klein — photorealistic character conversion +# Flux.2 Klein — optimized I2I Converts any supplied reference image into a photorealistic image of the same subject. The prompt is intentionally generic: identity, pose, clothing, accessories, colors, proportions, composition, and framing are inferred from the reference image rather than hard-coded. diff --git a/optimized/image-edit/flux2klein-9b-photorealistic-character/ui-workflow.json b/optimized/I2I/flux/ui-workflow.json similarity index 100% rename from optimized/image-edit/flux2klein-9b-photorealistic-character/ui-workflow.json rename to optimized/I2I/flux/ui-workflow.json diff --git a/optimized/image-edit/flux2klein-9b-photorealistic-character/workflow.json b/optimized/I2I/flux/workflow.json similarity index 100% rename from optimized/image-edit/flux2klein-9b-photorealistic-character/workflow.json rename to optimized/I2I/flux/workflow.json diff --git a/optimized/I2I/qwen/README.md b/optimized/I2I/qwen/README.md new file mode 100644 index 0000000..0ec2935 --- /dev/null +++ b/optimized/I2I/qwen/README.md @@ -0,0 +1,23 @@ +# Qwen Image 2.1 — optimized I2I + +Converts any supplied reference image into a photorealistic image of the same subject. The prompt is generic: identity, pose, clothing, accessories, colors, proportions, composition, and framing are inferred from the input rather than hard-coded. + +## Reusable inputs + +- `input.png` in node `4` — replace with the reference image. +- Node `7` positive and negative prompts — adapt the transformation without describing a specific subject. +- Node `10` seed — change for alternate results or keep fixed for comparisons. +- Nodes `5` and `14` — change the generation and output dimensions. The default is portrait 1080×1920 for person-focused images. + +## Optimization baseline + +- Model: `qwen_image_2.1_int8_convrot.safetensors` +- Sampler: Euler CFG++ +- Scheduler: beta +- Steps: 40 +- CFG: 3.5 +- Measured runtime: approximately 81 seconds on the RTX 3070 + +The workflow uses the installed Qwen Image 2.1 stack and the flattened `images.image_1` reference input required by the API workflow. + +- `workflow.json` — API-format workflow. diff --git a/optimized/I2I/qwen/workflow.json b/optimized/I2I/qwen/workflow.json new file mode 100644 index 0000000..5f30e28 --- /dev/null +++ b/optimized/I2I/qwen/workflow.json @@ -0,0 +1,17 @@ +{ + "1": {"class_type":"UNETLoader","inputs":{"unet_name":"qwen_image_2.1_int8_convrot.safetensors","weight_dtype":"default"}}, + "2": {"class_type":"CLIPLoader","inputs":{"clip_name":"qwen3vl_8b_w4a8.safetensors","type":"qwen_image","device":"default"}}, + "3": {"class_type":"VAELoader","inputs":{"vae_name":"qwen_image_2.1_vae_bf16.safetensors"}}, + "4": {"class_type":"LoadImage","inputs":{"image":"input.png"}}, + "5": {"class_type":"ResizeAndPadImage","inputs":{"image":["4",0],"target_width":576,"target_height":1024,"padding_color":"white","interpolation":"lanczos"}}, + "6": {"class_type":"QwenImage21Cache","inputs":{"model":["1",0],"device":"auto","dtype":"int8"}}, + "7": {"class_type":"TextEncodeQwenImage21","inputs":{"clip":["2",0],"prompt":"Transform the supplied reference image into a photorealistic image of the same subject. Infer identity, facial features, skin tone, hairstyle, clothing, accessories, colors, pose, body proportions, composition, and framing directly from the reference. Preserve those visual attributes faithfully while replacing the original rendering style with natural human anatomy, realistic skin and hair texture, physically accurate materials, believable fabric and surface detail, natural hands and fingers, cinematic soft light, realistic shadows, coherent perspective, premium editorial photography, high dynamic range, photorealistic, highly detailed. Do not redesign, restyle, substitute, add, remove, mirror, or crop the subject. No text or logos.","negative_prompt":"different person, changed identity, changed face, changed hairstyle, changed clothing, changed colors, altered accessories, changed pose, different composition, extra person, duplicate person, extra limbs, malformed hands, fused fingers, distorted anatomy, cropped head, cropped feet, mirrored image, cartoon, illustration, anime, CGI, plastic skin, waxy skin, blurry, low detail, text, logo, watermark","resolution":0,"images.image_1":["5",0],"vae":["3",0]}}, + "8": {"class_type":"KSamplerSelect","inputs":{"sampler_name":"euler_cfg_pp"}}, + "9": {"class_type":"BasicScheduler","inputs":{"model":["6",0],"scheduler":"beta","steps":40,"denoise":1}}, + "10": {"class_type":"RandomNoise","inputs":{"noise_seed":20260921}}, + "11": {"class_type":"CFGGuider","inputs":{"model":["6",0],"positive":["7",0],"negative":["7",1],"cfg":3.5}}, + "12": {"class_type":"SamplerCustomAdvanced","inputs":{"noise":["10",0],"guider":["11",0],"sampler":["8",0],"sigmas":["9",0],"latent_image":["7",2]}}, + "13": {"class_type":"VAEDecode","inputs":{"samples":["12",0],"vae":["3",0]}}, + "14": {"class_type":"ResizeAndPadImage","inputs":{"image":["13",0],"target_width":1080,"target_height":1920,"padding_color":"white","interpolation":"lanczos"}}, + "15": {"class_type":"SaveImage","inputs":{"images":["14",0],"filename_prefix":"fluxExperiments/imageEdit/qwen_i2i"}} +} diff --git a/optimized/MultipleRef2I/README.md b/optimized/MultipleRef2I/README.md new file mode 100644 index 0000000..70488ae --- /dev/null +++ b/optimized/MultipleRef2I/README.md @@ -0,0 +1,3 @@ +# MultipleRef2I workflows + +Use [`flux/`](flux/) for the current best multi-reference image composition workflow. It accepts a primary subject reference and an environment or scene reference. A Qwen MultipleRef2I workflow has not yet been created. diff --git a/optimized/image-edit/flux2klein-9b-multi-reference-composite/README.md b/optimized/MultipleRef2I/flux/README.md similarity index 93% rename from optimized/image-edit/flux2klein-9b-multi-reference-composite/README.md rename to optimized/MultipleRef2I/flux/README.md index b85cf33..b251bc7 100644 --- a/optimized/image-edit/flux2klein-9b-multi-reference-composite/README.md +++ b/optimized/MultipleRef2I/flux/README.md @@ -1,4 +1,4 @@ -# Flux.2 Klein 9B multi-reference composite +# Flux.2 Klein — optimized MultipleRef2I API workflow for combining two reference images with Flux.2 Klein: diff --git a/optimized/image-edit/flux2klein-9b-multi-reference-composite/workflow.json b/optimized/MultipleRef2I/flux/workflow.json similarity index 100% rename from optimized/image-edit/flux2klein-9b-multi-reference-composite/workflow.json rename to optimized/MultipleRef2I/flux/workflow.json diff --git a/optimized/README.md b/optimized/README.md index eda250d..4115309 100644 --- a/optimized/README.md +++ b/optimized/README.md @@ -1,13 +1,37 @@ # Optimized workflows -This directory contains the current tested production-oriented workflows for the available hardware. +This directory contains the best tested workflows for the available hardware. Choose the workflow type first, then choose the model implementation. -## Current baseline +## Workflow types -- **Flux.2 Klein 9B FP8** text-to-image at 1920×1080 -- Euler CFG++ sampler, 6 steps, CFG 1.3 -- Fixed seed `20260920` for repeatable baseline comparisons -- Measured generation time: approximately 78 seconds on the RTX 3070 -- Optional SeedVR2 3B FP8 second pass tested separately at 2560×1440; the full 3840×2160 target exceeded 8 GB VRAM +- [`T2I/`](T2I/) — text-to-image generation. + - [`flux/`](T2I/flux/) — Flux.2 Klein best baseline. + - [`qwen/`](T2I/qwen/) — Qwen Image 2.1 best baseline. +- [`I2I/`](I2I/) — one-reference-image transformation or editing. + - [`flux/`](I2I/flux/) — Flux.2 Klein photorealistic conversion. + - [`qwen/`](I2I/qwen/) — Qwen Image 2.1 photorealistic conversion. +- [`MultipleRef2I/`](MultipleRef2I/) — multi-reference image composition. + - [`flux/`](MultipleRef2I/flux/) — Flux.2 Klein best multi-reference workflow. + - Qwen MultipleRef2I is not yet available. -See [`text-to-image/flux2klein-9b-3070-best/`](text-to-image/flux2klein-9b-3070-best/). +## Reusable variables + +These are the values to change for a specific task: + +- Prompt and negative prompt +- Seed +- Input image or images +- Generation and output resolution + +## Optimization variables + +These are the values used to balance speed and quality: + +- Step count +- Sampler +- Scheduler +- CFG value + +The workflow files retain the tested baseline values. Each workflow README documents its model, inputs, dimensions, and measured runtime. + +The previous prompt-specific and specialized workflows are retained under [`archive/`](archive/) for reference. diff --git a/optimized/T2I/README.md b/optimized/T2I/README.md new file mode 100644 index 0000000..8e726d2 --- /dev/null +++ b/optimized/T2I/README.md @@ -0,0 +1,3 @@ +# T2I workflows + +Use [`flux/`](flux/) or [`qwen/`](qwen/) for the best tested text-to-image baseline. Prompts, seeds, and dimensions are intended to be replaced per task; sampler, scheduler, CFG, and steps are the optimization controls. diff --git a/optimized/text-to-image/flux2klein-9b-3070-best/README.md b/optimized/T2I/flux/README.md similarity index 78% rename from optimized/text-to-image/flux2klein-9b-3070-best/README.md rename to optimized/T2I/flux/README.md index ad9a3db..7f2d622 100644 --- a/optimized/text-to-image/flux2klein-9b-3070-best/README.md +++ b/optimized/T2I/flux/README.md @@ -1,4 +1,4 @@ -# Flux.2 Klein 9B — RTX 3070 best baseline +# Flux.2 Klein 9B — optimized T2I This is the current best tested Flux.2 Klein text-to-image workflow for the 8 GB RTX 3070. @@ -19,7 +19,7 @@ Files: - Seed: `20260920` - Measured generation time: approximately 78 seconds -The seed and prompt are intentionally fixed so future sampler, scheduler, step, CFG, LoRA, and second-pass experiments can be compared consistently. +The included seed and prompt are a controlled baseline example. For reuse, replace the prompt, seed, and resolution; sampler, scheduler, steps, and CFG are the optimization controls. ## Optional second pass diff --git a/optimized/text-to-image/flux2klein-9b-3070-best/ui-workflow.json b/optimized/T2I/flux/ui-workflow.json similarity index 100% rename from optimized/text-to-image/flux2klein-9b-3070-best/ui-workflow.json rename to optimized/T2I/flux/ui-workflow.json diff --git a/optimized/text-to-image/flux2klein-9b-3070-best/workflow.json b/optimized/T2I/flux/workflow.json similarity index 100% rename from optimized/text-to-image/flux2klein-9b-3070-best/workflow.json rename to optimized/T2I/flux/workflow.json diff --git a/optimized/text-to-image/qwen-image-2.1-spaceship-canteen/README.md b/optimized/T2I/qwen/README.md similarity index 59% rename from optimized/text-to-image/qwen-image-2.1-spaceship-canteen/README.md rename to optimized/T2I/qwen/README.md index eb4c361..ea24261 100644 --- a/optimized/text-to-image/qwen-image-2.1-spaceship-canteen/README.md +++ b/optimized/T2I/qwen/README.md @@ -1,6 +1,6 @@ -# Qwen Image 2.1 — spaceship canteen baseline +# Qwen Image 2.1 — optimized T2I -Qwen Image 2.1 text-to-image workflow using the same spaceship-canteen prompt as the Flux.2 Klein baseline. +Qwen Image 2.1 text-to-image workflow using the best tested sampler, scheduler, step, and CFG balance. The prompt is an editable example rather than a workflow identity. ## Settings @@ -16,9 +16,8 @@ Qwen Image 2.1 text-to-image workflow using the same spaceship-canteen prompt as - Seed: 20260920 - Warm generation time: approximately 22 seconds on the server RTX 3070 -The positive and negative prompts are intentionally identical to the Flux baseline for controlled comparison. The final crop removes the white side bands produced by padding the square Qwen output. +For reuse, replace the positive and negative prompts, seed, and output dimensions. The final crop removes the white side bands produced by padding the square Qwen output. Files: - workflow.json — API format - ui-workflow.json — ComfyUI web UI format - diff --git a/optimized/text-to-image/qwen-image-2.1-spaceship-canteen/ui-workflow.json b/optimized/T2I/qwen/ui-workflow.json similarity index 100% rename from optimized/text-to-image/qwen-image-2.1-spaceship-canteen/ui-workflow.json rename to optimized/T2I/qwen/ui-workflow.json diff --git a/optimized/text-to-image/qwen-image-2.1-spaceship-canteen/workflow.json b/optimized/T2I/qwen/workflow.json similarity index 100% rename from optimized/text-to-image/qwen-image-2.1-spaceship-canteen/workflow.json rename to optimized/T2I/qwen/workflow.json diff --git a/optimized/image-edit/flux2klein-9b-character-sheet-4view/README.md b/optimized/archive/flux-character-sheet-4view/README.md similarity index 100% rename from optimized/image-edit/flux2klein-9b-character-sheet-4view/README.md rename to optimized/archive/flux-character-sheet-4view/README.md diff --git a/optimized/image-edit/flux2klein-9b-character-sheet-4view/ui-workflow.json b/optimized/archive/flux-character-sheet-4view/ui-workflow.json similarity index 100% rename from optimized/image-edit/flux2klein-9b-character-sheet-4view/ui-workflow.json rename to optimized/archive/flux-character-sheet-4view/ui-workflow.json diff --git a/optimized/image-edit/flux2klein-9b-character-sheet-4view/workflow.json b/optimized/archive/flux-character-sheet-4view/workflow.json similarity index 100% rename from optimized/image-edit/flux2klein-9b-character-sheet-4view/workflow.json rename to optimized/archive/flux-character-sheet-4view/workflow.json diff --git a/optimized/text-to-image/flux2klein-9b-portrait/README.md b/optimized/archive/flux-portrait/README.md similarity index 100% rename from optimized/text-to-image/flux2klein-9b-portrait/README.md rename to optimized/archive/flux-portrait/README.md diff --git a/optimized/text-to-image/flux2klein-9b-portrait/workflow.json b/optimized/archive/flux-portrait/workflow.json similarity index 100% rename from optimized/text-to-image/flux2klein-9b-portrait/workflow.json rename to optimized/archive/flux-portrait/workflow.json diff --git a/optimized/text-to-image/qwen-image-2.1-character-sheet/README.md b/optimized/archive/qwen-character-sheet-t2i/README.md similarity index 100% rename from optimized/text-to-image/qwen-image-2.1-character-sheet/README.md rename to optimized/archive/qwen-character-sheet-t2i/README.md diff --git a/optimized/text-to-image/qwen-image-2.1-character-sheet/ui-workflow.json b/optimized/archive/qwen-character-sheet-t2i/ui-workflow.json similarity index 100% rename from optimized/text-to-image/qwen-image-2.1-character-sheet/ui-workflow.json rename to optimized/archive/qwen-character-sheet-t2i/ui-workflow.json diff --git a/optimized/text-to-image/qwen-image-2.1-character-sheet/workflow.json b/optimized/archive/qwen-character-sheet-t2i/workflow.json similarity index 100% rename from optimized/text-to-image/qwen-image-2.1-character-sheet/workflow.json rename to optimized/archive/qwen-character-sheet-t2i/workflow.json diff --git a/optimized/image-edit/qwen-image-2.1-character-sheet/README.md b/optimized/archive/qwen-character-sheet/README.md similarity index 100% rename from optimized/image-edit/qwen-image-2.1-character-sheet/README.md rename to optimized/archive/qwen-character-sheet/README.md diff --git a/optimized/image-edit/qwen-image-2.1-character-sheet/ui-workflow.json b/optimized/archive/qwen-character-sheet/ui-workflow.json similarity index 100% rename from optimized/image-edit/qwen-image-2.1-character-sheet/ui-workflow.json rename to optimized/archive/qwen-character-sheet/ui-workflow.json diff --git a/optimized/image-edit/qwen-image-2.1-character-sheet/workflow.json b/optimized/archive/qwen-character-sheet/workflow.json similarity index 100% rename from optimized/image-edit/qwen-image-2.1-character-sheet/workflow.json rename to optimized/archive/qwen-character-sheet/workflow.json diff --git a/optimized/image-edit/README.md b/optimized/image-edit/README.md deleted file mode 100644 index 11fe93f..0000000 --- a/optimized/image-edit/README.md +++ /dev/null @@ -1,3 +0,0 @@ -# Image-edit workflows - -The current image-edit baseline is the Flux.2 Klein photorealistic character conversion workflow. diff --git a/optimized/text-to-image/README.md b/optimized/text-to-image/README.md deleted file mode 100644 index 4122ff5..0000000 --- a/optimized/text-to-image/README.md +++ /dev/null @@ -1,3 +0,0 @@ -# Text-to-image - -The optimized text-to-image collection currently focuses on the tested Flux.2 Klein baseline.