diff --git a/models/minimax/minimax-h3-extender-ref2va/README.md b/models/minimax/minimax-h3-extender-ref2va/README.md index 25c2af1..d59a219 100644 --- a/models/minimax/minimax-h3-extender-ref2va/README.md +++ b/models/minimax/minimax-h3-extender-ref2va/README.md @@ -57,5 +57,6 @@ validated clip-by-clip reuse, and final joined video/audio decode. ## Notes - Use this when you want the upstream extender logic itself. -- For the tighter local-first variant, use the optimized companion workflow in - `optimized/image-to-video/minimax-h3-extender-3070-r2v-480p-clip-by-clip/`. +- For the maintained optimized lanes, use: + - `optimized/image-to-video/minimax-h3-best-current-r2v-master-480p-3x10s/` + - `optimized/image-to-video/minimax-h3-contex-loop-3070-safe-60s-awq-int8/` diff --git a/optimized/README.md b/optimized/README.md index 27f2c91..6c008a9 100644 --- a/optimized/README.md +++ b/optimized/README.md @@ -8,6 +8,14 @@ The `optimized/` tree stores the cleaned-up workflows built from analyzing what The `optimized/notes/` tree stores accumulated optimization notes so future review passes can reuse prior judgments instead of re-reading every collected workflow from scratch. +## Maintenance rule + +Keep the `optimized/` lane deliberately small. + +- Each category should usually expose one maintained default. +- A category may keep a second maintained challenger or specialist path when it serves a distinct job. +- Historical experiments, stepping stones, and source imports belong in `models/` or `custom/`, not as long-lived `optimized/` masters. + ## Purpose These workflows are intended to become the practical default choices for each category after comparing: @@ -26,13 +34,13 @@ These workflows are intended to become the practical default choices for each ca - `text-to-video/` - `upscale-restoration/` -## Current best-current masters +## Current maintained masters - `text-to-image/zimage-turbo-3070-fast-start/` -- `image-edit/zimage-turbo-3070-inpaint-start/` - `image-edit/flux2klein-9b-fp8-edit-master/` -- `image-to-video/ltx23-3070-simple-master/` -- `image-to-video/minimax-h3-3070-single-10s-1152x640-r2v-master/` +- `image-edit/zimage-turbo-3070-inpaint-start/` +- `image-to-video/minimax-h3-best-current-r2v-master-480p-3x10s/` +- `image-to-video/minimax-h3-contex-loop-3070-safe-60s-awq-int8/` - `text-to-video/minimax-h3-3070-turbo-master/` ## Workflow format diff --git a/optimized/image-edit/README.md b/optimized/image-edit/README.md index 0fe397e..2231396 100644 --- a/optimized/image-edit/README.md +++ b/optimized/image-edit/README.md @@ -2,10 +2,19 @@ Home for maintained category masters focused on image editing, inpainting, outpainting, and reference-driven edits. +This category may keep up to two maintained workflows: one default winner and one specialist or challenger. + ## Current masters -- `zimage-turbo-3070-inpaint-start` - `flux2klein-9b-fp8-edit-master` +- `zimage-turbo-3070-inpaint-start` + +## Roles + +- `flux2klein-9b-fp8-edit-master` + Current default edit master and present benchmark winner for Chris's setup. +- `zimage-turbo-3070-inpaint-start` + Secondary inpaint-focused challenger kept for comparison and niche masked-edit work. ## README rule diff --git a/optimized/image-to-video/README.md b/optimized/image-to-video/README.md index 83b8722..85a8559 100644 --- a/optimized/image-to-video/README.md +++ b/optimized/image-to-video/README.md @@ -2,11 +2,19 @@ Home for maintained category masters focused on image-to-video generation. -## Current masters +This category is intentionally capped at two maintained workflows: -- `ltx23-3070-simple-master` -- `minimax-h3-3070-single-10s-1152x640-r2v-master` - `minimax-h3-best-current-r2v-master-480p-3x10s` -- `minimax-h3-contex-loop-3070-compact-30s` -- `minimax-h3-contex-loop-3070-compact-prepend-480p-3x10s` -- `minimax-h3-extender-3070-r2v-480p-60s-clip-by-clip` +- `minimax-h3-contex-loop-3070-safe-60s-awq-int8` + +## Roles + +- `minimax-h3-best-current-r2v-master-480p-3x10s` + The current reference-first generation master when the job starts from still images and should grow into connected clips. +- `minimax-h3-contex-loop-3070-safe-60s-awq-int8` + The current extension master when the job starts from an existing video clip and should continue through the `Contex Loop` lane. + +## Policy + +- If a workflow is only a stepping stone, benchmark, or dead-end experiment, move it out of `optimized/`. +- New `image-to-video` work should improve one of these two lanes rather than creating another maintained sibling by default. diff --git a/optimized/image-to-video/ltx23-3070-simple-master/README.md b/optimized/image-to-video/ltx23-3070-simple-master/README.md deleted file mode 100644 index 03021d3..0000000 --- a/optimized/image-to-video/ltx23-3070-simple-master/README.md +++ /dev/null @@ -1,56 +0,0 @@ -# LTX 2.3 3070 Simple Master - -## Summary - -Best current `LTX 2.3` low-complexity starter for local video work. - -This master uses the simple single-pass workflow instead of the more ambitious first-last-frame or character-sheet variants because your `3070` needs a realistic first foothold, not the fanciest graph on paper. - -## Status - -- `best-current` -- `not-yet-tested-on-chris-box` - -## Workflow asset - -- `workflow.json` - -## Built from - -- `models/ltx/ltx23-i2v-t2v-simple-single-pass/` - -## Why this is the current master - -- Most plausible `LTX` starting point on tighter VRAM -- Simpler graph means less time chasing broken helper nodes -- Supports both `image-to-video` and `text-to-video` style experimentation from one baseline - -## What I intentionally kept - -- single-pass graph shape -- split-model assumption from the source pack -- lighter starting complexity than the bigger RuneXX graphs - -## What I intentionally did not add yet - -- first-last-frame complexity -- character-sheet consistency branches -- extra memory-efficiency gadgets unless needed - -## Required custom nodes - -- `ComfyUI-KJNodes` -- `rgthree-comfy` -- `easy use` / `easy showAnything` -- optional `ComfyUI-GGUF` support remains present in the source graph - -## Monday test checklist - -- Confirm whether it loads at all on the `3070`. -- Check whether preview/decode settings feel like the real bottleneck. -- If it works, then try the heavier first-last-frame workflow second. - -## Next optimization candidates - -- strip unused optional loader paths if they create confusion -- create a separate `first-last-frame` master only if the simple master proves viable diff --git a/optimized/image-to-video/ltx23-3070-simple-master/workflow.json b/optimized/image-to-video/ltx23-3070-simple-master/workflow.json deleted file mode 100644 index c9917de..0000000 --- a/optimized/image-to-video/ltx23-3070-simple-master/workflow.json +++ /dev/null @@ -1,5125 +0,0 @@ -{ - "id": "d15f72da-ab9c-490d-9386-b750d889c6f8", - "revision": 0, - "last_node_id": 362, - "last_link_id": 646, - "nodes": [ - { - "id": 218, - "type": "GetNode", - "pos": [ - -129.42226803816817, - 4196.461349362681 - ], - "size": [ - 270, - 58 - ], - "flags": { - "collapsed": true - }, - "order": 0, - "mode": 0, - "inputs": [], - "outputs": [ - { - "name": "VAE", - "type": "VAE", - "links": [ - 445 - ] - } - ], - "title": "Get_vae", - "properties": {}, - "widgets_values": [ - "vae" - ], - "color": "#af3535", - "bgcolor": "rgba(24,24,27,.9)" - }, - { - "id": 220, - "type": "GetNode", - "pos": [ - 915.2389825960021, - 3884.950284193325 - ], - "size": [ - 257.2388542190106, - 60 - ], - "flags": { - "collapsed": true - }, - "order": 1, - "mode": 0, - "inputs": [], - "outputs": [ - { - "name": "VAE", - "type": "VAE", - "links": [ - 449 - ] - } - ], - "title": "Get_vae", - "properties": {}, - "widgets_values": [ - "vae" - ], - "color": "#af3535", - "bgcolor": "rgba(24,24,27,.9)" - }, - { - "id": 238, - "type": "SetNode", - "pos": [ - -129.42226803816817, - 4381.5762979179335 - ], - "size": [ - 270, - 60 - ], - "flags": { - "collapsed": true - }, - "order": 91, - "mode": 0, - "inputs": [ - { - "name": "LATENT", - "type": "LATENT", - "link": 465 - } - ], - "outputs": [ - { - "name": "*", - "type": "*", - "links": null - } - ], - "title": "Set_latent", - "properties": { - "previousName": "latent" - }, - "widgets_values": [ - "latent" - ], - "color": "#422342", - "bgcolor": "rgba(24,24,27,.9)" - }, - { - "id": 205, - "type": "GetNode", - "pos": [ - -129.42226803816817, - 3791.4450915646084 - ], - "size": [ - 270, - 60 - ], - "flags": { - "collapsed": true - }, - "order": 2, - "mode": 0, - "inputs": [], - "outputs": [ - { - "name": "INT", - "type": "INT", - "links": [ - 424, - 425 - ] - } - ], - "title": "Get_frames", - "properties": {}, - "widgets_values": [ - "frames" - ], - "color": "#1b4669", - "bgcolor": "#29699c" - }, - { - "id": 211, - "type": "SetNode", - "pos": [ - -129.42226803816817, - 3664.535246780658 - ], - "size": [ - 270, - 60 - ], - "flags": { - "collapsed": true - }, - "order": 77, - "mode": 0, - "inputs": [ - { - "name": "IMAGE", - "type": "IMAGE", - "link": 437 - } - ], - "outputs": [ - { - "name": "*", - "type": "*", - "links": null - } - ], - "title": "Set_compress_image", - "properties": { - "previousName": "compress_image" - }, - "widgets_values": [ - "compress_image" - ], - "color": "#006691", - "bgcolor": "rgba(24,24,27,.9)" - }, - { - "id": 282, - "type": "SetNode", - "pos": [ - -1264.5623087594242, - 4836.883066753237 - ], - "size": [ - 210, - 34 - ], - "flags": { - "collapsed": true - }, - "order": 69, - "mode": 0, - "inputs": [ - { - "name": "INT", - "type": "INT", - "link": 528 - } - ], - "outputs": [ - { - "name": "*", - "type": "*", - "links": null - } - ], - "title": "Set_height", - "properties": { - "previousName": "" - }, - "widgets_values": [ - "height" - ], - "color": "#1b4669", - "bgcolor": "#29699c" - }, - { - "id": 283, - "type": "SetNode", - "pos": [ - -1497.6848116215458, - 4845.43525128396 - ], - "size": [ - 210, - 34 - ], - "flags": { - "collapsed": true - }, - "order": 68, - "mode": 0, - "inputs": [ - { - "name": "INT", - "type": "INT", - "link": 529 - } - ], - "outputs": [ - { - "name": "*", - "type": "*", - "links": null - } - ], - "title": "Set_width", - "properties": { - "previousName": "" - }, - "widgets_values": [ - "width" - ], - "color": "#1b4669", - "bgcolor": "#29699c" - }, - { - "id": 284, - "type": "SetNode", - "pos": [ - -805.9064006334132, - 4832.406732533761 - ], - "size": [ - 210, - 34 - ], - "flags": { - "collapsed": true - }, - "order": 51, - "mode": 0, - "inputs": [ - { - "name": "FLOAT", - "type": "FLOAT", - "link": 530 - } - ], - "outputs": [ - { - "name": "*", - "type": "*", - "links": null - } - ], - "title": "Set_fps", - "properties": { - "previousName": "" - }, - "widgets_values": [ - "fps" - ], - "color": "#346434", - "bgcolor": "rgba(24,24,27,.9)" - }, - { - "id": 285, - "type": "PrimitiveFloat", - "pos": [ - -828.4853578355645, - 4820.213753539184 - ], - "size": [ - 210, - 61.42105412153796 - ], - "flags": {}, - "order": 3, - "mode": 0, - "inputs": [], - "outputs": [ - { - "name": "FLOAT", - "type": "FLOAT", - "links": [ - 530, - 533 - ] - } - ], - "title": "FPS", - "properties": { - "cnr_id": "comfy-core", - "ver": "0.10.0", - "Node name for S&R": "PrimitiveFloat" - }, - "widgets_values": [ - 24 - ], - "color": "#006691", - "bgcolor": "rgba(24,24,27,.9)" - }, - { - "id": 286, - "type": "SetNode", - "pos": [ - -1027.0002583727967, - 4846.272118953432 - ], - "size": [ - 210, - 34 - ], - "flags": { - "collapsed": true - }, - "order": 71, - "mode": 0, - "inputs": [ - { - "name": "INT", - "type": "INT", - "link": 531 - } - ], - "outputs": [ - { - "name": "*", - "type": "*", - "links": null - } - ], - "title": "Set_frames", - "properties": { - "previousName": "" - }, - "widgets_values": [ - "frames" - ], - "color": "#1b4669", - "bgcolor": "#29699c" - }, - { - "id": 288, - "type": "SetNode", - "pos": [ - -435.5618508508995, - 4845.537109583825 - ], - "size": [ - 210, - 34 - ], - "flags": { - "collapsed": true - }, - "order": 63, - "mode": 0, - "inputs": [ - { - "name": "BOOLEAN", - "type": "BOOLEAN", - "link": 534 - } - ], - "outputs": [ - { - "name": "*", - "type": "*", - "links": null - } - ], - "title": "Set_t2v_mode", - "properties": { - "previousName": "" - }, - "widgets_values": [ - "t2v_mode" - ] - }, - { - "id": 221, - "type": "GetNode", - "pos": [ - 915.2389825960021, - 3983.089108499493 - ], - "size": [ - 257.2388542190106, - 58 - ], - "flags": { - "collapsed": true - }, - "order": 4, - "mode": 0, - "inputs": [], - "outputs": [ - { - "name": "VAE", - "type": "VAE", - "links": [ - 448 - ] - } - ], - "title": "Get_vae_audio", - "properties": {}, - "widgets_values": [ - "vae_audio" - ], - "color": "#af3535", - "bgcolor": "rgba(24,24,27,.9)" - }, - { - "id": 127, - "type": "VAEDecodeTiled", - "pos": [ - 915.2389825960021, - 3748.220700653191 - ], - "size": [ - 257.2388542190106, - 150 - ], - "flags": {}, - "order": 87, - "mode": 0, - "inputs": [ - { - "name": "samples", - "type": "LATENT", - "link": 302 - }, - { - "name": "vae", - "type": "VAE", - "link": 449 - } - ], - "outputs": [ - { - "name": "IMAGE", - "type": "IMAGE", - "links": [ - 313 - ] - } - ], - "properties": { - "cnr_id": "comfy-core", - "ver": "0.7.0", - "Node name for S&R": "VAEDecodeTiled", - "enableTabs": false, - "tabWidth": 65, - "tabXOffset": 10, - "hasSecondTab": false, - "secondTabText": "Send Back", - "secondTabOffset": 80, - "secondTabWidth": 65 - }, - "widgets_values": [ - 512, - 64, - 4096, - 8 - ] - }, - { - "id": 307, - "type": "GetNode", - "pos": [ - 1511.2452407931055, - 3592.0678473903613 - ], - "size": [ - 210, - 60 - ], - "flags": { - "collapsed": true - }, - "order": 5, - "mode": 0, - "inputs": [], - "outputs": [ - { - "name": "FLOAT", - "type": "FLOAT", - "links": [ - 561 - ] - } - ], - "title": "Get_fps", - "properties": {}, - "widgets_values": [ - "fps" - ] - }, - { - "id": 308, - "type": "GetNode", - "pos": [ - -129.42226803816817, - 4196.832409347547 - ], - "size": [ - 270, - 60 - ], - "flags": { - "collapsed": true - }, - "order": 6, - "mode": 0, - "inputs": [], - "outputs": [ - { - "name": "BOOLEAN", - "type": "BOOLEAN", - "links": [ - 563 - ] - } - ], - "title": "Get_t2v_mode", - "properties": {}, - "widgets_values": [ - "t2v_mode" - ] - }, - { - "id": 311, - "type": "SimpleCalculatorKJ", - "pos": [ - -129.42226803816817, - 4069.5171292630694 - ], - "size": [ - 270, - 128 - ], - "flags": { - "collapsed": true - }, - "order": 52, - "mode": 0, - "inputs": [ - { - "label": "a", - "name": "variables.a", - "shape": 7, - "type": "INT,FLOAT,BOOLEAN", - "link": 565 - }, - { - "label": "b", - "name": "variables.b", - "shape": 7, - "type": "INT,FLOAT,BOOLEAN", - "link": null - } - ], - "outputs": [ - { - "name": "FLOAT", - "type": "FLOAT", - "links": null - }, - { - "name": "INT", - "type": "INT", - "links": [ - 566 - ] - }, - { - "name": "BOOLEAN", - "type": "BOOLEAN", - "links": null - } - ], - "properties": { - "cnr_id": "comfyui-kjnodes", - "ver": "debc47061f722e93fc9885c19facefcf59b6426a", - "Node name for S&R": "SimpleCalculatorKJ" - }, - "widgets_values": [ - "a" - ] - }, - { - "id": 310, - "type": "GetNode", - "pos": [ - -129.42226803816817, - 4056.9732641507644 - ], - "size": [ - 270, - 60 - ], - "flags": { - "collapsed": true - }, - "order": 7, - "mode": 0, - "inputs": [], - "outputs": [ - { - "name": "FLOAT", - "type": "FLOAT", - "links": [ - 565 - ] - } - ], - "title": "Get_fps", - "properties": {}, - "widgets_values": [ - "fps" - ] - }, - { - "id": 217, - "type": "GetNode", - "pos": [ - -129.42226803816817, - 3998.3671211422625 - ], - "size": [ - 270, - 60 - ], - "flags": { - "collapsed": true - }, - "order": 8, - "mode": 0, - "inputs": [], - "outputs": [ - { - "name": "VAE", - "type": "VAE", - "links": [ - 444 - ] - } - ], - "title": "Get_vae_audio", - "properties": {}, - "widgets_values": [ - "vae_audio" - ], - "color": "#af3535", - "bgcolor": "rgba(24,24,27,.9)" - }, - { - "id": 240, - "type": "SetNode", - "pos": [ - -129.42226803816817, - 4040.939445629616 - ], - "size": [ - 270, - 50 - ], - "flags": { - "collapsed": true - }, - "order": 79, - "mode": 0, - "inputs": [ - { - "name": "LATENT", - "type": "LATENT", - "link": 468 - } - ], - "outputs": [ - { - "name": "*", - "type": "*", - "links": null - } - ], - "title": "Set_latent_audio", - "properties": { - "previousName": "latent_audio" - }, - "widgets_values": [ - "latent_audio" - ], - "color": "#422342", - "bgcolor": "rgba(24,24,27,.9)" - }, - { - "id": 246, - "type": "ResizeImagesByLongerEdge", - "pos": [ - -1019.8779975664972, - 4367.062194105972 - ], - "size": [ - 243.6109375, - 58 - ], - "flags": { - "collapsed": true - }, - "order": 73, - "mode": 0, - "inputs": [ - { - "name": "images", - "type": "IMAGE", - "link": 479 - } - ], - "outputs": [ - { - "name": "images", - "type": "IMAGE", - "links": [ - 481 - ] - } - ], - "properties": { - "cnr_id": "comfy-core", - "ver": "0.5.1", - "Node name for S&R": "ResizeImagesByLongerEdge" - }, - "widgets_values": [ - 1536 - ] - }, - { - "id": 209, - "type": "SetNode", - "pos": [ - -988.9868935432019, - 4405.663635518321 - ], - "size": [ - 210, - 60 - ], - "flags": { - "collapsed": true - }, - "order": 81, - "mode": 0, - "inputs": [ - { - "name": "IMAGE", - "type": "IMAGE", - "link": 481 - } - ], - "outputs": [ - { - "name": "*", - "type": "*", - "links": null - } - ], - "title": "Set_ref_image", - "properties": { - "previousName": "ref_image" - }, - "widgets_values": [ - "ref_image" - ], - "color": "#006691", - "bgcolor": "rgba(24,24,27,.9)" - }, - { - "id": 244, - "type": "GetNode", - "pos": [ - -972.1177033180707, - 4319.307329996706 - ], - "size": [ - 210, - 58 - ], - "flags": { - "collapsed": true - }, - "order": 9, - "mode": 0, - "inputs": [], - "outputs": [ - { - "name": "INT", - "type": "INT", - "links": [ - 473 - ] - } - ], - "title": "Get_height", - "properties": {}, - "widgets_values": [ - "height" - ], - "color": "#1b4669", - "bgcolor": "#29699c" - }, - { - "id": 243, - "type": "GetNode", - "pos": [ - -978.287871495176, - 4269.931119158377 - ], - "size": [ - 210, - 60 - ], - "flags": { - "collapsed": true - }, - "order": 10, - "mode": 0, - "inputs": [], - "outputs": [ - { - "name": "INT", - "type": "INT", - "links": [ - 472 - ] - } - ], - "title": "Get_width", - "properties": {}, - "widgets_values": [ - "width" - ], - "color": "#1b4669", - "bgcolor": "#29699c" - }, - { - "id": 216, - "type": "SetNode", - "pos": [ - -1526.9793006711818, - 4450.867361500014 - ], - "size": [ - 364.0273046899474, - 60 - ], - "flags": { - "collapsed": true - }, - "order": 54, - "mode": 0, - "inputs": [ - { - "name": "VAE", - "type": "VAE", - "link": 443 - } - ], - "outputs": [ - { - "name": "*", - "type": "*", - "links": null - } - ], - "title": "Set_vae_audio", - "properties": { - "previousName": "vae_audio" - }, - "widgets_values": [ - "vae_audio" - ], - "color": "#af3535", - "bgcolor": "rgba(24,24,27,.9)" - }, - { - "id": 215, - "type": "SetNode", - "pos": [ - -1526.9793006711818, - 4315.372884625767 - ], - "size": [ - 364.0273046899474, - 60 - ], - "flags": { - "collapsed": true - }, - "order": 56, - "mode": 0, - "inputs": [ - { - "name": "VAE", - "type": "VAE", - "link": 442 - } - ], - "outputs": [ - { - "name": "*", - "type": "*", - "links": null - } - ], - "title": "Set_vae", - "properties": { - "previousName": "vae" - }, - "widgets_values": [ - "vae" - ], - "color": "#af3535", - "bgcolor": "rgba(24,24,27,.9)" - }, - { - "id": 213, - "type": "SetNode", - "pos": [ - -1526.9793006711818, - 4110.260657658327 - ], - "size": [ - 364.0273046899474, - 60 - ], - "flags": { - "collapsed": true - }, - "order": 64, - "mode": 0, - "inputs": [ - { - "name": "CLIP", - "type": "CLIP", - "link": 550 - } - ], - "outputs": [ - { - "name": "*", - "type": "*", - "links": null - } - ], - "title": "Set_clip", - "properties": { - "previousName": "clip" - }, - "widgets_values": [ - "clip" - ], - "color": "#c09430", - "bgcolor": "rgba(24,24,27,.9)" - }, - { - "id": 225, - "type": "GetNode", - "pos": [ - 237.99144812298735, - 3813.700211629916 - ], - "size": [ - 271.305509971064, - 58 - ], - "flags": { - "collapsed": true - }, - "order": 11, - "mode": 0, - "inputs": [], - "outputs": [ - { - "name": "MODEL", - "type": "MODEL", - "links": [] - } - ], - "title": "Get_model", - "properties": {}, - "widgets_values": [ - "model" - ], - "color": "#1f1f48", - "bgcolor": "rgba(24,24,27,.9)" - }, - { - "id": 231, - "type": "GetNode", - "pos": [ - 237.99144812298735, - 3808.091183626127 - ], - "size": [ - 271.305509971064, - 58 - ], - "flags": { - "collapsed": true - }, - "order": 12, - "mode": 0, - "inputs": [], - "outputs": [ - { - "name": "CONDITIONING", - "type": "CONDITIONING", - "links": [ - 459 - ] - } - ], - "title": "Get_negative", - "properties": {}, - "widgets_values": [ - "negative" - ], - "color": "#38291f", - "bgcolor": "rgba(24,24,27,.9)" - }, - { - "id": 230, - "type": "GetNode", - "pos": [ - 237.99144812298735, - 3808.3496174952584 - ], - "size": [ - 271.305509971064, - 60 - ], - "flags": { - "collapsed": true - }, - "order": 13, - "mode": 0, - "inputs": [], - "outputs": [ - { - "name": "CONDITIONING", - "type": "CONDITIONING", - "links": [ - 460 - ] - } - ], - "title": "Get_positive", - "properties": {}, - "widgets_values": [ - "positive" - ], - "color": "#38291f", - "bgcolor": "rgba(24,24,27,.9)" - }, - { - "id": 199, - "type": "LTXVEmptyLatentAudio", - "pos": [ - -129.42226803816817, - 3972.336880680874 - ], - "size": [ - 270, - 120 - ], - "flags": {}, - "order": 70, - "mode": 0, - "inputs": [ - { - "name": "audio_vae", - "type": "VAE", - "link": 444 - }, - { - "name": "frames_number", - "type": "INT", - "widget": { - "name": "frames_number" - }, - "link": 425 - }, - { - "name": "frame_rate", - "type": "INT", - "widget": { - "name": "frame_rate" - }, - "link": 566 - } - ], - "outputs": [ - { - "name": "Latent", - "type": "LATENT", - "links": [ - 412, - 468 - ] - } - ], - "properties": { - "cnr_id": "comfy-core", - "ver": "0.3.68", - "Node name for S&R": "LTXVEmptyLatentAudio", - "enableTabs": false, - "tabWidth": 65, - "tabXOffset": 10, - "hasSecondTab": false, - "secondTabText": "Send Back", - "secondTabOffset": 80, - "secondTabWidth": 65 - }, - "widgets_values": [ - 121, - 24, - 1 - ] - }, - { - "id": 201, - "type": "LTXVAudioVAEDecode", - "pos": [ - 915.2389825960021, - 3962.66159945768 - ], - "size": [ - 257.2388542190106, - 46 - ], - "flags": {}, - "order": 88, - "mode": 0, - "inputs": [ - { - "name": "samples", - "type": "LATENT", - "link": 430 - }, - { - "label": "Audio VAE", - "name": "audio_vae", - "type": "VAE", - "link": 448 - } - ], - "outputs": [ - { - "name": "Audio", - "type": "AUDIO", - "links": [ - 416 - ] - } - ], - "properties": { - "cnr_id": "comfy-core", - "ver": "0.7.0", - "Node name for S&R": "LTXVAudioVAEDecode", - "enableTabs": false, - "tabWidth": 65, - "tabXOffset": 10, - "hasSecondTab": false, - "secondTabText": "Send Back", - "secondTabOffset": 80, - "secondTabWidth": 65 - }, - "widgets_values": [] - }, - { - "id": 287, - "type": "SimpleCalculatorKJ", - "pos": [ - -1067.9490631055062, - 4848.515349256717 - ], - "size": [ - 210, - 136 - ], - "flags": { - "collapsed": true - }, - "order": 53, - "mode": 0, - "inputs": [ - { - "label": "a", - "name": "variables.a", - "shape": 7, - "type": "INT,FLOAT,BOOLEAN", - "link": null - }, - { - "label": "b", - "name": "variables.b", - "shape": 7, - "type": "INT,FLOAT,BOOLEAN", - "link": null - }, - { - "name": "a", - "shape": 7, - "type": "*", - "link": 532 - }, - { - "name": "b", - "shape": 7, - "type": "*", - "link": 533 - } - ], - "outputs": [ - { - "name": "FLOAT", - "type": "FLOAT", - "links": [] - }, - { - "name": "INT", - "type": "INT", - "links": [ - 531 - ] - }, - { - "name": "BOOLEAN", - "type": "BOOLEAN", - "links": null - } - ], - "properties": { - "cnr_id": "comfyui-kjnodes", - "ver": "17cddd4959f00182c66954be2a7a32a6481d81be", - "Node name for S&R": "SimpleCalculatorKJ" - }, - "widgets_values": [ - "1+ 8*(round(a*b)/8)" - ], - "color": "#006691", - "bgcolor": "rgba(24,24,27,.9)" - }, - { - "id": 291, - "type": "INTConstant", - "pos": [ - -1076.6131465721123, - 4821.5606676345205 - ], - "size": [ - 210, - 58 - ], - "flags": {}, - "order": 14, - "mode": 0, - "inputs": [], - "outputs": [ - { - "name": "value", - "type": "INT", - "links": [ - 532 - ] - } - ], - "title": "LENGTH (in seconds)", - "properties": { - "cnr_id": "comfyui-kjnodes", - "ver": "c6ce76d00bb8177d1b0286cad891df08eff5226e", - "Node name for S&R": "INTConstant" - }, - "widgets_values": [ - 10 - ], - "color": "#006691", - "bgcolor": "rgba(24,24,27,.9)" - }, - { - "id": 306, - "type": "GetNode", - "pos": [ - 237.99144812298735, - 3857.405377510338 - ], - "size": [ - 271.305509971064, - 60 - ], - "flags": { - "collapsed": true - }, - "order": 15, - "mode": 0, - "inputs": [], - "outputs": [ - { - "name": "MODEL", - "type": "MODEL", - "links": [] - } - ], - "title": "Get_model_with_lora", - "properties": {}, - "widgets_values": [ - "model_with_lora" - ] - }, - { - "id": 196, - "type": "VAELoaderKJ", - "pos": [ - -1526.9793006711818, - 4400.414846566154 - ], - "size": [ - 364.0273046899474, - 110.28381432699462 - ], - "flags": {}, - "order": 16, - "mode": 0, - "inputs": [], - "outputs": [ - { - "name": "VAE", - "type": "VAE", - "links": [ - 443 - ] - } - ], - "title": "VAELoader KJ (audio VAE)", - "properties": { - "cnr_id": "comfyui-kjnodes", - "ver": "487c7d86a0230aae3d8c0a37d517159b73834f85", - "Node name for S&R": "VAELoaderKJ" - }, - "widgets_values": [ - "LTX23_audio_vae_bf16_KJ.safetensors", - "main_device", - "bf16" - ], - "color": "#1f1f48", - "bgcolor": "rgba(24,24,27,.9)", - "ndSuperSelectorEnabled": false, - "ndPowerEnabled": false - }, - { - "id": 331, - "type": "SetNode", - "pos": [ - -1526.9793006711818, - 4613.193006910724 - ], - "size": [ - 364.0273046899474, - 60 - ], - "flags": { - "collapsed": true - }, - "order": 55, - "mode": 0, - "inputs": [ - { - "name": "VAE", - "type": "VAE", - "link": 611 - } - ], - "outputs": [ - { - "name": "*", - "type": "*", - "links": null - } - ], - "title": "Set_vae_tiny", - "properties": { - "previousName": "vae_tiny" - }, - "widgets_values": [ - "vae_tiny" - ] - }, - { - "id": 289, - "type": "MarkdownNote", - "pos": [ - -1948.4909647025866, - 4794.389327529134 - ], - "size": [ - 291.99631835798823, - 102.45137621179947 - ], - "flags": { - "collapsed": false - }, - "order": 17, - "mode": 0, - "inputs": [], - "outputs": [], - "title": "Video settings", - "properties": {}, - "widgets_values": [ - "If low on Ram/Vram, try width height to 832 x 480 or 960 x 544. If you can, run at 1280 x 720 or higher.\n\n\nLength in seconds : try 5, 10 or 20. \nfps : 24 or 25 (or 48 or 50 if your pc can run it)" - ], - "color": "#222", - "bgcolor": "#000" - }, - { - "id": 330, - "type": "VAELoader", - "pos": [ - -1526.9793006711818, - 4565.2982492091905 - ], - "size": [ - 364.0273046899474, - 58 - ], - "flags": {}, - "order": 18, - "mode": 0, - "inputs": [], - "outputs": [ - { - "name": "VAE", - "type": "VAE", - "links": [ - 611 - ] - } - ], - "title": "Tiny VAE (for sampler previews)", - "properties": { - "cnr_id": "comfy-core", - "ver": "0.16.3", - "Node name for S&R": "VAELoader" - }, - "widgets_values": [ - "taeltx2_3.safetensors" - ], - "color": "#1f1f48", - "bgcolor": "rgba(24,24,27,.9)", - "ndSuperSelectorEnabled": false, - "ndPowerEnabled": false - }, - { - "id": 184, - "type": "VAELoader", - "pos": [ - -1526.9793006711818, - 4287.833587437025 - ], - "size": [ - 364.0273046899474, - 61.42705146159551 - ], - "flags": {}, - "order": 19, - "mode": 0, - "inputs": [], - "outputs": [ - { - "name": "VAE", - "type": "VAE", - "links": [ - 442 - ] - } - ], - "title": "Load VAE (video VAE)", - "properties": { - "cnr_id": "comfy-core", - "ver": "0.8.2", - "Node name for S&R": "VAELoader" - }, - "widgets_values": [ - "LTX23_video_vae_bf16.safetensors" - ], - "color": "#1f1f48", - "bgcolor": "rgba(24,24,27,.9)", - "ndSuperSelectorEnabled": false, - "ndPowerEnabled": false - }, - { - "id": 109, - "type": "LTXVConcatAVLatent", - "pos": [ - -129.42226803816817, - 4334.352245641956 - ], - "size": [ - 270, - 46 - ], - "flags": {}, - "order": 86, - "mode": 0, - "inputs": [ - { - "name": "video_latent", - "type": "LATENT", - "link": 363 - }, - { - "name": "audio_latent", - "type": "LATENT", - "link": 412 - } - ], - "outputs": [ - { - "name": "latent", - "type": "LATENT", - "links": [ - 465 - ] - } - ], - "properties": { - "cnr_id": "comfy-core", - "ver": "0.7.0", - "Node name for S&R": "LTXVConcatAVLatent", - "enableTabs": false, - "tabWidth": 65, - "tabXOffset": 10, - "hasSecondTab": false, - "secondTabText": "Send Back", - "secondTabOffset": 80, - "secondTabWidth": 65 - }, - "widgets_values": [] - }, - { - "id": 125, - "type": "LTXVSeparateAVLatent", - "pos": [ - 915.2389825960021, - 3634.839483651904 - ], - "size": [ - 257.2388542190106, - 46 - ], - "flags": {}, - "order": 80, - "mode": 0, - "inputs": [ - { - "name": "av_latent", - "type": "LATENT", - "link": 644 - } - ], - "outputs": [ - { - "name": "video_latent", - "type": "LATENT", - "links": [ - 302 - ] - }, - { - "name": "audio_latent", - "type": "LATENT", - "links": [ - 430 - ] - } - ], - "properties": { - "cnr_id": "comfy-core", - "ver": "0.5.1", - "Node name for S&R": "LTXVSeparateAVLatent", - "enableTabs": false, - "tabWidth": 65, - "tabXOffset": 10, - "hasSecondTab": false, - "secondTabText": "Send Back", - "secondTabOffset": 80, - "secondTabWidth": 65 - }, - "widgets_values": [] - }, - { - "id": 344, - "type": "GetNode", - "pos": [ - 237.99144812298735, - 3814.06500689016 - ], - "size": [ - 271.305509971064, - 60 - ], - "flags": { - "collapsed": true - }, - "order": 20, - "mode": 0, - "inputs": [], - "outputs": [ - { - "name": "MODEL", - "type": "MODEL", - "links": [ - 627 - ] - } - ], - "title": "Get_model", - "properties": {}, - "widgets_values": [ - "model" - ] - }, - { - "id": 115, - "type": "RandomNoise", - "pos": [ - 237.99144812298735, - 3635.2926194922593 - ], - "size": [ - 271.305509971064, - 82 - ], - "flags": {}, - "order": 21, - "mode": 0, - "inputs": [], - "outputs": [ - { - "name": "NOISE", - "type": "NOISE", - "links": [ - 259 - ] - } - ], - "properties": { - "cnr_id": "comfy-core", - "ver": "0.3.56", - "Node name for S&R": "RandomNoise", - "enableTabs": false, - "tabWidth": 65, - "tabXOffset": 10, - "hasSecondTab": false, - "secondTabText": "Send Back", - "secondTabOffset": 80, - "secondTabWidth": 65 - }, - "widgets_values": [ - 43, - "fixed" - ], - "color": "#006691", - "bgcolor": "rgba(24,24,27,.9)" - }, - { - "id": 343, - "type": "GetNode", - "pos": [ - 273.75003497061414, - 4532.958178219769 - ], - "size": [ - 271.305509971064, - 60 - ], - "flags": { - "collapsed": true - }, - "order": 22, - "mode": 0, - "inputs": [], - "outputs": [ - { - "name": "CONDITIONING", - "type": "CONDITIONING", - "links": [ - 623, - 624 - ] - } - ], - "title": "Get_negative", - "properties": {}, - "widgets_values": [ - "negative" - ] - }, - { - "id": 342, - "type": "LTX2_NAG", - "pos": [ - 244.132794287635, - 4480.644574669967 - ], - "size": [ - 271.305509971064, - 170 - ], - "flags": {}, - "order": 75, - "mode": 0, - "inputs": [ - { - "name": "model", - "type": "MODEL", - "link": 625 - }, - { - "name": "nag_cond_video", - "shape": 7, - "type": "CONDITIONING", - "link": 623 - }, - { - "name": "nag_cond_audio", - "shape": 7, - "type": "CONDITIONING", - "link": 624 - } - ], - "outputs": [ - { - "name": "model", - "type": "MODEL", - "links": [ - 626 - ] - } - ], - "properties": { - "cnr_id": "comfyui-kjnodes", - "ver": "ff79c7332d7ea4aa85097a88fb09359f28cb487e", - "Node name for S&R": "LTX2_NAG" - }, - "widgets_values": [ - 11, - 0.25, - 2.5, - true - ] - }, - { - "id": 322, - "type": "GetNode", - "pos": [ - -24.85188038740955, - 4471.396478929093 - ], - "size": [ - 210, - 60 - ], - "flags": { - "collapsed": true - }, - "order": 23, - "mode": 0, - "inputs": [], - "outputs": [ - { - "name": "FLOAT", - "type": "FLOAT", - "links": [ - 600 - ] - } - ], - "title": "Get_fps", - "properties": {}, - "widgets_values": [ - "fps" - ] - }, - { - "id": 226, - "type": "SetNode", - "pos": [ - -86.21565705316577, - 4489.73876465332 - ], - "size": [ - 210, - 60 - ], - "flags": { - "collapsed": true - }, - "order": 93, - "mode": 0, - "inputs": [ - { - "name": "CONDITIONING", - "type": "CONDITIONING", - "link": 455 - } - ], - "outputs": [ - { - "name": "*", - "type": "*", - "links": null - } - ], - "title": "Set_positive", - "properties": { - "previousName": "positive" - }, - "widgets_values": [ - "positive" - ], - "color": "#38291f", - "bgcolor": "rgba(24,24,27,.9)" - }, - { - "id": 227, - "type": "SetNode", - "pos": [ - -29.742659196724304, - 4498.2660995229035 - ], - "size": [ - 210, - 58 - ], - "flags": { - "collapsed": true - }, - "order": 94, - "mode": 0, - "inputs": [ - { - "name": "CONDITIONING", - "type": "CONDITIONING", - "link": 456 - } - ], - "outputs": [ - { - "name": "*", - "type": "*", - "links": null - } - ], - "title": "Set_negative", - "properties": { - "previousName": "negative" - }, - "widgets_values": [ - "negative" - ], - "color": "#38291f", - "bgcolor": "rgba(24,24,27,.9)" - }, - { - "id": 107, - "type": "LTXVConditioning", - "pos": [ - -128.45264555902682, - 4442.679834689612 - ], - "size": [ - 270, - 86.66666666666667 - ], - "flags": { - "collapsed": false - }, - "order": 89, - "mode": 0, - "inputs": [ - { - "name": "positive", - "type": "CONDITIONING", - "link": 286 - }, - { - "name": "negative", - "type": "CONDITIONING", - "link": 287 - }, - { - "name": "frame_rate", - "type": "FLOAT", - "widget": { - "name": "frame_rate" - }, - "link": 600 - } - ], - "outputs": [ - { - "name": "positive", - "type": "CONDITIONING", - "links": [ - 455 - ] - }, - { - "name": "negative", - "type": "CONDITIONING", - "links": [ - 456 - ] - } - ], - "properties": { - "cnr_id": "comfy-core", - "ver": "0.3.56", - "Node name for S&R": "LTXVConditioning", - "enableTabs": false, - "tabWidth": 65, - "tabXOffset": 10, - "hasSecondTab": false, - "secondTabText": "Send Back", - "secondTabOffset": 80, - "secondTabWidth": 65 - }, - "widgets_values": [ - 24 - ] - }, - { - "id": 303, - "type": "SetNode", - "pos": [ - -550.0867256817794, - 3637.178773994079 - ], - "size": [ - 386.66127530410665, - 60 - ], - "flags": { - "collapsed": true - }, - "order": 90, - "mode": 0, - "inputs": [ - { - "name": "MODEL", - "type": "MODEL", - "link": 590 - } - ], - "outputs": [ - { - "name": "*", - "type": "*", - "links": null - } - ], - "title": "Set_model_with_lora", - "properties": { - "previousName": "model_with_lora" - }, - "widgets_values": [ - "model_with_lora" - ] - }, - { - "id": 347, - "type": "StringConcatenate", - "pos": [ - -616.5295595599073, - 3962.4072266805238 - ], - "size": [ - 429.64913571999637, - 200 - ], - "flags": { - "collapsed": true - }, - "order": 58, - "mode": 0, - "inputs": [ - { - "name": "string_a", - "type": "STRING", - "widget": { - "name": "string_a" - }, - "link": 628 - } - ], - "outputs": [ - { - "name": "STRING", - "type": "STRING", - "links": [] - } - ], - "properties": { - "cnr_id": "comfy-core", - "ver": "0.14.1", - "Node name for S&R": "StringConcatenate" - }, - "widgets_values": [ - "", - "", - "" - ] - }, - { - "id": 348, - "type": "GetNode", - "pos": [ - -616.5295595599073, - 4054.852292030277 - ], - "size": [ - 429.64913571999637, - 34 - ], - "flags": { - "collapsed": true - }, - "order": 24, - "mode": 0, - "inputs": [], - "outputs": [ - { - "name": "CLIP", - "type": "CLIP", - "links": [] - } - ], - "title": "Get_clip", - "properties": {}, - "widgets_values": [ - "clip" - ] - }, - { - "id": 350, - "type": "PrimitiveStringMultiline", - "pos": [ - -616.5295595599073, - 3994.832575181112 - ], - "size": [ - 429.64913571999637, - 523.859790172266 - ], - "flags": { - "collapsed": true - }, - "order": 25, - "mode": 0, - "inputs": [], - "outputs": [ - { - "name": "STRING", - "type": "STRING", - "links": [ - 628 - ] - } - ], - "title": "LTX-2 PROMPT INSTRUCT", - "properties": { - "cnr_id": "comfy-core", - "ver": "0.14.1", - "Node name for S&R": "PrimitiveStringMultiline" - }, - "widgets_values": [ - "You are a Creative Assistant writing concise, action-focused image-to-video prompts. Given an image (first frame) and user Raw Input Prompt, generate a prompt to guide video generation from that image.\n\n#### Guidelines:\n- Analyze the Image: Identify Subject, Setting, Elements, Style and Mood.\n- Follow user Raw Input Prompt: Include all requested motion, actions, camera movements, audio, and details. If in conflict with the image, prioritize user request while maintaining visual consistency (describe transition from image to user's scene).\n- Describe only changes from the image: Don't reiterate established visual details. Inaccurate descriptions may cause scene cuts.\n- Active language: Use present-progressive verbs (\"is walking,\" \"speaking\"). If no action specified, describe natural movements.\n- Chronological flow: Use temporal connectors (\"as,\" \"then,\" \"while\").\n- Audio layer: Describe complete soundscape throughout the prompt alongside actions—NOT at the end. Align audio intensity with action tempo. Include natural background audio, ambient sounds, effects, speech or music (when requested). Be specific (e.g., \"soft footsteps on tile\") not vague (e.g., \"ambient sound\").\n- Speech (only when requested): Provide exact words in quotes with character's visual/voice characteristics (e.g., \"The tall man speaks in a low, gravelly voice\"), language if not English and accent if relevant. If general conversation mentioned without text, generate contextual quoted dialogue. (i.e., \"The man is talking\" input -> the output should include exact spoken words, like: \"The man is talking in an excited voice saying: 'You won't believe what I just saw!' His hands gesture expressively as he speaks, eyebrows raised with enthusiasm. The ambient sound of a quiet room underscores his animated speech.\")\n- Style: Include visual style at beginning: \"Style: