188 lines
8.9 KiB
Markdown
188 lines
8.9 KiB
Markdown
# Overview
|
|
|
|
This will be a collection of free resources for ComfyUI.
|
|
|
|
Hopefully it will make creating cool stuff easier.
|
|
|
|
All of my nodes are created with the help of AI, so there may or may not be redundant, messy code.
|
|
|
|
## ▶️ YouTube Tutorial Videos
|
|
|
|
<table>
|
|
<tr>
|
|
<td>
|
|
<p align="center">Overview Video</p>
|
|
<a href="https://www.youtube.com/watch?v=aXDIr8eNovI">
|
|
<img src="https://img.youtube.com/vi/aXDIr8eNovI/0.jpg" alt="Overview Video" width="400">
|
|
</a>
|
|
</td>
|
|
<td>
|
|
<p align="center">Prompting and Keyframing Guide</p>
|
|
<a href="https://www.youtube.com/watch?v=ZY4hsvTzbas">
|
|
<img src="https://img.youtube.com/vi/ZY4hsvTzbas/0.jpg" alt="Prompting and Keyframing Guide" width="400">
|
|
</a>
|
|
</td>
|
|
</tr>
|
|
</table>
|
|
|
|
## ❓ How to install nodes
|
|
|
|
- Navigate to your `/ComfyUI/custom_nodes/ folder`
|
|
- Run `git clone https://github.com/WhatDreamscost/WhatDreamsCost-ComfyUI`
|
|
- Or download through the ComfyUI Manager.
|
|
|
|
# 🔄 Recent Updates
|
|
|
|
**v1.2.8**
|
|
* **Updated Load Video UI and Color Conversion**
|
|
* Added crop mode, a simple interface to crop videos. It also include various aspect ratio presets.
|
|
* Updated color conversion to ensure colors are as accurate as possible. Will first check metadata for colorspace, and if metadata is missing then it will guess the colorspace based on video dimensions.
|
|
* Updated display mode toggle UI to be more understandable
|
|
|
|
|
|
**v1.2.7**
|
|
* **New Node: Load Video UI**
|
|
|
|
Custom Node to Trim, Resize, and Preview Videos in Realtime
|
|
|
|
**v1.2.6**
|
|
* **Updated Speech Length Calculator UI**
|
|
|
|
Also added duration output to the Load Audio UI node
|
|
|
|
|
|
<details>
|
|
<summary>Click to view older Updates</summary>
|
|
|
|
**v1.2.5**
|
|
* **Updated Load Audio UI Node**
|
|
* Added Duration Setting
|
|
* Made the whole selection bar draggable
|
|
* Fixed Trimmed UI to show centiseconds
|
|
|
|
**v1.2.4**
|
|
* **New Node: Load Audio UI**
|
|
|
|
Overhaul of the load audio node. Features a simple interface to easily trim audio. Also allows dragging and dropping files (fixes the original node that doesn't allow dropping in videos). Also compatible with nodes 2.0.
|
|
|
|
**v1.2.3**
|
|
* **Workflow Update + Minor Bug Fix**
|
|
* Added new workflow that is compatible with the latest ComfyUI version (as of 4/27/26). The new workflow also included an option to include custom audio, and has minor improvements of the previous workflows.
|
|
* Fixed minor bug with Multi Image Loader that blocked mouse input in a small area under the node 🤷♂️
|
|
|
|
**v1.2.0**
|
|
* **New Node: Speech Length Calculator**
|
|
|
|
Automatically output in realtime how long a video should be based on the dialouge.
|
|
|
|
**v1.1.0**
|
|
* Added resize_method to the Multi Image Loader node for more resize options
|
|
* Added insert_mode which allows you to enter in seconds instead of frames on the LTX Sequencer node
|
|
* Updated workflows with more notes
|
|
* Re-added tiny vae to workflows
|
|
* Fixed various bugs
|
|
* more things i can't rememeber
|
|
|
|
**This update will change the node layouts, so be sure to update your workflows or else they won't work properly.**
|
|
|
|
❗❗❗ **New Tutorial on using these nodes available: https://www.youtube.com/watch?v=aXDIr8eNovI** ❗❗❗
|
|
</details>
|
|
|
|
# ⚙️ Custom Nodes
|
|
|
|
## Multi Image Loader
|
|
<img width="1280" height="720" alt="Multi_Image_Loader_Wide_Gif" src="https://github.com/user-attachments/assets/99b6afd8-5197-4e6c-81da-a7bd156c42c7" />
|
|
|
|
An Image loader that features a built in gallery, allowing your to easily rearrange images and output them seperately or batched together. It also combines the image resize node and LTXVPreprocess node to reduce clutter in LTX workflows.
|
|
|
|
## LTX Sequencer
|
|
|
|
|
|
An overhaul of the LTXVAddGuideMulti node. It allows you to quickly create FFLF (First Frame Last Frame) videos, shot sequences, supports any number of middle frames.
|
|
|
|
Connect the Multi Image Loader node's multi_output to automatically update the node's widgets.
|
|
|
|
It also has a sync feature that syncs all LTX Sequencer nodes together in realtime, removing the need to edit every single node manually every time you want to make a change to something.
|
|
|
|
|
|
## LTX Keyframer
|
|
<img width="1082" height="608" alt="LTX Keyframer Wide" src="https://github.com/user-attachments/assets/850ba4a2-dbca-4e5a-a580-1c271e9f0c41" />
|
|
|
|
An overhaul of the LTXVImgToVideoInplaceKJ node. It allows you to quickly create FFLF (First Frame Last Frame) videos and shot sequences. Also upports any number of middle frames.
|
|
|
|
Connect the Multi Image Loader node's multi_output to automatically update the node's widgets.
|
|
|
|
It also has a sync feature that syncs all LTX Keyframer nodes together in realtime, removing the need to edit every single node manually every time you want to make a change to something.
|
|
|
|
**I would recommend using the LTX Sequencer Node over this node, after further testing it seems superior in at pretty much everything. I'll leave it in just in case more people want to test it**
|
|
|
|
## Speech Length Calculator
|
|
<img width="1280" height="720" alt="Speech Length Calculator v2 Gif" src="https://github.com/user-attachments/assets/04b9a1cf-20e4-4b7b-a9c6-4a5a0825995b" />
|
|
<br>
|
|
<br>
|
|
This node calculates in realtime how long a video should be based on the dialogue. Any words in quotations will be considered as speech. The node updates in realtime without having to run the workflow, and outputs the length depending on how fast the speech is.
|
|
|
|
If you connect another string/text node to the text_input, it will still update in the length in realtime.
|
|
|
|
I kept having to play the guessing game on my own generations so I made this node to make it easier :man_shrugging:
|
|
|
|
## Load Video UI
|
|
<table width="100%">
|
|
<tr>
|
|
<td width="50%" align="center">
|
|
<p>Simple Controls</p>
|
|
<img src="https://github.com/user-attachments/assets/fb76ff03-a6ff-4837-bd63-7e429f5f3d37" width="100%" />
|
|
</td>
|
|
<td width="50%" align="center">
|
|
<p>New Crop Mode!</p>
|
|
<img src="https://github.com/user-attachments/assets/28cfb4ca-e42a-44da-9afb-f20cb01b9722" width="100%" />
|
|
</td>
|
|
</tr>
|
|
</table>
|
|
|
|
<br>
|
|
<br>
|
|
An upgraded Load Video node. It has the following features:
|
|
|
|
* Simple interface to quickly trim videos and preview them in realtime.
|
|
* Ability to load any length of video into the node (the default load video node was limited to 100MB files)
|
|
* Easily switch between showing seconds and frames with a toggle button. This will change the widgets as well as the interface.
|
|
* Multiple options for resizing the video (maintain aspect ratio, crop, stretch to fit, pad)
|
|
* Allows dragging and dropping files into the node
|
|
* Progress bar
|
|
* Optimized to use less RAM (still very limited due to ComfyUI limitations, but at least a little more efficient)
|
|
|
|
Please note that due to ComfyUI limitations (and the fact that this node doesn't use any addtional libraries), this node will not work well for outputting large videos. You can trim any length of video without a problem, but if the output is still large it will end up using a lot of RAM. I have implemented various optimizations though to make it use less memory.
|
|
|
|
## Load Audio UI
|
|
<img width="1280" height="720" alt="Load_Audio_UI_V2" src="https://github.com/user-attachments/assets/e3dc5c8d-d0b9-4336-8196-944204719239" />
|
|
<br>
|
|
<br>
|
|
An upgraded Load Audio node. Features a simple interface to easily trim audio. Also allows dragging and dropping files (fixes the original node that doesn't allow dropping in videos). Also compatible with nodes 2.0.
|
|
|
|
# 💡 Workflows
|
|
<img width="3120" height="990" alt="LTX I2V First Last Frame 3 Stage Workflow v6" src="https://github.com/user-attachments/assets/c993ef2f-ac4b-4091-a7f6-5ff1674c3718" />
|
|
<br>
|
|
<br>
|
|
This is a compact LTX 2.3 workflow for I2V and First Frame, Middle Frame, Last frame video generation.
|
|
I seperated and organized everything into subraphs to make things as clean as possible, and added toggles to customize the workflow quickly.
|
|
|
|
Download workflows here: https://github.com/WhatDreamsCost/WhatDreamsCost-ComfyUI/tree/main/example_workflows
|
|
|
|
Or drag and drop the image into ComfyUI to import workflow.
|
|
|
|
# ❗ Known Issues
|
|
**Multi Image Loader**
|
|
- Rearranging images sometimes gets finicky. I'll try and fix this soon. It may be due to my ComfyUI frontend not matching the backend.
|
|
|
|
**LTX Sequencer and LTX Keyframer**
|
|
- Will randomly swap the widget values when loading workflows. It happens very rarely, and for some reason only happens to 1 node. It can be reversed by just re-syncing it with another node.
|
|
|
|
It may also be due to my ComfyUI frontend not matching the backend (that has been causing other issues with ComfyUI, still waiting for ComfyUI to fix the issues with latest version)
|
|
|
|
# 💡 Additional Info
|
|
|
|
I made these nodes knowing almost nothing about python and a beginner level knowledge of javascript. Feel free to suggest improvements, and if you run into any bugs let me know.
|
|
|
|
For those asking, I mainly used gemini to create these nodes.
|