diff --git a/optimized/image-to-video/minimax-h3-r2v-master/README.md b/optimized/image-to-video/minimax-h3-r2v-master/README.md index 71a8443..5e7be16 100644 --- a/optimized/image-to-video/minimax-h3-r2v-master/README.md +++ b/optimized/image-to-video/minimax-h3-r2v-master/README.md @@ -15,6 +15,8 @@ non-Heretic `AWQ` text-encoder path. ## Workflow asset - `workflow.json` +- `prompt-guide.md` +- `prompt-template.md` ## This pass @@ -29,6 +31,7 @@ non-Heretic `AWQ` text-encoder path. - `custom/chris/minimax-h3-extender-working/` - current MiniMax Ref2VA prompt guidance in `optimized/notes/minimax-h3-ref2va-prompt-guidelines.md` - local MiniMax continuation lessons gathered from earlier optimized `ref2v` and `Contex Loop` experiments +- official MiniMax H3 docs for prompt relationships, role labels, and limits ## Key model stack @@ -76,3 +79,5 @@ non-Heretic `AWQ` text-encoder path. - The graph still carries extra continuation machinery from the promoted Chris working workflow, but the maintained `ref2v` lane is the generic single-clip starter built around the reusable prompt block and quality passes. +- Use `prompt-guide.md` for the short authoring rules and `prompt-template.md` + for a copy-ready starter block that matches this maintained workflow. diff --git a/optimized/image-to-video/minimax-h3-r2v-master/prompt-guide.md b/optimized/image-to-video/minimax-h3-r2v-master/prompt-guide.md new file mode 100644 index 0000000..df48016 --- /dev/null +++ b/optimized/image-to-video/minimax-h3-r2v-master/prompt-guide.md @@ -0,0 +1,136 @@ +# MiniMax H3 Prompt Guide + +## Purpose + +Short prompt-authoring companion for the maintained `MiniMax H3` `r2v` +master. This keeps the prompt shape close to MiniMax's official H3 docs while +matching the local ComfyUI workflow that Chris is actually using. + +## Official MiniMax doc takeaways + +Based on: + +- `https://platform.minimax.io/docs/guides/video-generation` +- `https://platform.minimax.io/docs/guides/video-prompt` +- `https://platform.minimax.io/docs/api-reference/video-generation-v2-h3-context-ir` + +Key points worth preserving: + +- Every request needs one non-empty text prompt. +- `reference-to-video` can combine `reference_image`, `reference_video`, and + `reference_audio`. +- Official H3 limits allow up to `9` reference images, `3` reference videos, + and `3` reference audio clips, with mixed inputs capped at `12` files total. +- Prompt length limit is `7000` characters. +- Official duration is `4-15` seconds, but this local workflow should still be + planned around one clean `10s` beat per generation block. +- MiniMax explicitly recommends describing the relationship between references, + not just listing disconnected visual details. +- Camera guidance can be embedded directly in the prompt; their docs call out + tags like `[pan]`, `[zoom]`, and `[static]` as valid simple controls. +- `H3-Context-IR` exists to expand multimodal input into a richer structured + prompt, but the current ComfyUI workflow still benefits from a clean manual + prompt shape. + +## Local workflow rules + +- Treat `` as the environment / master-scene reference when an + environment reference is used. +- Group all images belonging to the same character explicitly. +- State what each reference controls and what it must not control. +- Ignore the backgrounds of character references unless a reference is + explicitly assigned as the environment. +- Keep one coherent action beat per `10s` block. +- End each block in a state that naturally feeds the next continuation shot. + +## Recommended prompt order + +Use this order for the actual text block: + +1. `Reference assignment` +2. `Reference usage and conflict resolution` +3. `Shot description` +4. `Camera` +5. `Visual continuity` +6. `Dialogue` +7. `Audio` + +That order matches both the official MiniMax emphasis on relationship-aware +multimodal prompting and the authority rules already captured in the local +workflow. + +## Prompt-writing rules + +- Start by declaring which pictures belong to which subject. +- Say which image owns environment, body, face, clothing, props, or product + identity. +- Tell the model what to ignore from each reference. +- Describe the shot chronologically. +- Keep camera language simple and continuous. +- Keep dialogue short enough to fit inside the same motion beat. +- State ambience and sound effects plainly instead of over-scoring the audio. + +## Copy style that works well + +Preferred reference phrasing: + +```text + is the environment and master scene reference. + + and both represent Subject 1. + is the primary full-body reference for Subject 1. + is the facial identity reference for Subject 1. + +Use to define the environment, layout, lighting, and composition. +Use to define Subject 1's body proportions, hair, and clothing. +Use to reinforce Subject 1's face. + +Ignore the original backgrounds of character references. +The environment is defined only by . +``` + +Preferred shot phrasing: + +```text +Shot 1 - 0.00s-10.00s + +Subject 1 stands near the shop counter facing three-quarters left. +Subject 2 enters from the right edge and slows beside the doorway. +Subject 1 looks up, turns towards Subject 2, and gives a restrained nod. +Subject 2 answers with a small smile and steps closer. +The action ends with both subjects holding position, leaving the conversation +open for the next extension. +``` + +Preferred camera phrasing: + +```text +Camera: medium-wide eye-level two-shot, slow push in, no cut, no sudden +reframe. [static] at the start, then a gentle [push in] as Subject 2 enters. +``` + +Preferred audio phrasing: + +```text +ambient_sound: quiet interior room tone, distant refrigeration hum, soft street +noise outside +sound_effects: light footsteps, fabric rustle, door handle click +non_diegetic_music: N/A +``` + +## Avoid + +- Re-describing the whole environment when `` already establishes it +- Treating multiple references of one person as separate people +- Stacking several unrelated actions into one `10s` block +- Long monologues inside a movement-heavy shot +- Overcomplicated camera choreography +- Mixing environment authority between the master scene and character images + +## Recommended workflow use + +- Use `prompt-template.md` as the starting copy block. +- Use `custom/chris/minimax-h3-extender-working/prompt-set-specification.md` + when building a full multi-shot extension plan. +- Use `optimized/notes/minimax-h3-ref2va-prompt-guidelines.md` when you need + the longer rationale behind reference authority and local-safe constraints. diff --git a/optimized/image-to-video/minimax-h3-r2v-master/prompt-template.md b/optimized/image-to-video/minimax-h3-r2v-master/prompt-template.md new file mode 100644 index 0000000..921c7b3 --- /dev/null +++ b/optimized/image-to-video/minimax-h3-r2v-master/prompt-template.md @@ -0,0 +1,101 @@ +# MiniMax H3 Prompt Template + +Use this as a starter for the maintained `MiniMax H3` `r2v` master. + +```text +## Reference Assignment + + is the environment and master scene reference. + + and both represent Subject 1. + is the primary full-body reference for Subject 1. + is the facial identity reference for Subject 1. + + and both represent Subject 2. + is the primary full-body reference for Subject 2. + is the facial identity reference for Subject 2. + +[Optional] + defines the key prop / product / vehicle. + defines the secondary prop / product / vehicle. + +## Reference Usage + +Use to define the environment, composition, spatial layout, +lighting, and overall scene. + +Use to define Subject 1's body proportions, build, hair, clothing, +and overall appearance. +Use only to reinforce Subject 1's facial identity. + +Use to define Subject 2's body proportions, build, hair, clothing, +and overall appearance. +Use only to reinforce Subject 2's facial identity. + +[Optional] +Use only for the appearance of the key prop / product / vehicle. +Use only for the appearance of the secondary prop / product / +vehicle. + +Ignore the original backgrounds, locations, and camera compositions of all +character references. +The environment is defined only by . +Do not mix identity traits between subjects. + +## Shot + +Shot 1 - 0.00s-10.00s + +The environment remains exactly as established by . + +Subject 1 is [starting position, orientation, and mood]. +Subject 2 is [starting position, orientation, and mood]. + +0.00s-3.00s: +[opening action beat] + +3.00s-7.00s: +[main interaction or movement] + +7.00s-10.00s: +[ending action that leaves a clean handoff into the next block if needed] + +The subjects preserve their established identities throughout the shot. + +## Camera + +Camera: [framing], [height], [angle], [movement]. +Example tags when useful: [static], [pan left], [pan right], [push in], +[pull out], [zoom in], [zoom out]. + +Keep the camera movement continuous and appropriate to the action. +Do not introduce a sudden cut or reset unless that is explicitly intended. + +## Visual Continuity + +Preserve the environment, object placement, perspective, and lighting +established by . +Do not duplicate, mirror, offset, or reconstruct a second version of the +environment. + +Subject 1 must remain the same person defined by and . +Subject 2 must remain the same person defined by and . + +## Dialogue + +Subject 1 says: +[English] [SUBJECT 1 DIALOGUE] + +Subject 2 says: +[English] [SUBJECT 2 DIALOGUE] + +[Optional] +Both say together: +[English] [SHARED DIALOGUE] + +## Audio + +ambient_sound: [room tone / ambience / background environment] +sound_effects: [diegetic action sounds] +non_diegetic_music: [N/A or short music direction] +```