Add MiniMax H3 prompt guide and template
This commit is contained in:
@@ -15,6 +15,8 @@ non-Heretic `AWQ` text-encoder path.
|
|||||||
## Workflow asset
|
## Workflow asset
|
||||||
|
|
||||||
- `workflow.json`
|
- `workflow.json`
|
||||||
|
- `prompt-guide.md`
|
||||||
|
- `prompt-template.md`
|
||||||
|
|
||||||
## This pass
|
## This pass
|
||||||
|
|
||||||
@@ -29,6 +31,7 @@ non-Heretic `AWQ` text-encoder path.
|
|||||||
- `custom/chris/minimax-h3-extender-working/`
|
- `custom/chris/minimax-h3-extender-working/`
|
||||||
- current MiniMax Ref2VA prompt guidance in `optimized/notes/minimax-h3-ref2va-prompt-guidelines.md`
|
- current MiniMax Ref2VA prompt guidance in `optimized/notes/minimax-h3-ref2va-prompt-guidelines.md`
|
||||||
- local MiniMax continuation lessons gathered from earlier optimized `ref2v` and `Contex Loop` experiments
|
- local MiniMax continuation lessons gathered from earlier optimized `ref2v` and `Contex Loop` experiments
|
||||||
|
- official MiniMax H3 docs for prompt relationships, role labels, and limits
|
||||||
|
|
||||||
## Key model stack
|
## Key model stack
|
||||||
|
|
||||||
@@ -76,3 +79,5 @@ non-Heretic `AWQ` text-encoder path.
|
|||||||
- The graph still carries extra continuation machinery from the promoted Chris
|
- The graph still carries extra continuation machinery from the promoted Chris
|
||||||
working workflow, but the maintained `ref2v` lane is the generic single-clip
|
working workflow, but the maintained `ref2v` lane is the generic single-clip
|
||||||
starter built around the reusable prompt block and quality passes.
|
starter built around the reusable prompt block and quality passes.
|
||||||
|
- Use `prompt-guide.md` for the short authoring rules and `prompt-template.md`
|
||||||
|
for a copy-ready starter block that matches this maintained workflow.
|
||||||
|
|||||||
@@ -0,0 +1,136 @@
|
|||||||
|
# MiniMax H3 Prompt Guide
|
||||||
|
|
||||||
|
## Purpose
|
||||||
|
|
||||||
|
Short prompt-authoring companion for the maintained `MiniMax H3` `r2v`
|
||||||
|
master. This keeps the prompt shape close to MiniMax's official H3 docs while
|
||||||
|
matching the local ComfyUI workflow that Chris is actually using.
|
||||||
|
|
||||||
|
## Official MiniMax doc takeaways
|
||||||
|
|
||||||
|
Based on:
|
||||||
|
|
||||||
|
- `https://platform.minimax.io/docs/guides/video-generation`
|
||||||
|
- `https://platform.minimax.io/docs/guides/video-prompt`
|
||||||
|
- `https://platform.minimax.io/docs/api-reference/video-generation-v2-h3-context-ir`
|
||||||
|
|
||||||
|
Key points worth preserving:
|
||||||
|
|
||||||
|
- Every request needs one non-empty text prompt.
|
||||||
|
- `reference-to-video` can combine `reference_image`, `reference_video`, and
|
||||||
|
`reference_audio`.
|
||||||
|
- Official H3 limits allow up to `9` reference images, `3` reference videos,
|
||||||
|
and `3` reference audio clips, with mixed inputs capped at `12` files total.
|
||||||
|
- Prompt length limit is `7000` characters.
|
||||||
|
- Official duration is `4-15` seconds, but this local workflow should still be
|
||||||
|
planned around one clean `10s` beat per generation block.
|
||||||
|
- MiniMax explicitly recommends describing the relationship between references,
|
||||||
|
not just listing disconnected visual details.
|
||||||
|
- Camera guidance can be embedded directly in the prompt; their docs call out
|
||||||
|
tags like `[pan]`, `[zoom]`, and `[static]` as valid simple controls.
|
||||||
|
- `H3-Context-IR` exists to expand multimodal input into a richer structured
|
||||||
|
prompt, but the current ComfyUI workflow still benefits from a clean manual
|
||||||
|
prompt shape.
|
||||||
|
|
||||||
|
## Local workflow rules
|
||||||
|
|
||||||
|
- Treat `<Picture 1>` as the environment / master-scene reference when an
|
||||||
|
environment reference is used.
|
||||||
|
- Group all images belonging to the same character explicitly.
|
||||||
|
- State what each reference controls and what it must not control.
|
||||||
|
- Ignore the backgrounds of character references unless a reference is
|
||||||
|
explicitly assigned as the environment.
|
||||||
|
- Keep one coherent action beat per `10s` block.
|
||||||
|
- End each block in a state that naturally feeds the next continuation shot.
|
||||||
|
|
||||||
|
## Recommended prompt order
|
||||||
|
|
||||||
|
Use this order for the actual text block:
|
||||||
|
|
||||||
|
1. `Reference assignment`
|
||||||
|
2. `Reference usage and conflict resolution`
|
||||||
|
3. `Shot description`
|
||||||
|
4. `Camera`
|
||||||
|
5. `Visual continuity`
|
||||||
|
6. `Dialogue`
|
||||||
|
7. `Audio`
|
||||||
|
|
||||||
|
That order matches both the official MiniMax emphasis on relationship-aware
|
||||||
|
multimodal prompting and the authority rules already captured in the local
|
||||||
|
workflow.
|
||||||
|
|
||||||
|
## Prompt-writing rules
|
||||||
|
|
||||||
|
- Start by declaring which pictures belong to which subject.
|
||||||
|
- Say which image owns environment, body, face, clothing, props, or product
|
||||||
|
identity.
|
||||||
|
- Tell the model what to ignore from each reference.
|
||||||
|
- Describe the shot chronologically.
|
||||||
|
- Keep camera language simple and continuous.
|
||||||
|
- Keep dialogue short enough to fit inside the same motion beat.
|
||||||
|
- State ambience and sound effects plainly instead of over-scoring the audio.
|
||||||
|
|
||||||
|
## Copy style that works well
|
||||||
|
|
||||||
|
Preferred reference phrasing:
|
||||||
|
|
||||||
|
```text
|
||||||
|
<Picture 1> is the environment and master scene reference.
|
||||||
|
|
||||||
|
<Picture 2> and <Picture 3> both represent Subject 1.
|
||||||
|
<Picture 2> is the primary full-body reference for Subject 1.
|
||||||
|
<Picture 3> is the facial identity reference for Subject 1.
|
||||||
|
|
||||||
|
Use <Picture 1> to define the environment, layout, lighting, and composition.
|
||||||
|
Use <Picture 2> to define Subject 1's body proportions, hair, and clothing.
|
||||||
|
Use <Picture 3> to reinforce Subject 1's face.
|
||||||
|
|
||||||
|
Ignore the original backgrounds of character references.
|
||||||
|
The environment is defined only by <Picture 1>.
|
||||||
|
```
|
||||||
|
|
||||||
|
Preferred shot phrasing:
|
||||||
|
|
||||||
|
```text
|
||||||
|
Shot 1 - 0.00s-10.00s
|
||||||
|
|
||||||
|
Subject 1 stands near the shop counter facing three-quarters left.
|
||||||
|
Subject 2 enters from the right edge and slows beside the doorway.
|
||||||
|
Subject 1 looks up, turns towards Subject 2, and gives a restrained nod.
|
||||||
|
Subject 2 answers with a small smile and steps closer.
|
||||||
|
The action ends with both subjects holding position, leaving the conversation
|
||||||
|
open for the next extension.
|
||||||
|
```
|
||||||
|
|
||||||
|
Preferred camera phrasing:
|
||||||
|
|
||||||
|
```text
|
||||||
|
Camera: medium-wide eye-level two-shot, slow push in, no cut, no sudden
|
||||||
|
reframe. [static] at the start, then a gentle [push in] as Subject 2 enters.
|
||||||
|
```
|
||||||
|
|
||||||
|
Preferred audio phrasing:
|
||||||
|
|
||||||
|
```text
|
||||||
|
ambient_sound: quiet interior room tone, distant refrigeration hum, soft street
|
||||||
|
noise outside
|
||||||
|
sound_effects: light footsteps, fabric rustle, door handle click
|
||||||
|
non_diegetic_music: N/A
|
||||||
|
```
|
||||||
|
|
||||||
|
## Avoid
|
||||||
|
|
||||||
|
- Re-describing the whole environment when `<Picture 1>` already establishes it
|
||||||
|
- Treating multiple references of one person as separate people
|
||||||
|
- Stacking several unrelated actions into one `10s` block
|
||||||
|
- Long monologues inside a movement-heavy shot
|
||||||
|
- Overcomplicated camera choreography
|
||||||
|
- Mixing environment authority between the master scene and character images
|
||||||
|
|
||||||
|
## Recommended workflow use
|
||||||
|
|
||||||
|
- Use `prompt-template.md` as the starting copy block.
|
||||||
|
- Use `custom/chris/minimax-h3-extender-working/prompt-set-specification.md`
|
||||||
|
when building a full multi-shot extension plan.
|
||||||
|
- Use `optimized/notes/minimax-h3-ref2va-prompt-guidelines.md` when you need
|
||||||
|
the longer rationale behind reference authority and local-safe constraints.
|
||||||
@@ -0,0 +1,101 @@
|
|||||||
|
# MiniMax H3 Prompt Template
|
||||||
|
|
||||||
|
Use this as a starter for the maintained `MiniMax H3` `r2v` master.
|
||||||
|
|
||||||
|
```text
|
||||||
|
## Reference Assignment
|
||||||
|
|
||||||
|
<Picture 1> is the environment and master scene reference.
|
||||||
|
|
||||||
|
<Picture 2> and <Picture 3> both represent Subject 1.
|
||||||
|
<Picture 2> is the primary full-body reference for Subject 1.
|
||||||
|
<Picture 3> is the facial identity reference for Subject 1.
|
||||||
|
|
||||||
|
<Picture 4> and <Picture 5> both represent Subject 2.
|
||||||
|
<Picture 4> is the primary full-body reference for Subject 2.
|
||||||
|
<Picture 5> is the facial identity reference for Subject 2.
|
||||||
|
|
||||||
|
[Optional]
|
||||||
|
<Picture 6> defines the key prop / product / vehicle.
|
||||||
|
<Picture 7> defines the secondary prop / product / vehicle.
|
||||||
|
|
||||||
|
## Reference Usage
|
||||||
|
|
||||||
|
Use <Picture 1> to define the environment, composition, spatial layout,
|
||||||
|
lighting, and overall scene.
|
||||||
|
|
||||||
|
Use <Picture 2> to define Subject 1's body proportions, build, hair, clothing,
|
||||||
|
and overall appearance.
|
||||||
|
Use <Picture 3> only to reinforce Subject 1's facial identity.
|
||||||
|
|
||||||
|
Use <Picture 4> to define Subject 2's body proportions, build, hair, clothing,
|
||||||
|
and overall appearance.
|
||||||
|
Use <Picture 5> only to reinforce Subject 2's facial identity.
|
||||||
|
|
||||||
|
[Optional]
|
||||||
|
Use <Picture 6> only for the appearance of the key prop / product / vehicle.
|
||||||
|
Use <Picture 7> only for the appearance of the secondary prop / product /
|
||||||
|
vehicle.
|
||||||
|
|
||||||
|
Ignore the original backgrounds, locations, and camera compositions of all
|
||||||
|
character references.
|
||||||
|
The environment is defined only by <Picture 1>.
|
||||||
|
Do not mix identity traits between subjects.
|
||||||
|
|
||||||
|
## Shot
|
||||||
|
|
||||||
|
Shot 1 - 0.00s-10.00s
|
||||||
|
|
||||||
|
The environment remains exactly as established by <Picture 1>.
|
||||||
|
|
||||||
|
Subject 1 is [starting position, orientation, and mood].
|
||||||
|
Subject 2 is [starting position, orientation, and mood].
|
||||||
|
|
||||||
|
0.00s-3.00s:
|
||||||
|
[opening action beat]
|
||||||
|
|
||||||
|
3.00s-7.00s:
|
||||||
|
[main interaction or movement]
|
||||||
|
|
||||||
|
7.00s-10.00s:
|
||||||
|
[ending action that leaves a clean handoff into the next block if needed]
|
||||||
|
|
||||||
|
The subjects preserve their established identities throughout the shot.
|
||||||
|
|
||||||
|
## Camera
|
||||||
|
|
||||||
|
Camera: [framing], [height], [angle], [movement].
|
||||||
|
Example tags when useful: [static], [pan left], [pan right], [push in],
|
||||||
|
[pull out], [zoom in], [zoom out].
|
||||||
|
|
||||||
|
Keep the camera movement continuous and appropriate to the action.
|
||||||
|
Do not introduce a sudden cut or reset unless that is explicitly intended.
|
||||||
|
|
||||||
|
## Visual Continuity
|
||||||
|
|
||||||
|
Preserve the environment, object placement, perspective, and lighting
|
||||||
|
established by <Picture 1>.
|
||||||
|
Do not duplicate, mirror, offset, or reconstruct a second version of the
|
||||||
|
environment.
|
||||||
|
|
||||||
|
Subject 1 must remain the same person defined by <Picture 2> and <Picture 3>.
|
||||||
|
Subject 2 must remain the same person defined by <Picture 4> and <Picture 5>.
|
||||||
|
|
||||||
|
## Dialogue
|
||||||
|
|
||||||
|
Subject 1 says:
|
||||||
|
<d>[English] [SUBJECT 1 DIALOGUE]</d>
|
||||||
|
|
||||||
|
Subject 2 says:
|
||||||
|
<d>[English] [SUBJECT 2 DIALOGUE]</d>
|
||||||
|
|
||||||
|
[Optional]
|
||||||
|
Both say together:
|
||||||
|
<d>[English] [SHARED DIALOGUE]</d>
|
||||||
|
|
||||||
|
## Audio
|
||||||
|
|
||||||
|
ambient_sound: [room tone / ambience / background environment]
|
||||||
|
sound_effects: [diegetic action sounds]
|
||||||
|
non_diegetic_music: [N/A or short music direction]
|
||||||
|
```
|
||||||
Reference in New Issue
Block a user