Add MiniMax H3 prompt guide and template
This commit is contained in:
Morpheus
@@ -15,6 +15,8 @@ non-Heretic `AWQ` text-encoder path.
|
||||
## Workflow asset
|
||||
|
||||
- `workflow.json`
|
||||
- `prompt-guide.md`
|
||||
- `prompt-template.md`
|
||||
|
||||
## This pass
|
||||
|
||||
@@ -29,6 +31,7 @@ non-Heretic `AWQ` text-encoder path.
|
||||
- `custom/chris/minimax-h3-extender-working/`
|
||||
- current MiniMax Ref2VA prompt guidance in `optimized/notes/minimax-h3-ref2va-prompt-guidelines.md`
|
||||
- local MiniMax continuation lessons gathered from earlier optimized `ref2v` and `Contex Loop` experiments
|
||||
- official MiniMax H3 docs for prompt relationships, role labels, and limits
|
||||
|
||||
## Key model stack
|
||||
|
||||
@@ -76,3 +79,5 @@ non-Heretic `AWQ` text-encoder path.
|
||||
- The graph still carries extra continuation machinery from the promoted Chris
|
||||
working workflow, but the maintained `ref2v` lane is the generic single-clip
|
||||
starter built around the reusable prompt block and quality passes.
|
||||
- Use `prompt-guide.md` for the short authoring rules and `prompt-template.md`
|
||||
for a copy-ready starter block that matches this maintained workflow.
|
||||
|
||||
@@ -0,0 +1,136 @@
|
||||
# MiniMax H3 Prompt Guide
|
||||
|
||||
## Purpose
|
||||
|
||||
Short prompt-authoring companion for the maintained `MiniMax H3` `r2v`
|
||||
master. This keeps the prompt shape close to MiniMax's official H3 docs while
|
||||
matching the local ComfyUI workflow that Chris is actually using.
|
||||
|
||||
## Official MiniMax doc takeaways
|
||||
|
||||
Based on:
|
||||
|
||||
- `https://platform.minimax.io/docs/guides/video-generation`
|
||||
- `https://platform.minimax.io/docs/guides/video-prompt`
|
||||
- `https://platform.minimax.io/docs/api-reference/video-generation-v2-h3-context-ir`
|
||||
|
||||
Key points worth preserving:
|
||||
|
||||
- Every request needs one non-empty text prompt.
|
||||
- `reference-to-video` can combine `reference_image`, `reference_video`, and
|
||||
`reference_audio`.
|
||||
- Official H3 limits allow up to `9` reference images, `3` reference videos,
|
||||
and `3` reference audio clips, with mixed inputs capped at `12` files total.
|
||||
- Prompt length limit is `7000` characters.
|
||||
- Official duration is `4-15` seconds, but this local workflow should still be
|
||||
planned around one clean `10s` beat per generation block.
|
||||
- MiniMax explicitly recommends describing the relationship between references,
|
||||
not just listing disconnected visual details.
|
||||
- Camera guidance can be embedded directly in the prompt; their docs call out
|
||||
tags like `[pan]`, `[zoom]`, and `[static]` as valid simple controls.
|
||||
- `H3-Context-IR` exists to expand multimodal input into a richer structured
|
||||
prompt, but the current ComfyUI workflow still benefits from a clean manual
|
||||
prompt shape.
|
||||
|
||||
## Local workflow rules
|
||||
|
||||
- Treat `<Picture 1>` as the environment / master-scene reference when an
|
||||
environment reference is used.
|
||||
- Group all images belonging to the same character explicitly.
|
||||
- State what each reference controls and what it must not control.
|
||||
- Ignore the backgrounds of character references unless a reference is
|
||||
explicitly assigned as the environment.
|
||||
- Keep one coherent action beat per `10s` block.
|
||||
- End each block in a state that naturally feeds the next continuation shot.
|
||||
|
||||
## Recommended prompt order
|
||||
|
||||
Use this order for the actual text block:
|
||||
|
||||
1. `Reference assignment`
|
||||
2. `Reference usage and conflict resolution`
|
||||
3. `Shot description`
|
||||
4. `Camera`
|
||||
5. `Visual continuity`
|
||||
6. `Dialogue`
|
||||
7. `Audio`
|
||||
|
||||
That order matches both the official MiniMax emphasis on relationship-aware
|
||||
multimodal prompting and the authority rules already captured in the local
|
||||
workflow.
|
||||
|
||||
## Prompt-writing rules
|
||||
|
||||
- Start by declaring which pictures belong to which subject.
|
||||
- Say which image owns environment, body, face, clothing, props, or product
|
||||
identity.
|
||||
- Tell the model what to ignore from each reference.
|
||||
- Describe the shot chronologically.
|
||||
- Keep camera language simple and continuous.
|
||||
- Keep dialogue short enough to fit inside the same motion beat.
|
||||
- State ambience and sound effects plainly instead of over-scoring the audio.
|
||||
|
||||
## Copy style that works well
|
||||
|
||||
Preferred reference phrasing:
|
||||
|
||||
```text
|
||||
<Picture 1> is the environment and master scene reference.
|
||||
|
||||
<Picture 2> and <Picture 3> both represent Subject 1.
|
||||
<Picture 2> is the primary full-body reference for Subject 1.
|
||||
<Picture 3> is the facial identity reference for Subject 1.
|
||||
|
||||
Use <Picture 1> to define the environment, layout, lighting, and composition.
|
||||
Use <Picture 2> to define Subject 1's body proportions, hair, and clothing.
|
||||
Use <Picture 3> to reinforce Subject 1's face.
|
||||
|
||||
Ignore the original backgrounds of character references.
|
||||
The environment is defined only by <Picture 1>.
|
||||
```
|
||||
|
||||
Preferred shot phrasing:
|
||||
|
||||
```text
|
||||
Shot 1 - 0.00s-10.00s
|
||||
|
||||
Subject 1 stands near the shop counter facing three-quarters left.
|
||||
Subject 2 enters from the right edge and slows beside the doorway.
|
||||
Subject 1 looks up, turns towards Subject 2, and gives a restrained nod.
|
||||
Subject 2 answers with a small smile and steps closer.
|
||||
The action ends with both subjects holding position, leaving the conversation
|
||||
open for the next extension.
|
||||
```
|
||||
|
||||
Preferred camera phrasing:
|
||||
|
||||
```text
|
||||
Camera: medium-wide eye-level two-shot, slow push in, no cut, no sudden
|
||||
reframe. [static] at the start, then a gentle [push in] as Subject 2 enters.
|
||||
```
|
||||
|
||||
Preferred audio phrasing:
|
||||
|
||||
```text
|
||||
ambient_sound: quiet interior room tone, distant refrigeration hum, soft street
|
||||
noise outside
|
||||
sound_effects: light footsteps, fabric rustle, door handle click
|
||||
non_diegetic_music: N/A
|
||||
```
|
||||
|
||||
## Avoid
|
||||
|
||||
- Re-describing the whole environment when `<Picture 1>` already establishes it
|
||||
- Treating multiple references of one person as separate people
|
||||
- Stacking several unrelated actions into one `10s` block
|
||||
- Long monologues inside a movement-heavy shot
|
||||
- Overcomplicated camera choreography
|
||||
- Mixing environment authority between the master scene and character images
|
||||
|
||||
## Recommended workflow use
|
||||
|
||||
- Use `prompt-template.md` as the starting copy block.
|
||||
- Use `custom/chris/minimax-h3-extender-working/prompt-set-specification.md`
|
||||
when building a full multi-shot extension plan.
|
||||
- Use `optimized/notes/minimax-h3-ref2va-prompt-guidelines.md` when you need
|
||||
the longer rationale behind reference authority and local-safe constraints.
|
||||
@@ -0,0 +1,101 @@
|
||||
# MiniMax H3 Prompt Template
|
||||
|
||||
Use this as a starter for the maintained `MiniMax H3` `r2v` master.
|
||||
|
||||
```text
|
||||
## Reference Assignment
|
||||
|
||||
<Picture 1> is the environment and master scene reference.
|
||||
|
||||
<Picture 2> and <Picture 3> both represent Subject 1.
|
||||
<Picture 2> is the primary full-body reference for Subject 1.
|
||||
<Picture 3> is the facial identity reference for Subject 1.
|
||||
|
||||
<Picture 4> and <Picture 5> both represent Subject 2.
|
||||
<Picture 4> is the primary full-body reference for Subject 2.
|
||||
<Picture 5> is the facial identity reference for Subject 2.
|
||||
|
||||
[Optional]
|
||||
<Picture 6> defines the key prop / product / vehicle.
|
||||
<Picture 7> defines the secondary prop / product / vehicle.
|
||||
|
||||
## Reference Usage
|
||||
|
||||
Use <Picture 1> to define the environment, composition, spatial layout,
|
||||
lighting, and overall scene.
|
||||
|
||||
Use <Picture 2> to define Subject 1's body proportions, build, hair, clothing,
|
||||
and overall appearance.
|
||||
Use <Picture 3> only to reinforce Subject 1's facial identity.
|
||||
|
||||
Use <Picture 4> to define Subject 2's body proportions, build, hair, clothing,
|
||||
and overall appearance.
|
||||
Use <Picture 5> only to reinforce Subject 2's facial identity.
|
||||
|
||||
[Optional]
|
||||
Use <Picture 6> only for the appearance of the key prop / product / vehicle.
|
||||
Use <Picture 7> only for the appearance of the secondary prop / product /
|
||||
vehicle.
|
||||
|
||||
Ignore the original backgrounds, locations, and camera compositions of all
|
||||
character references.
|
||||
The environment is defined only by <Picture 1>.
|
||||
Do not mix identity traits between subjects.
|
||||
|
||||
## Shot
|
||||
|
||||
Shot 1 - 0.00s-10.00s
|
||||
|
||||
The environment remains exactly as established by <Picture 1>.
|
||||
|
||||
Subject 1 is [starting position, orientation, and mood].
|
||||
Subject 2 is [starting position, orientation, and mood].
|
||||
|
||||
0.00s-3.00s:
|
||||
[opening action beat]
|
||||
|
||||
3.00s-7.00s:
|
||||
[main interaction or movement]
|
||||
|
||||
7.00s-10.00s:
|
||||
[ending action that leaves a clean handoff into the next block if needed]
|
||||
|
||||
The subjects preserve their established identities throughout the shot.
|
||||
|
||||
## Camera
|
||||
|
||||
Camera: [framing], [height], [angle], [movement].
|
||||
Example tags when useful: [static], [pan left], [pan right], [push in],
|
||||
[pull out], [zoom in], [zoom out].
|
||||
|
||||
Keep the camera movement continuous and appropriate to the action.
|
||||
Do not introduce a sudden cut or reset unless that is explicitly intended.
|
||||
|
||||
## Visual Continuity
|
||||
|
||||
Preserve the environment, object placement, perspective, and lighting
|
||||
established by <Picture 1>.
|
||||
Do not duplicate, mirror, offset, or reconstruct a second version of the
|
||||
environment.
|
||||
|
||||
Subject 1 must remain the same person defined by <Picture 2> and <Picture 3>.
|
||||
Subject 2 must remain the same person defined by <Picture 4> and <Picture 5>.
|
||||
|
||||
## Dialogue
|
||||
|
||||
Subject 1 says:
|
||||
<d>[English] [SUBJECT 1 DIALOGUE]</d>
|
||||
|
||||
Subject 2 says:
|
||||
<d>[English] [SUBJECT 2 DIALOGUE]</d>
|
||||
|
||||
[Optional]
|
||||
Both say together:
|
||||
<d>[English] [SHARED DIALOGUE]</d>
|
||||
|
||||
## Audio
|
||||
|
||||
ambient_sound: [room tone / ambience / background environment]
|
||||
sound_effects: [diegetic action sounds]
|
||||
non_diegetic_music: [N/A or short music direction]
|
||||
```
|
||||
Reference in New Issue
Block a user