Add H3 prompt set specification beside Chris workflow

2026-08-15 09:44:10 +00:00
parent 52255d15be
commit dd757541be
1 changed files with 855 additions and 0 deletions
@@ -0,0 +1,855 @@
+# MiniMax H3 Prompt Set Specification
+
+## 1. Purpose
+
+This specification defines the standard structure for creating MiniMax
+H3 video prompt sets.
+
+The format is designed around a practical production workflow:
+
+1. Plan the complete sequence.
+2. Define and create any required character, clothing, environment,
+prop, vehicle, or object references.
+3. Allocate the available reference-image slots.
+4. Create the Global Prompt.
+5. Generate the initial video.
+6. Feed the initial video into a chained JSON extension loop.
+7. Carry forward continuity state explicitly between generated blocks.
+
+The final deliverable should always be **tight, clearly sectioned,
+actionable, and copy-ready**.
+
+------------------------------------------------------------------------
+
+## 2. Core Generation Model
+
+### 2.1 Initial Video + Extension Chain
+
+A prompt set consists of:
+
+- An **Initial Video Prompt**
+- A **Global Prompt**
+- A sequence of JSON-defined video extensions
+
+The initial generated video is fed into the first JSON extension. Each
+generated extension is then fed into the next.
+
+Although the finished clips are stitched to appear as one continuous
+sequence, **each generation block has no semantic memory of earlier
+prompts**.
+
+Therefore:
+
+- The incoming video provides visual/start-frame continuity.
+- The current prompt must provide semantic and state continuity.
+- Persistent changes must be explicitly restated in later sections.
+
+### 2.2 Duration
+
+- **10 seconds is the maximum duration of a single generated block.**
+- Sections do **not** have to be 10 seconds long.
+- Duration should match the natural length of the story beat.
+- Short reactions, reveals, transitions, or simple actions may use
+shorter blocks.
+- The workflow supports a custom per-section duration field.
+- The exact JSON property for per-section duration is **TBD** and
+should not be invented until supplied.
+
+### 2.3 Steps
+
+Default:
+
+```json
+"steps": 8
+```
+
+------------------------------------------------------------------------
+
+## 3. Reference Image System
+
+MiniMax H3 supports a working bank of up to **7 reference-image slots**
+for this workflow.
+
+Reference allocation must be planned **before video generation**.
+
+### 3.1 Character References
+
+A consistent recurring character normally uses two images:
+
+1. Primary full-body reference
+2. Frontal facial reference
+
+Therefore:
+
+ Consistent Characters Character Slots Used Slots Remaining
+ ----------------------- ---------------------- -----------------
+ 3 6 1
+ 2 4 3
+ 1 2 5
+
+The actual number of remaining slots depends on whether an environment
+reference is used.
+
+### 3.2 Maximum Consistent Characters
+
+- Maximum: **3 consistent recurring characters per prompt set**
+- Each normally receives a full-body and facial reference.
+- Additional incidental/background people may be generated when
+appropriate, but they should not be treated as persistent
+reference-driven characters unless explicitly planned.
+
+------------------------------------------------------------------------
+
+## 4. Environment Modes
+
+A prompt set can use either of two environment modes.
+
+### 4.1 Referenced Environment
+
+Use when:
+
+- Spatial consistency matters.
+- Characters interact with specific parts of the location.
+- The sequence is relatively long.
+- Fixed scene features are important to later actions.
+- A distinctive location must remain visually consistent.
+
+One image slot is assigned as the master environment reference.
+
+Example:
+
+```text
+<Picture 1> is the environment and master scene reference. Use it to establish the environment, spatial layout, lighting and overall scene.
+```
+
+The environment image must be designed around the **complete planned
+story**, not only the opening section.
+
+If section 8 requires a gate, table, doorway, counter, caravan,
+staircase, etc., that feature should already be represented
+appropriately in the environment reference where practical.
+
+### 4.2 Generated Environment
+
+Use when precise location consistency is not important, particularly
+for:
+
+- Short commercials
+- Spoof adverts
+- Short comedy sketches
+- Simple studio scenes
+- Quick standalone sequences
+- Scenes where the environment is secondary to
+characters/products/actions
+
+No environment reference image is required.
+
+Instead:
+
+- Describe the environment textually.
+- Establish the broad scene in the Global Prompt.
+- Add section-specific environmental details where required.
+- Use the freed image slot for another useful reference asset.
+
+------------------------------------------------------------------------
+
+## 5. Additional Reference Assets
+
+Unused image slots can be assigned to:
+
+- Products
+- Props
+- Vehicles
+- Important objects
+- Equipment
+- Creatures
+- Signs/graphics
+- Other persistent visual elements
+
+### 5.1 Composite Reference Images
+
+A single image may contain multiple assets.
+
+Example:
+
+```text
+<Picture 7> is a prop reference sheet containing:
+- the red holdall
+- the silver cassette recorder
+- the brass key
+
+Treat these as three separate persistent story objects and preserve the appearance of each whenever shown.
+```
+
+Composite references must be defined **before asset creation**.
+
+Every item should be:
+
+- Clearly visible
+- Visually separated where practical
+- Explicitly named in the Global Prompt/reference mapping
+
+------------------------------------------------------------------------
+
+## 6. Character Definition
+
+Character planning should remain minimal during pre-production.
+
+The purpose is to select an appropriate reusable character from the
+character bank and prepare their clothing.
+
+Define only what is needed, such as:
+
+- Name
+- Approximate age, when relevant
+- Gender/presentation, when relevant
+- Very brief story role
+- Physical characteristics only when critical to the story
+
+Do **not** unnecessarily define:
+
+- Race/ethnicity
+- Hairstyle
+- Body type
+
+These should normally remain open so an appropriate existing character
+can be selected.
+
+Character personality, relationships, mannerisms, accent, behaviour, and
+performance direction belong primarily in the **Global Prompt**.
+
+------------------------------------------------------------------------
+
+## 7. Character Clothing Creation
+
+Each recurring character should receive a highly descriptive re-clothing
+image prompt where new wardrobe is required.
+
+The clothing prompt should preserve the existing character identity
+while changing the wardrobe.
+
+Describe:
+
+- Upper-body garments
+- Lower-body garments
+- Outerwear
+- Footwear
+- Accessories
+- Materials
+- Textures
+- Colours
+- Fit
+- Layering
+- Condition/wear
+- Weather suitability
+- Story-specific details
+
+Avoid unnecessary physical identity descriptions.
+
+Clothing should suit:
+
+- Character role
+- Scene
+- Time period
+- Weather
+- Production style
+- Story requirements
+
+------------------------------------------------------------------------
+
+## 8. Global Prompt
+
+The Global Prompt provides the shared semantic context for the complete
+prompt set.
+
+It is currently required **twice** by the workflow because the workflow
+cannot automatically reuse the same value.
+
+The two copies must be identical.
+
+### 8.1 Global Prompt Contents
+
+Include, where applicable:
+
+- Broad environment/scene description
+- Reference-image mapping
+- Character identity mapping
+- Additional asset mapping
+- Composite-reference definitions
+- Character personality
+- Temperament
+- Relationships
+- Mannerisms
+- Behaviour
+- Voice/accent
+- Speaking style
+- Clothing identity
+- General continuity rules
+- Broad environmental behaviour
+- Universal acting constraints
+- Universal camera constraints
+- Production style
+
+### 8.2 Production Style
+
+The Global Prompt should state the **style type concisely**, for
+example:
+
+- Classic cinematic
+- Modern cinematic
+- 1990s sitcom
+- Found footage
+- Mockumentary
+- Documentary
+- Reality television
+- Commercial/advertising
+- Infomercial
+- Home video/camcorder
+- CCTV/surveillance
+- Crime drama
+- Horror
+- Thriller
+
+Do not overload the Global Prompt with detailed shot-by-shot
+cinematography.
+
+Example:
+
+```text
+Style: 1990s British sitcom with natural ensemble comedy and period-appropriate television presentation.
+```
+
+Specific camera instructions belong in individual video sections.
+
+------------------------------------------------------------------------
+
+## 9. Camera Direction
+
+Camera direction is defined primarily **per section**.
+
+Each section may specify:
+
+- Camera position
+- Camera height
+- Viewpoint
+- POV
+- Framing
+- Subject focus
+- Camera movement
+- Reveal
+- Transition
+- Immediate view change
+- Ending camera state
+
+### 9.1 Useful Camera Position Bank
+
+Available approaches include:
+
+- Eye-level
+- Chest-level
+- Waist-level
+- Ground-level
+- Low-angle
+- High-angle
+- Overhead/top-down
+- Elevated wide
+- Distant observer
+- Side profile
+- Three-quarter front
+- Three-quarter rear
+- Direct frontal
+- Direct rear
+- Two-shot
+- Three-shot
+- Over-the-shoulder
+- Reverse over-the-shoulder
+- Dirty single
+- Clean single
+- Profile two-shot
+- Across-table
+- End-of-table
+- Close follow
+- Shoulder follow
+- Side follow
+- Front-facing follow
+- Rear tracking
+- Tabletop
+- Floor camera
+- Dashboard
+- Back seat
+- Doorway
+- Window
+- Inside cupboard/fridge/container
+- Security camera
+- Hidden observer
+
+### 9.2 Framing
+
+Useful framing includes:
+
+- Extreme close-up
+- Close-up
+- Head-and-shoulders
+- Medium close-up
+- Medium shot
+- Medium-wide
+- Cowboy shot
+- Three-quarter body
+- Full body
+- Wide
+- Extreme wide
+
+### 9.3 Movement
+
+Useful movement includes:
+
+- Locked/static
+- Pan
+- Tilt
+- Push in
+- Pull out
+- Dolly
+- Truck
+- Tracking
+- Follow
+- Orbit
+- Arc
+- Rise
+- Descend
+- Fly-in
+- Fly-out
+- Whip-pan
+- Handheld
+- Gentle handheld
+- POV head movement
+- Follow eyeline
+- Follow pointing gesture
+- Turn toward sound
+- Pull-back reveal
+
+------------------------------------------------------------------------
+
+## 10. First-Person / POV
+
+A section may switch into a character's first-person viewpoint.
+
+Example:
+
+```text
+Immediately begin from Bill's first-person point of view. The camera is positioned at Bill's eye level looking toward Nancy.
+```
+
+When using character POV:
+
+- The POV character should normally not appear fully in front of the
+camera.
+- Hands/arms/body may enter frame naturally.
+- Reflections are an explicit exception.
+- Other characters may look directly into the lens when they are
+actually looking at or speaking to the POV character.
+
+This overrides a general "characters never look at camera" rule where
+logically necessary.
+
+------------------------------------------------------------------------
+
+## 11. Chained Camera Continuity
+
+A new JSON section is **not automatically a new shot or camera cut**.
+
+By default, assume the next block continues from the incoming video's
+starting frame/state.
+
+Use continuity-aware language such as:
+
+```text
+Continuing naturally from the starting frame...
+```
+
+If the camera continues naturally:
+
+```text
+Continuing from the starting frame, the camera remains beside Bill and begins moving slowly around him toward Nancy.
+```
+
+If the section must immediately begin from a different view, explicitly
+state this at the start:
+
+```text
+Immediately change to Nancy's first-person point of view...
+```
+
+or:
+
+```text
+Begin this section from a new low-angle position beside the table...
+```
+
+Do not assume MiniMax will infer a deliberate camera change simply
+because a new generation block has started.
+
+------------------------------------------------------------------------
+
+## 12. Persistent Continuity State
+
+Every generation block has to be told about important state changes that
+differ from the original references or original scene.
+
+### Example
+
+If Bill's character reference shows him wearing a jacket and he removes
+it in section 3:
+
+Section 4 and every relevant later section should state:
+
+```text
+Bill had previously removed his jacket and remains without it.
+```
+
+Do not rely solely on the incoming video's final frame.
+
+### 12.1 Track Persistent Changes To
+
+- Clothing
+- Accessories
+- Hair/appearance changes caused during the story
+- Wetness/dirt/damage
+- Injuries or visible marks
+- Held objects
+- Prop ownership
+- Object position
+- Furniture position
+- Open/closed doors
+- Broken objects
+- Vehicle state
+- Drinks/food state
+- Character position when spatially important
+- Environmental changes
+- Lighting/weather changes
+- Any state that conflicts with the original reference image
+
+### 12.2 Continuity Ledger
+
+While designing the set, maintain a continuity ledger containing:
+
+- Character clothing state
+- Character position
+- Character physical state
+- Held objects
+- Prop ownership
+- Important object states
+- Environment state
+- Relevant emotional/story state
+- Camera position
+- Camera viewpoint
+
+Each new section should be written from the current ledger.
+
+------------------------------------------------------------------------
+
+## 13. Reference Priority
+
+The intended priority is:
+
+### Reference Images
+
+Define:
+
+- Character identity
+- Base character design
+- Asset design
+- Vehicle design
+- Prop design
+- Environment design where supplied
+
+### Current Video + Current Prompt
+
+Define:
+
+- Current state
+- Current clothing changes
+- Current object state
+- Current position
+- Current action
+- Current environment changes
+- Current camera state
+
+If the story deliberately changes something from the original reference,
+the current prompt should explicitly reinforce that changed state.
+
+------------------------------------------------------------------------
+
+## 14. Dialogue
+
+For multi-character sequences:
+
+- Explicitly name the speaker for each line.
+- Keep dialogue appropriate to the available block duration.
+- State important pauses/reactions where required.
+- Specify silence when incorrect dialogue assignment is a realistic
+risk.
+- Preserve established accents and speaking styles through the Global
+Prompt.
+
+Example:
+
+```text
+Bill leans forward and asks, "Do you think it's time?"
+
+Becca exhales before replying, "I don't know. We normally wait till sunset."
+```
+
+------------------------------------------------------------------------
+
+## 15. Initial Video Prompt
+
+The Initial Video Prompt establishes the first generated block.
+
+It should contain:
+
+- Starting composition
+- Character positions
+- Initial actions
+- Dialogue
+- Body language
+- Camera position
+- Camera movement
+- Environmental activity
+- Relevant sound/ambience
+- Ending action/state that leads naturally into extension 01
+
+The **Global Prompt is supplied alongside the Initial Video Prompt**.
+
+------------------------------------------------------------------------
+
+## 16. JSON Extension Structure
+
+Baseline structure:
+
+```json
+{
+ "defaults": {
+ "duration_seconds": 10,
+ "steps": 8
+ },
+ "shots": [
+ {
+ "id": "existing_video_extension_01",
+ "prompt": [
+ "Continuing naturally from the starting frame..."
+ ],
+ "seed": "SEED_VALUE"
+ }
+ ],
+ "prompt_prefix": [
+ "GLOBAL/REFERENCE INSTRUCTIONS"
+ ]
+}
+```
+
+### 16.1 Extension IDs
+
+Use sequential IDs:
+
+```text
+existing_video_extension_01
+existing_video_extension_02
+existing_video_extension_03
+...
+```
+
+### 16.2 Number of Sections
+
+The number of extensions depends on the requested story.
+
+Ten extensions may be used for a longer set, but this is not a fixed
+requirement unless requested.
+
+### 16.3 Per-Section Duration
+
+The workflow supports custom duration per extension.
+
+**Exact JSON syntax: TBD.**
+
+Until supplied, do not invent the property.
+
+------------------------------------------------------------------------
+
+## 17. Prompt Prefix
+
+The JSON `prompt_prefix` contains shared reference/global instructions
+required by the extension loop.
+
+Example with three characters:
+
+```json
+"prompt_prefix": [
+ "<Picture 1> is the environment and master scene reference, use this to establish the environment, spatial layout, lighting and overall scene.",
+ "",
+ "<Picture 2> is the primary full-body reference for Bill, use this as the primary reference for Bill's body proportions, overall appearance, hair and clothing.",
+ "<Picture 3> is a frontal facial reference for Bill, use this as a complementary reference for Bill's facial identity.",
+ "",
+ "<Picture 4> is the primary full-body reference for Nancy, use this as the primary reference for Nancy's body proportions, overall appearance, hair and clothing.",
+ "<Picture 5> is a frontal facial reference for Nancy, use this as a complementary reference for Nancy's facial identity.",
+ "",
+ "<Picture 6> is the primary full-body reference for Becca, use this as the primary reference for Becca's body proportions, overall appearance, hair and clothing.",
+ "<Picture 7> is a frontal facial reference for Becca, use this as a complementary reference for Becca's facial identity."
+]
+```
+
+The actual mapping must reflect the reference plan for the current
+production.
+
+------------------------------------------------------------------------
+
+## 18. Required Deliverable Order
+
+Every complete prompt-set response should be kept concise and delivered
+in this order.
+
+### PREP
+
+#### 1. Scene Overview
+
+- Premise
+- Broad story direction
+- Environment mode
+- Character count
+- Relevant time/weather/setting information
+
+#### 2. Character Selection
+
+- Minimal information required to select reusable characters
+
+#### 3. Re-Clothing Prompts
+
+- One copy-ready image prompt per character
+
+#### 4. Environment Creation
+
+- Only when using a referenced environment
+- One copy-ready environment image prompt
+
+#### 5. Extra Asset Creation
+
+- Props
+- Vehicles
+- Products
+- Composite reference sheets
+- Other required visual references
+
+#### 6. Reference Allocation
+
+- Exact Picture 1--7 mapping
+- Clearly state unused slots if any
+
+### VIDEO GENERATION
+
+#### 7. Global Prompt
+
+- Copy-ready
+- Contains global character/story/reference/style rules
+
+#### 8. Initial Video Prompt
+
+- Copy-ready
+- First generated block
+
+#### 9. JSON Extension Set
+
+- Copy-ready
+- Sequential chained continuation prompts
+- Persistent state restated as required
+
+#### 10. Global Prompt --- Workflow Copy
+
+- Exact duplicate of section 7
+
+------------------------------------------------------------------------
+
+## 19. Planning Rule
+
+The complete story should be planned **before finalising the asset
+requirements**.
+
+This ensures:
+
+- The environment contains required features.
+- Important props are created before generation.
+- Vehicles receive reference slots when necessary.
+- Composite sheets are planned efficiently.
+- Reference slots are not wasted.
+- Later sections do not suddenly require unavailable visual
+references.
+
+The user-facing deliverable should remain concise even though the
+complete sequence has been planned internally.
+
+------------------------------------------------------------------------
+
+## 20. Output Philosophy
+
+A MiniMax H3 prompt set should be:
+
+- Production-ready
+- Concise
+- Clearly sectioned
+- Easy to follow top-to-bottom
+- Explicit about creation jobs
+- Explicit about reference allocation
+- Copy-ready
+- Continuity-aware
+- Camera-aware
+- Efficient with reference slots
+- Designed around MiniMax H3's lack of semantic memory between
+generated clips
+
+Avoid:
+
+- Unnecessary explanation
+- Repeating the same instructions outside required workflow
+duplication
+- Overloading the Global Prompt with shot-specific camera directions
+- Assuming previous prompt context is remembered
+- Assuming a new extension automatically creates a camera cut
+- Introducing important assets after reference planning is complete
+
+------------------------------------------------------------------------
+
+## 21. Current Defaults
+
+ -----------------------------------------------------------------------
+ Setting Default
+ ----------------------------------- -----------------------------------
+ Maximum block duration 10 seconds
+
+ Steps 8
+
+ Maximum consistent characters 3
+
+ Character reference images 2 per consistent character
+
+ Total reference slots 7
+
+ Environment reference Optional
+
+ Camera direction Per section
+
+ Production style Concise definition in Global Prompt
+
+ Persistent changed state Restated in every relevant
+ subsequent block
+
+ Per-section duration JSON field TBD
+ -----------------------------------------------------------------------
+
+------------------------------------------------------------------------
+
+## 22. Outstanding Workflow Detail
+
+The following remains to be added once supplied:
+
+- Exact JSON property and syntax for custom per-section duration.
+
+Once known, it should become part of the canonical JSON extension
+specification.