AI Generated Animation Video Steps

Releasing date：July 16, 2024

1. Consistent Character Design

Tool: FaceChain (Based on ModelScope)

Steps:

• Upload reference images and tags for the character.
• Train a LoRA style model to ensure consistency in the character's facial features and style.

2. Personalized Voice Generation for Characters

Tool: CosyVoice (Voice generation tool provided by ModelScope)

Steps:

• Set the character's voice sample.
• Input text to generate the character's personalized voice.

3. Motion Capture and Animation Production

3.1 Using Motion Capture Technology

Tool: DeepMotion (AI-driven motion capture)

Steps:

• Use DeepMotion to record and process the actor's motion capture data.
• Convert the captured data into usable 3D animation data.

3.2 Using Animation Production Software

Tool: Blender (Open-source 3D animation production tool)

Steps:

• Import the motion capture data into Blender.
• Apply the captured data to the 3D model for animation production.

4. Scene Design and Layout

Tools: DALL·E 2 (OpenAI's image generation tool), Unreal Engine (3D scene creation and rendering tool)

Steps:

• Use DALL·E 2 to generate scene background images.
• Create and render 3D scenes in Unreal Engine, combining the generated background images.

5. Integrating Animation and Sound

Tools: Adobe After Effects (Video post-production tool), DaVinci Resolve (Video editing and color grading software)

Steps:

• Integrate the character animations, background scenes, and generated sound effects.
• Use Adobe After Effects and DaVinci Resolve for video editing and compositing.

6. Dynamic Generation and Synthesis

Tool: DeepArt (AI image and video style transfer tool)

Steps:

• Use DeepArt to perform style transfer and optimization on images and videos to make animations smoother and more realistic.

7. Testing and Adjustment

Tools: Unreal Engine, Adobe After Effects, DaVinci Resolve

Steps:

• Perform real-time rendering and testing in Unreal Engine.
• Conduct multiple tests and adjustments in Adobe After Effects and DaVinci Resolve to ensure smooth animations, natural character appearance, and reasonable scene design.