Add 3D Characters into Real Life WAY Easier with Masking in Unreal Engine 5.8!
Dean Yurke - Unreal Engine and VFX Filmmaking
9,406 views
Add 3D Characters into Real Life WAY Easier with Masking in Unreal Engine 5.8.
In Episode 4 of my Composure series, Augmented Reality takes a huge leap forward in UE 5.8 as Composure introduces new Masking Passes. Project your actors onto simple geometry then use high quality 2D masks to create perfect edges for seamless 3D compositing!
Composure in 5.8 also includes a blur and erode pass for masks as well as a streamlined Media Track ingest. In this episode I cover the entire offline pipeline for adding CGI characters into live action plates, and with camera moves too!
Note - Camera Tracking and Magic Masks require DaVinci Resolve Studio (though blender has a free camera tracker and there are some Open Source AI roto options available too)
UPDATE - I made a bonus follow up video on how to render the shadows and beauty as separate passes for post production compositing - check out episode 5 here -
Render separate SHADOWS from Unreal Engine...
Time Stamps
0:00 Introduction to new masking in Unreal Engine 5.8
1:08 Scanning our location
3:24 Film our scene
3:52 DaVinci Resolve Matchmove and flatten plate
5:02 Magic mask for tracking
6:06 Camera Tracking in DaVinci Resolve Studio.
12:07 Color space transform (linear sRGB)
16:42 Bring 3D scan into Unreal Engine
18:11 Setup lighting in Unreal
19:09 Setup Sequencer and media track
21:22 Camera match move import
25:31 Setup 3D camera projections (Composure)
30:03 Adding CGI (the Alien)
30:35 Shadow and reflection catchers
33:56 Using Magic Mask for 2D masking
42:28 Multi-colored mats in Unreal
44:11 Adding masking passes
47:04 Using the Modeling Tab (Lattice)
53:05 Blur and erode masks in Unreal
56:41 Adjusting focal distance
1:01:52 Render with Movie Render Graph
Connect with me on your favorite Social Media
LinkedIn: deanyurke
Instagram: deanyurke
TikTok: deanyurke
Facebook: deanyurke
Twitter: deanyurke
✉️ For additional news, tips, setups and secret stuff, join my email list here - https://deanyurke.kit.com/
🎥 Binge Watch All My Content - Binge Watch All My Videos - Unreal Engine ...
-----------------------------------------------------------------------------------------
#UnrealEngine5 #VFX #virtualproduction
20 Comments
I'm really looking forward to the lesson on 3D videos! 😊
Add 3D Characters into Real Life WAY Easier with Masking in Unreal Engine 5.8!
Dean Yurke - Unreal Engine and VFX Filmmaking
9,406 views
Add 3D Characters into Real Life WAY Easier with Masking in Unreal Engine 5.8.
In Episode 4 of my Composure series, Augmented Reality takes a huge leap forward in UE 5.8 as Composure introduces new Masking Passes. Project your actors onto simple geometry then use high quality 2D masks to create perfect edges for seamless 3D compositing!
Composure in 5.8 also includes a blur and erode pass for masks as well as a streamlined Media Track ingest. In this episode I cover the entire offline pipeline for adding CGI characters into live action plates, and with camera moves too!
Note - Camera Tracking and Magic Masks require DaVinci Resolve Studio (though blender has a free camera tracker and there are some Open Source AI roto options available too)
UPDATE - I made a bonus follow up video on how to render the shadows and beauty as separate passes for post production compositing - check out episode 5 here -
Render separate SHADOWS from Unreal Engine...
Time Stamps
0:00 Introduction to new masking in Unreal Engine 5.8
1:08 Scanning our location
3:24 Film our scene
3:52 DaVinci Resolve Matchmove and flatten plate
5:02 Magic mask for tracking
6:06 Camera Tracking in DaVinci Resolve Studio.
12:07 Color space transform (linear sRGB)
16:42 Bring 3D scan into Unreal Engine
18:11 Setup lighting in Unreal
19:09 Setup Sequencer and media track
21:22 Camera match move import
25:31 Setup 3D camera projections (Composure)
30:03 Adding CGI (the Alien)
30:35 Shadow and reflection catchers
33:56 Using Magic Mask for 2D masking
42:28 Multi-colored mats in Unreal
44:11 Adding masking passes
47:04 Using the Modeling Tab (Lattice)
53:05 Blur and erode masks in Unreal
56:41 Adjusting focal distance
1:01:52 Render with Movie Render Graph
Connect with me on your favorite Social Media
LinkedIn: deanyurke
Instagram: deanyurke
TikTok: deanyurke
Facebook: deanyurke
Twitter: deanyurke
✉️ For additional news, tips, setups and secret stuff, join my email list here - https://deanyurke.kit.com/
🎥 Binge Watch All My Content - Binge Watch All My Videos - Unreal Engine ...
-----------------------------------------------------------------------------------------
#UnrealEngine5 #VFX #virtualproduction
UPDATE - I made a follow up video as I had a few viewers ask about exporting the shadows as a separate pass along with a beauty pass for post production compositing - https://youtu.be/HrAWf7b8vww