Virtual Production (8/21)

Virtual Production Resources - Shaun Foster

Get Started. It's Free
or sign up with your email address
Virtual Production (8/21) by Mind Map: Virtual Production    (8/21)

1. Unreal Virtual Production Tools

1.1. Unreal Roadmap

1.1.1. Switchboard (roadmap app)

1.1.2. Level Snapshot 4.27

1.2. Previsualization

1.2.1. CineTracer (beta)

1.2.2. Variant Manager

1.2.3. Virtual Scouting

1.3. Sequencer

1.3.1. Getting Started (video chapter)

1.3.2. Linear Editing

1.3.3. (NLE) Non-Linear Editor

1.3.4. Output & Render Passes

1.4. Multi-User Editing

1.4.1. Collab Viewer (VR)

1.5. nDisplay (multi-display rendering)

1.5.1. Configuration Viewer

1.6. Pixel Mapper

1.6.1. DMX Pixel Map Matching to LEDs

1.7. Composure (Compositing)

1.7.1. Projections

1.7.2. Green Screen

1.7.3. Tutorial

1.8. Post Process Volumes

1.8.1. Open Color IO

1.8.2. Color Management Open Color IO Doc

1.8.3. Look Up Tables (LUTs) for color grading

1.8.4. Note: Turn OFF any Screen Space PP controls for InCamera VFX

1.8.5. Tone Mapping

1.8.5.1. ACES Standard

1.9. Optimization

1.9.1. Virtual Textures (RVT / SVT)

1.9.1.1. (SVT) Streaming Virtual Textures

1.9.1.2. (RVT) Runtime Virtual Texturing

1.9.2. World Partition (UE5)

1.9.2.1. Data Layers

1.9.2.2. HLODs

1.9.2.3. Level Instancing

1.9.3. Level Streaming

1.9.4. Performance & Profiling

1.9.4.1. Insights (advanced tool)

1.10. Audio

1.10.1. External Capture Sync & Integration

1.10.2. Unreal Audio

1.10.2.1. Audio Synesthesia

1.10.2.2. Spatialized (Virtual Space)

1.10.2.3. Audio Mixer (and subMixes)

1.10.2.4. Convolution Reverb

1.10.2.5. MetaSounds (UE5)

1.11. LiveLink

2. (VAD) Virtual Art Department

2.1. Organization

2.1.1. Naming Conventions

2.1.2. Version Control

2.1.2.1. Github

2.1.2.2. Perforce

2.1.2.3. SVN

2.1.3. USD

2.1.3.1. USD Live Actor & Stage Importer

2.1.4. DataSmith

2.2. Props

2.2.1. Quixel

2.2.2. Unreal Marketplace

2.2.3. 3D Modelers / Sculptors

2.2.4. Parametric tools

2.2.5. Sketchfab

2.2.6. Photogrammetry / LiDAR Scans

2.2.6.1. Capturing Reality

2.3. 3D Sets

2.3.1. Virtual Worlds

2.3.1.1. Sky Atmosphere

2.3.1.2. Landmass

2.3.1.3. Water

2.3.2. Texture Streaming

2.3.2.1. Virtual Texture Streaming

2.3.2.1.1. Unreal Docs

2.3.2.1.2. Live Unreal Demo

2.3.3. Unreal 5 (Emerging)

2.3.3.1. UE5 "MegaAssemblies"

2.3.3.2. Lumen (Lighting UE5)

2.3.3.3. Nanite (Streaming Geometry)

2.3.3.4. Chaos Physics

2.3.4. AI Layout

2.3.4.1. Promethian AI

2.4. Volumetrics

2.4.1. Volumetric Capture

2.4.1.1. EF-EVE

2.4.1.2. Mantis Vision

2.5. LiDAR

2.6. VFX

2.6.1. Niagara

2.6.2. Chaos Physics

2.6.3. Material FX

2.6.3.1. Asset Store (examples)

3. Resources & News

3.1. Unreal "Up to Speed" Resources Videos

3.2. Unreal VP Field Guides

3.2.1. Virtual Production Field Guide I

3.2.2. Virtual Production Field Guide II

3.3. Unreal Virtual Production Facebook

3.4. Unreal Film & TV YouTube Playlist

3.5. Terminology Document

3.6. Virtual Production Companies List

3.7. Google Search

3.8. EXAMPLE Levels

3.8.1. Content Examples

3.8.2. InCamera VFX Template

3.8.3. Face AR Sample

3.8.3.1. See also (Tracking Tools / Live Link)

3.8.4. Virtual Camera

3.8.5. Virtual Camera (Marketplace)

3.8.6. Virtual Studio

3.8.6.1. Key UE Plugins for "Cross talk"

3.8.6.1.1. Software

3.8.6.1.2. Hardware

3.9. Unreal Learning Portal Learning Path

3.9.1. Virtual Production Syllabus by Deepak Chetty

3.10. Shaun Foster: YouTube Channel

3.11. Virtual Production Events

3.11.1. RTC (Real Time Conference)

3.11.2. I'll add to this as more emerge!

4. Tracking Tools

4.1. Simul Cam / VCam / & Tracking Tools

4.1.1. VP Focused Tracking Solutions

4.1.1.1. AntiLatency

4.1.1.2. EZ Track

4.1.1.3. Mo-Sys "Star Tracker"

4.1.1.4. Ncam

4.1.1.5. OptiTrack

4.1.1.6. Stype RedSpy

4.1.1.7. Vanishing Point XYZ

4.1.1.8. Vicon

4.1.2. AR Phone/Tablet Camera

4.2. VR Vive Tracking Tools / Mixed Reality / Virtual Scouting

4.2.1. Unreal + Vive

4.2.1.1. Timed Data Monitor

4.2.2. VR Tracking

4.2.2.1. Vive Trackers

4.2.2.1.1. Vive Tracker 3.0

4.2.3. Virtual Scouting

4.3. Motion Capture

4.3.1. Facial Mocap

4.3.1.1. Unreal Facial Capture

4.3.1.2. Faceware Studio

4.3.1.3. GlassBox Live Client

4.3.1.4. RealIllusion

4.3.2. Body Mocap

4.3.2.1. Motion Capture List Google Sheet

4.3.3. Unreal Live Link

4.3.4. Hand Tracking

4.3.4.1. Manus-VR

4.3.4.2. Rokoko Smart Gloves

5. Hardware Cross Talk (XR)

5.1. Professional Video I/O

5.1.1. AJA

5.1.1.1. Quickstart

5.1.1.2. Media Reference

5.1.2. Black Magic

5.1.2.1. Quickstart

5.1.2.2. Media Reference

5.1.3. Gen Lock / Frame Synch

5.1.3.1. Quadro/A6000/A5000/A4000

5.1.3.1.1. Mosiac

5.1.3.1.2. Sync

5.1.3.2. Master Clock System

5.1.3.3. Ambient

5.1.3.3.1. TheLockit

5.1.4. Camera Meta-Data

5.2. Unreal Web Remote Control

5.3. DMX

5.4. OSC

5.4.1. OSC Unreal Plugin

5.5. Open Source

5.5.1. Kino Wheels

5.5.2. DOGHUT Vcam OSC Based Cam Setup

5.5.3. Arduino - Microprocessor XR Integration

5.5.3.1. Pixel Prof's Tutorial(s)

5.6. Other Accessories

5.6.1. Lens Encoder

6. Smart Stage / Volume

6.1. Lighting

6.1.1. Virtual Lighting

6.1.1.1. IES Profiles

6.1.2. On-Set Lighting

6.1.3. DMX (also see 4.26 Switchbaord)

6.2. Set-Up

6.2.1. "Brain Bar" (ILM term)

6.2.2. Physical Set

6.3. Audio

6.4. LED Walls

6.4.1. PRG

6.4.2. Processing for LEDs

6.4.2.1. Example: HELIOS

6.5. Facilities Examples

6.5.1. Nant Studios

6.5.1.1. Announce

6.5.1.2. 7/21 Blog Post

6.5.2. PixoMondo

6.6. Green Screen

6.7. Miniatures

6.8. Drone Integration

6.9. Projections

6.9.1. Light Interact Projection

6.9.2. Dome Projection

6.9.3. VIOSO

6.10. MoCo (motionControlled) Integration

6.10.1. Example: MRMC Rigs + LiveLink