Skip to content
Real-Time Avatars/Learn
End-to-End|GaussianMetaHumanVideo Gen

Learn Real-Time Avatar Technologies

Back to Research Survey
Complementary DossierEngine scan: UE 5.7

MetaHuman Full Architecture and Implementation

Complete end-to-end map of MetaHuman modules, functions, and integration details from this repo plus Unreal Engine plugin source.

Live Evolution Status

Cycle

11

Plugins / Modules

12 / 70

Source Files

2898

Dependency Edges

248

Current scope

  • UE root: G:\UE\UnrealEngine
  • Scan roots: 12
  • Includes core LiveLink plugin: yes
  • Generated at: 2026-02-19T04:27:25Z

Module type split

  • Editor modules: 40
  • Runtime modules: 26
  • UncookedOnly modules: 4
  • New plugins this cycle: 0

Generated Architecture Snapshot

Cycle

11

Generated

2026-02-19T04:27:25Z

UE Root

G:\UE\UnrealEngine

Internal Edges

248

PluginCategoryModulesType SplitLargest Modules

MetaHumanAnimator

G:\UE\UnrealEngine\Engine\Plugins\MetaHuman\MetaHumanAnimator

MetaHuman28Editor:22 | Runtime:6
MetaHumanCaptureProtocolStackMetaHumanCaptureSourceMetaHumanPerformanceMetaHumanCore

LiveLink

G:\UE\UnrealEngine\Engine\Plugins\Animation\LiveLink

Animation7Editor:1 | Runtime:3 | UncookedOnly:3
LiveLinkLiveLinkEditorLiveLinkMovieSceneLiveLinkComponents

MetaHumanCharacter

G:\UE\UnrealEngine\Engine\Plugins\MetaHuman\MetaHumanCharacter

MetaHuman7Editor:4 | Runtime:3
MetaHumanCharacterEditorMetaHumanCharacterPaletteMetaHumanCharacterPaletteEditorMetaHumanDefaultPipeline

MetaHumanLiveLink

G:\UE\UnrealEngine\Engine\Plugins\MetaHuman\MetaHumanLiveLink

MetaHuman7Editor:3 | Runtime:4
MetaHumanLocalLiveLinkSourceLiveLinkFaceSourceMetaHumanLocalLiveLinkSourceEditor

Generated Dependency Graph (Plugin-Level)

End-to-End Realtime Control Path

Browser (/rapport)
  -> Next.js API (/api/metahuman/control)
  -> Editor bridge (/v1/command @ 127.0.0.1:8788)
  -> Unreal HTTPServer (/pajama/control @ 127.0.0.1:5189)
  -> Actor tag lookup (PajamaMetaHuman)
  -> UPajamaMetaHumanControllerComponent
  -> SkeletalMesh morph targets + actor head pose
Source roots used: metahuman/avatar01, metahuman/editor-bridge, web/app/api/metahuman/control/route.ts, and G:/UE/UnrealEngine/Engine/Plugins/MetaHuman.

UE 5.7 Plugin Inventory

LiveLink7 modules

Base Live Link framework that MetaHumanLiveLink builds on for subjects, components, and sequencer tracks.

Engine/Plugins/Animation/LiveLink/LiveLink.uplugin

View modules
LiveLinkLiveLinkEditorLiveLinkComponentsLiveLinkMovieSceneLiveLinkGraphNodeLiveLinkSequencerLiveLinkMultiUser
MetaHumanAnimator28 modules

Animator toolkit: capture, solving, performance, speech-to-face, and batch workflows.

Engine/Plugins/MetaHuman/MetaHumanAnimator/MetaHuman.uplugin

View modules
MetaHumanCoreMetaHumanCoreEditorMetaHumanImageViewerEditorMetaHumanPipelineMetaHumanFaceContourTrackerMetaHumanFaceContourTrackerEditorMetaHumanIdentityMetaHumanIdentityEditorMetaHumanCaptureDataEditorMetaHumanCaptureSource

Function-Level Map

ComponentMethodsImplementation role

PajamaRealtimeControl (repo plugin)

metahuman/avatar01/Plugins/PajamaRealtimeControl/.../PajamaRealtimeControlModule.cpp

StartupModule, HandleControl, ParsePayload, ApplyPayloadOnGameThreadStarts UE HTTP routes, parses control payload, and dispatches morph/head changes to game thread.

UPajamaMetaHumanControllerComponent

metahuman/avatar01/Plugins/PajamaRealtimeControl/.../PajamaMetaHumanControllerComponent.cpp

CollectControlledMeshes, ApplyMorphTargets, ApplyHeadPose, ResetMorphTargetsApplies morph target values and head pose to selected skeletal meshes/owner actor.

Next.js proxy route

web/app/api/metahuman/control/route.ts

GET, POSTForwards browser calls to bridge health/command endpoints with optional bearer token.

Bridge server

metahuman/editor-bridge/server.mjs

GET /health, POST /v1/commandToken-gated HTTP bridge from web layer to local Unreal plugin endpoints.

Live Link face source

Engine/Plugins/MetaHuman/MetaHumanLiveLink/Source/LiveLinkFaceSource/Private/LiveLinkFaceSource.cpp

Connect, OnDataReceived, ProcessPacket, PushStaticData

Control Payload Contract

{
  "targetActorTag": "PajamaMetaHuman",
  "preset": "smile",
  "strength": 1.0,
  "morphTargets": {
    "mouthSmileLeft": 0.6,
    "mouthSmileRight": 0.6,
    "jawOpen": 0.2
  },
  "headYaw": 8,
  "headPitch": -3,
  "headRoll": 0
}

Health endpoints

  • GET /api/metahuman/control (web proxy health)
  • GET /health (bridge health)
  • GET /pajama/health (UE plugin health)

Runtime thread boundary

UE plugin receives HTTP off-thread and marshals actor/morph application onto game thread via AsyncTask(ENamedThreads::GameThread).

Implementation Runbook

  1. Open metahuman/avatar01/avatar01.uproject in UE 5.7.
  2. Ensure actor has tag PajamaMetaHuman and component UPajamaMetaHumanControllerComponent.
  3. Start bridge: cd metahuman/editor-bridge && node server.mjs.
  4. Set web env to bridge endpoints (METAHUMAN_CONTROL_ENDPOINT, METAHUMAN_CONTROL_HEALTH_ENDPOINT).
  5. Run web app and use /rapport control panel.

Official References

MetaHuman documentation hubMetaHumans in Unreal EngineMetaHuman Component for Unreal EngineRealtime Animation Using Live Link

Full Markdown Dossier

The same architecture report is also available as a markdown document for offline review and versioning.

Open markdown version
MetaHumanLiveLinkSource

MetaHumanCoreTechLib

G:\UE\UnrealEngine\Engine\Plugins\MetaHuman\MetaHumanCoreTechLib

MetaHuman5Editor:2 | Runtime:3
MetaHumanCoreTechLibMetaHumanPipelineCoreMetaHumanCoreTechMetaHumanCaptureData

RigLogic

G:\UE\UnrealEngine\Engine\Plugins\Animation\RigLogic

Animation5Editor:1 | Runtime:3 | UncookedOnly:1
RigLogicLibRigLogicLibTestRigLogicModuleRigLogicEditor

DNACalib

G:\UE\UnrealEngine\Engine\Plugins\Animation\DNACalib

Animation3Runtime:3
DNACalibLibDNACalibModuleDNACalibLibTest

MetaHumanCalibrationProcessing

G:\UE\UnrealEngine\Engine\Plugins\MetaHuman\MetaHumanCalibrationProcessing

MetaHuman3Editor:3
MetaHumanCalibrationLibMetaHumanCalibrationCoreMetaHumanCalibrationGenerator

MetaHumanSDK

G:\UE\UnrealEngine\Engine\Plugins\MetaHuman\MetaHumanSDK

MetaHuman3Editor:2 | Runtime:1
MetaHumanSDKEditorMetaHumanSDKRuntimeInterchangeDNA

MetaHumanCalibrationDiagnostics

G:\UE\UnrealEngine\Engine\Plugins\Experimental\MetaHuman\MetaHumanCalibrationDiagnostics

MetaHuman1Editor:1
MetaHumanCalibrationDiagnostics

MetaHumanCharacterUAF

G:\UE\UnrealEngine\Engine\Plugins\Experimental\MetaHuman\MetaHumanCharacterUAF

MetaHuman1Editor:1
MetaHumanCharacterUAFEditor

MetaHumanRuntime

G:\UE\UnrealEngine\Engine\Plugins\Experimental\MetaHuman\MetaHumanRuntime

Other0n/a
DNACalibLiveLinkMetaHumanAn...MetaHumanCa...MetaHumanCa...MetaHumanCh...MetaHumanCh...MetaHumanCo...MetaHumanLi...MetaHumanRu...MetaHumanSDKRigLogic
From PluginTo PluginEdge CountKinds
MetaHumanAnimatorMetaHumanCoreTechLib35PrivateDependencyModuleNames, PublicDependencyModuleNames
MetaHumanCharacterMetaHumanSDK10PrivateDependencyModuleNames, PublicDependencyModuleNames
MetaHumanLiveLinkMetaHumanCoreTechLib9PrivateDependencyModuleNames
MetaHumanAnimatorRigLogic8PrivateDependencyModuleNames, PublicDependencyModuleNames
DNACalibRigLogic4PrivateDependencyModuleNames, PublicDependencyModuleNames
MetaHumanAnimatorMetaHumanSDK4PrivateDependencyModuleNames, PublicDependencyModuleNames
MetaHumanCharacterMetaHumanAnimator4PrivateDependencyModuleNames
MetaHumanCharacterMetaHumanCoreTechLib4PrivateDependencyModuleNames, PublicDependencyModuleNames
MetaHumanCharacterRigLogic4PrivateDependencyModuleNames, PublicDependencyModuleNames
MetaHumanCalibrationProcessingMetaHumanCoreTechLib3PrivateDependencyModuleNames
MetaHumanCharacterUAFMetaHumanCharacter3PublicDependencyModuleNames
MetaHumanLiveLinkLiveLink3PrivateDependencyModuleNames, PublicDependencyModuleNames
MetaHumanFootageIngest
MetaHumanDepthGenerator
MetaHumanPerformance
MetaHumanSequencer
MetaHumanCaptureUtils
MetaHumanCaptureProtocolStack
MetaHumanToolkit
MetaHumanSpeech2Face
MetaHumanBatchProcessor
MetaHumanConfig
MetaHumanConfigEditor
MetaHumanFaceAnimationSolver
MetaHumanFaceAnimationSolverEditor
MetaHumanFaceFittingSolver
MetaHumanFaceFittingSolverEditor
MetaHumanPlatform
MetaHumanControlsConversionTest
MeshTrackerInterface
MetaHumanCharacter7 modules

Character asset model and assembly pipeline with runtime + editor tooling.

Engine/Plugins/MetaHuman/MetaHumanCharacter/MetaHumanCharacter.uplugin

View modules
MetaHumanCharacterEditorMetaHumanCharacterMetaHumanCharacterPaletteEditorMetaHumanCharacterPaletteMetaHumanDefaultPipelineMetaHumanDefaultEditorPipelineMetaHumanCharacterMigrationEditor
MetaHumanCoreTech5 modules

Core tech libraries, image/capture utilities, and generic pipeline runtime.

Engine/Plugins/MetaHuman/MetaHumanCoreTechLib/MetaHumanCoreTech.uplugin

View modules
MetaHumanCoreTechLibMetaHumanCoreTechMetaHumanImageViewerMetaHumanCaptureDataMetaHumanPipelineCore
MetaHumanLiveLink7 modules

Realtime capture/stream source stack for face and local media sources.

Engine/Plugins/MetaHuman/MetaHumanLiveLink/MetaHumanLiveLink.uplugin

View modules
MetaHumanLiveLinkSourceMetaHumanLiveLinkSourceEditorLiveLinkFaceSourceLiveLinkFaceSourceEditorLiveLinkFaceDiscoveryMetaHumanLocalLiveLinkSourceMetaHumanLocalLiveLinkSourceEditor
MetaHumanSDK3 modules

Runtime component integration and editor import/verification pipeline.

Engine/Plugins/MetaHuman/MetaHumanSDK/MetaHumanSDK.uplugin

View modules
MetaHumanSDKEditorMetaHumanSDKRuntimeInterchangeDNA
MetaHumanCalibrationProcessing3 modules

Calibration generator/core/lib for multi-camera solving and robust feature matching.

Engine/Plugins/MetaHuman/MetaHumanCalibrationProcessing/MetaHumanCalibrationProcessing.uplugin

View modules
MetaHumanCalibrationGeneratorMetaHumanCalibrationLibMetaHumanCalibrationCore
Connects to device control channel and ingests UDP face packets into Live Link subjects.

Live Link subject settings

.../MetaHumanLiveLinkSource/Public/MetaHumanLiveLinkSubjectSettings.h

PreProcess, CaptureNeutrals, CaptureNeutralFrame, CaptureNeutralHeadPoseCalibration/smoothing/neutrals/head-pose preprocessing for realtime frame streams.

Local source subject worker

.../MetaHumanLocalLiveLinkSource/Public/MetaHumanLocalLiveLinkSubject.h

Run, FrameComplete, ProcessComplete, PushFrameDataFRunnable worker that executes local processing pipeline and emits Live Link frames.

Pipeline runtime

.../MetaHumanPipelineCore/Public/Pipeline/Pipeline.h

MakeConnection, Run, Cancel, IsRunningNode graph orchestration with push/pull execution modes and completion delegates.

Speech-to-animation node

.../MetaHumanPipelineCore/Public/Nodes/RealtimeSpeechToAnimNode.h

Start, Process, End, SetMood, SetLookaheadAudio-driven realtime animation node in pipeline graph.

MetaHuman component runtime

.../MetaHumanSDKRuntime/Public/MetaHumanComponentBase.h

LoadAndRunAnimBP, PostInitAnimBP, PostConnectAnimBPVariablesWires MetaHuman body/face settings into anim BP variables and runtime component setup.

Speech2Face API

.../MetaHumanAnimator/Source/MetaHumanSpeech2Face/Public/Speech2Face.h

Create, SetMood, SetMoodIntensity, GenerateFaceAnimationProduces RigLogic control animation from speech audio.

Calibration wrappers

.../MetaHumanCalibrationLib/Public/MetaHumanStereoCalibrator.h

Init, AddCamera, DetectPattern, Calibrate, ExportCalibrationsStereo calibration and export pipeline for capture rigs.

Robust matcher wrappers

.../MetaHumanCalibrationLib/Public/MetaHumanRobustFeatureMatcher.h

Init, AddCamera, DetectFeatures, GetFeaturesRobust multi-camera feature matching and triangulation retrieval.
MetaHuman Animator
Unreal API Plugin Index: MetaHuman
Unreal API Plugin Index: MetaHumanCharacter
Unreal API Plugin Index: MetaHumanLiveLink
Unreal API Plugin Index: MetaHumanCoreTech
Unreal API Plugin Index: MetaHumanSDK
Unreal API Plugin Index: MetaHumanCalibrationProcessing
Unreal API Plugin Index: LiveLink
EpicGames MetaHuman DNA Calibration (GitHub)