Fabrizio Bergamo

Real-Time FX & Tech Art

Kippy’s Escape – HoloLens 2

Diorama

Almost a couple of years ago, I was fortunate enough to work as a Technical Artist on this project at Framestore!
Kippy’s Escape is an open-source HoloLens 2 sample app built to show off the features of the new Mixed Reality UX Toolkit plugin for Unreal Engine.
It was an amazing experience, exciting and fun. I had the chance to build and experiment with various gameplay mechanics and FXs, as well as play around with procedural animations for the character and build shaders to express its emotions.


Highlights of the experience using the headset

Character Rig

Simple Bones to control the various body parts of the robot.
Most of the animations were done procedurally, controlling the bones in an animation Blueprint.
The project was done in Unreal Engine 4.25, before Control Rig features were implemented.
Walking, idle, and celebration animations.
Walking: blending between poses using a Blend Space asset.
Idle: Transform Bone nodes in the Animation Blueprint
Celebration: custom animation baked in Maya
ABP – graph for the idle animation
Expressions Animations (with audio🔊)
– ABP anims
– eyes, stickers and chest screen materials
– glow fx between body parts
Kippy’s eyes material.
The shapes are done with Sign Distance Fields and are animated using sign waves.
This allows a smooth transition animation from one expression to the other.
Eyes Material graph and functions used, open in a new window to zoom-in
(the resolution is not the best but it’s readable)
Kippy’s chest screen material parameters
Stickers Materials used for some of Kippy’s expressions
Cable technical interaction, physics, and gameplay with user’s hands
Bridge and island activation in engine animations
Explosion interaction with rubble and floating slates.
Floating slates idle animation done in engine.
Animation direction and intensity caused by the explosion are based on the location and proximity of the bomb.
Hint FX is activated when the user isn’t doing anything.
Interactivity FXs, the outline of the interactive meshes when looked at and scaling/outline animation when the hands are in the right position for the interaction
Islands initial placement lookdev and user interactions animations