Cubic Motion is the world leader in real-time model-based computer vision and digital animation, bringing extraordinary characters to life across video games, films, broadcast media, and immersive technologies. Unafraid of the unexpected and sometimes unnerving, our team fuses science and artistry in a mysterious alchemy of their own creation, making us the world leader in real-time model-based computer vision and digital animation.
WHERE CREATIVITY MEETS SCIENCE
Persona paves the way for a new era in live digital facial performance, one where human actors, digital characters and audiences can co-exist and interact. This is because Persona captures and translates an actor’s performance onto their digital counterpart, in real-time. Designed from the ground up for live performance, Persona enables immediate character animation in real-time engines such as Epic’s Unreal 4.
WHAT IS PERSONA
Persona is powered by Cubic Motion’s high fidelity, facial animation technologies. Technologies that have been proven at a host of live events including GDC and FMX and that won the 2016 Siggraph award for Real-Time Live. These advanced, proprietary computer vision techniques allow Persona to accurately capture an actor’s performance with stunning detail in order to bring digital characters to life.
The result is a system that can deliver animated characters who respond and engage with real-world events immediately, and whose performance may be interwoven with human actors. Providing a faithful reproduction of the actor’s performance whether for immediate broadcast at a live event or for character previsualisation during capture.
Persona supports multiple actors each wearing a bespoke Helmet-Mounted Camera (HMC) and on-body animation system facilitating a completely untethered performance. This allows the actor to move freely around the stage or performance volume.
The Persona HMC system is Cubic Motion’s proprietary design. It is optimised for comfort, stability and ease of use allowing Persona to deliver superb results over prolonged periods.
Persona‘s HMC carries Cubic Motion’s signature front-facing and profile camera configuration. This works in conjunction with the inbuilt infrared lighting to ensure the unambiguous recovery of even the most subtle mouth shapes and poses under a variety of environmental conditions.
The facial performance is captured and solved onto the character by the ‘Performance Pipeline’, an on-body computing appliance that is the heart of every actor’s setup. Each Performance Pipeline is simple to configure using our Identity System. This ensures a faithful representation of the actor’s performance is acquired and that an engaging and intimate portrayal of the character is delivered.
The Performance Pipeline also provides a full capture capability so that all video and animation data can be reused after the event or polished and finessed before final broadcast.
The pipeline is lightweight and battery powered. It may be tethered or wireless and comes with a flexible harness system giving uninhibited freedom to direct actors.
Performance Manager is a GUI application that allows operators to oversee all performances. It provides the ability to configure and monitor every aspect of an actor’s performance from a remote interface. Actors are automatically discovered by Performance Manager and single instance can be used to manage multiple actors simultaneously.
Cubic Motion’s Identity System allows a purpose-built tracking model for the actor to be matched with a bespoke solver model for the character rig. This is in a form that is ready to be used by Persona.
The Identities are constructed using state of the art machine learning algorithms. These analyse the appearance of the actor and the capabilities of the character rig in order to specifically tailor Persona for every unique human and digital character pairing.
Let your digital characters take center stage
Free your game and movie characters from the confines of their digital worlds. With Persona they can explode onto the stage at your next live event.
Connect with fans on social media
Let a human actor portray your digital character and make them interactive, responding and engaging to fans in real-time conversations. Use Persona to create short video replies from your characters or even host a live AMA event online!
Reuse your existing game and movie assets
Persona is able to drive a variety of digital character assets and rigs. You may not be far from seeing your character face-to-face.
Nothing like the real thing
With the astonishing fidelity that Persona provides it’s ready to drive the very best in digital humans. Why not fill your stage with famous faces including those no longer with us?
See what’s coming
Persona is not just the future of live digital performance but is also changing performance capture today as the perfect character previsualisation solution. Don’t just monitor a video of the actor, let Persona show you the character perform. Record both video and animation to ensure you leave the session with the complete performance ready for immediate review.
Cubic Motion is led by a team of award-winning PhD scientists, animation specialists and producers. We license our products and services for real-time visual tracking and animation in video games, films, broadcast media, virtual and augmented reality.
Cubic Motion’s proprietary technology and pipeline accepts video input from multiple capture types, single-camera HMC, stereo-camera HMC, 4D data, and depth cameras.
We track and analyze the video data at ultra-high density meaning all nuances of a performance are captured, and then our ever-evolving solving technology allows our Production team to produce top quality and high volume, critical factors required for AAA video games.
With our experienced and talented Production team of over 60 artists we continue to enable game developers to realize their characters.
Our team has vast experience solving to all types of facial rig, and can provide detailed and valuable feedback during production to support the client leading to the highest possible quality being achieved.
We deliver projects in all the leading animation packages such as Autodesk’s Maya.
Cubic Motion has developed a unique and unrivaled pipeline for quality and incredibly high volumes. For too long the games industry has ‘put up with’ procedurally driven facial animation, poor quality lip-sync and void of emotion. With Cubic’s Audio Pipeline the developer need only record the actor’s VO, we do the rest.
We record the facial acting performance at our professional studio in Manchester, using our acting talent, and our award-winning real-time facial pipeline to produce volumes of animation not seen before in the industry. The animation is then passed to our highly talented animation crew leading to high-quality animation that has all the necessary emotion for each line of dialogue.
Cubic Motion has recently expanded into full character animation, taking the client’s motion capture data and adding all the necessary fidelity required for body motion. We work closely with our clients and iterate to reach AAA quality.
To really push the quality of character performances it is necessary to judge the final result in full context, therefore Cubic Motion offers an additional service of integrating facial animation into the client’s scene with body and camera data. We can then deliver the AAA shippable result ensuring each character’s performance works in the context of the final cinematic
Cubic Motion is able to integrate all performance animation into the client’s game engine for final review, this leads to closer collaboration and pushes the quality even further. We have experience using Unreal, Unity, and proprietary game engines.
Our experienced Production team can design and deliver FACS-based facial rigs constructed via multiple methods including joints, blend shapes, scan data, and wrinkle maps.
Performance Capture Support
Cubic Motion can attend Performance Capture shoots to ensure high-quality data is recorded, this includes the provision of our multi-camera head-mounted unit that is available for purchase or long-term rentals.
We can send animators to your location.
Our technology is applicable anywhere accurate measurement of complex objects is needed. Key applications include AR and VR, but the same methods can be applied across many domains, such as industrial inspection and medical image analysis.
AR and VR applications, gaze & blink detection, pupil dilation are all possible with highly accurate tracking.
WANT TO KNOW HOW CUBIC MOTION CAN HELP YOU WITH YOUR NEXT PROJECT?
Our high-fidelity facial animation has been seen across film, TV, video games and immersive media, including Call of Duty, Hellblade, Spider-Man, Kiss Me First, and many more.