Wētā FX & AWS unite to develop AI tools for VFX artists

Wētā FX and Amazon Web Services have entered into an agreement to develop artificial intelligence tools aimed at assisting visual effects artists. The companies plan to collaborate on a suite of AI-powered solutions designed to increase efficiency and support creativity across the visual effects production process.

Artist control

The partnership will focus on building tools that give artists greater control when working with AI and machine learning. Rather than relying on chatbots or basic text-based interactions, the new approach is intended to offer natural interfaces that enable users to orchestrate complex systems. The tools will be developed with the intention of allowing collaboration among artists through intelligent systems, without sacrificing creative decision-making to automation.

"AI represents an opportunity to shift how high-end entertainment is crafted, with custom agents to assist with mechanical tasks. We are collaborating with AWS to build tools that provide a new interface for artists, not with chatbots or text prompts, but providing artists the ability to orchestrate intelligent systems with a natural interface and manage a complexity and sophistication not yet possible. With the artist in full control, they are then enabled to collaborate with the rest of the team, crafting the next-generation of premier storytelling to entertain the world," said Kimball Thurston, CTO, Wētā FX.

Workflow efficiency

One priority for the collaboration is to develop intelligent assistance for complex visual effects work. Tasks such as capturing actor performances, creating digital creatures, and ensuring realistic environments can require weeks of technical effort per scene. The goal is to integrate AI-enabled workflows into artist-centric tools, which could help reduce time spent on repetitive processes while preserving realism and fidelity. For example, rather than using existing machine learning models focused on human movement, the collaboration envisions training AI to generalise motion and physics for various creature types, generating new interactive tools for artists.

VFX-specific models

Wētā FX and AWS aim to address the limitations of general-purpose AI for visual effects by developing purpose-built models. Publicly available datasets often fall short for the specific needs of VFX professionals. Drawing on Wētā FX's history in film and AWS's computational infrastructure, the partners will investigate AI models tailored to understand the language and requirements of visual effects artists. This could include training on synthetic data generated by legacy visual effects tools. Examples might involve AI studying thousands of simulated mythical creature motions or architectural destruction sequences to grasp more specialised visual information.

Access and sustainability

The scale of visual effects projects continues to grow, and the companies plan to leverage AWS's elastic cloud computing resources to optimise efficiency and accessibility. The aim is to make sophisticated AI-assisted capabilities available to productions of different sizes, while reducing resource needs and computing power. Smaller, efficient AI models could help accelerate creative cycles from several days to just a few hours. There is also an emphasis on ensuring that technical advancements do not sideline the creative intents of artists, but instead support more rapid and diverse iterations of film assets.

"World-class filmmakers turn to Wētā FX to deliver iconic, awe-inspiring visual effects, from the battlefields of Middle-earth in The Lord of the Rings to the bioluminescent forests of Pandora in Avatar. We've done this for three decades by ensuring our artists have the most innovative tools as they craft the best path forward for every creative challenge. Together with AWS, we're approaching AI with the goal of enhancing our artists' work, enabling them to be more creative. We strongly believe AI technology should amplify human creativity and intent, and together with AWS we are committed to exploring and developing this," said Daniel Seah, CEO, Wētā FX.

"AWS has been powering media and entertainment innovation for nearly two decades, and this agreement represents an exciting milestone to explore and develop AI workflows and services that will transform the visual effects industry. Wētā FX's vision is about enabling exceptional artists to be more exceptional by creating purpose-built AI to fit their creative workflow. That's exactly the kind of innovation we want to enable with AWS infrastructure and our AI services," said Nina Walsh, global leader, industry business development for media, entertainment, games and sport.