Inworld AI announced that it is working with Nvidia and Streamlabs to create an intelligent streaming assistant using AI technology.
Streamlabs' Intelligent Streaming Assistant is like an interactive co-host, expert producer and technical assistant that will give independent creators the support of an entire production team. Inworld AI will provide its brains with multimodal AI, which can offload tasks from streamers without large production teams.
The companies made the announcement to Nvidia CEO Jensen Huangkeynote speech by sa CES 2025.
The collaboration brings together Streamlabs' expertise in live streaming and Nvidia's ACE technology for digital people. The latter includes audio-to-face animations, 3D rendering technology, as well as AI vision models that can understand what's happening on the screen; and Inworld's advanced generative AI capabilities for perception and cognition. Together, these technologies simplify streaming while empowering creators to produce high-quality, engaging content.
Creators can choose from assistant personalities that match the tone of their stream, whether they're looking for gentle behind-the-scenes support or a lively co-host.
How it works
Here's how Inworld works under the hood to power this AI agent:
- Interactive co-host: Using Nvidia's computer vision capabilities to identify events in real time with Inworld's ability to drive real-time agent behavior based on game state and understanding the context of games like Fortnite , the Intelligent Streaming Assistant can offer contextually relevant commentary at the creator's request. This awareness allows the assistant to do things like highlight a well-timed build-up, provide commentary during a dramatic Victory Royale, or shout out audience members for sending tips.
- Stream Producer: Like a producer overseeing the flow of a live show, the Intelligent Streaming Assistant can trigger audio and visual effects to enhance high-impact gameplay or clip the best highlights for replay . Inworld processes multimodal inputs from the creator, chat, and game to execute these producer actions through the Streamlabs API, giving the creator full control over how their stream appears.
- Technical Assistant: Intelligent Streaming Assistant also helps with Streamlabs desktop setup and troubleshooting. Inworld processes inputs from the creator to perform scene transitions or animations through the Streamlabs API, which helps ensure the stream runs smoothly.
Intelligent Streaming Assistant will be available through the Streamlabs App Store when the product launches later in 2025.
“The pace of innovation in generative AI is nothing short of extraordinary, pushing us beyond first-generation applications into a new era of sophisticated agent behavior,” said Kylan Gibbs, CEO of Inworld, in a statement. “Our collaboration with Streamlabs and Nvidia demonstrates how Inworld's AI agents enable real-time and context-aware interactions. More importantly, it demonstrates the true potential of AI to augment games and entertainment—empowering creators to deepen engagement and delight their audiences.”
Livestreaming has never been more popular—or more in demand. While millions of creators are able to captivate audiences around the world, the challenges of managing production, engaging with viewers, and delivering entertaining commentary all at the same time can be overwhelming.
From juggling scene transitions to providing entertaining commentary, streamers must navigate a complex mix of technical and creative demands, often with limited resources, says Inworld AI.
For new and smaller creators, these barriers can be steeper, making it harder to grow their audience and maintain consistency, the company says. Whether acting as a dynamic co-host by engaging the audience through real-time interaction or as a producer streamlining technical workflows, the Intelligent Streaming Assistant empowers creators to focus on what matters most—engaging with their audience.
“We hope that with this innovative technology, creators can now embrace AI in a way that is authentic to their brand and enables them to push the boundaries of innovation,” said Ashray Urs, head of Streamlabs, in a statement. “The first intelligent streaming assistant represents another step for the medium, giving creators the power to use this technology to make streaming easier and more engaging, while maintaining the level of authenticity they need to preserve and grow their community.”
Inworld's AI engine and tools fuel the next generation of innovation in games and entertainment. Inworld is backed by Lightspeed Venture Partners, Section 32, Intel Capital, Founders Fund, Disney Accelerator, Microsoft's M12 fund, BITKRAFT Ventures, First Spark Ventures co-founded by Eric Schmidt, The Venture Reality Fund, Kleiner Perkins, CRV, Stanford University , Meta, Micron Ventures, LG Technology Ventures, Samsung Next, NTT Docomo Ventures, and SK Telecom Venture Capital.
