AI Character
AI Voice Chat, Avatars, Tool Development
2023
This project highlights the strategic partnership between Inworld AI - a character creation platform, and Geenee AR - a no-code 3D WebAR builder system.
This integration enables creators, brands, and agencies to develop customized AI-powered characters, set up 3D avatars, and instantly share Augmented Reality scenes with their audience, all without programming skills.
Process
Challenge:
Provide creators with a tool that allows them to easily connect characters AI 'brains' with WebAR 3D scenes through an intuitive user experience. Also, ensure that end users can engage in seamless, real-time, and meaningful conversations with AI-powered avatars in Augmented Reality.
Action:
Developed the system and designed a workflow where users can:
Create a character within the existing Inworld AI system.
Generate a new AR scene using the Geenee Builder.
Select a "Snippet" from the provided library (templates) within the Geenee AR platform.
Utilize this snippet to enhance the WebAR Builder's UI and functionality.
Node.js server facilitates communication between the two platforms.
When the AR experience is published, it loads the code snippet to enable real-time AI-powered voice chat with the configured character, allowing end users to interact seamlessly.
Tech Stack:
Geenee WebAR, Inworld AI SDK, Mixamo, Three.js, JavaScript, React, Node.js, Figma, Blender.
Result
The feature was integrated for the paid customer and helped the platform to be live in 50 countries, with over 100 AR experiences built by marketers.
This integration provided many non-technical customers with a simple tool to create interactive AR avatars. It has received significant media coverage and created new opportunities for brands aiming to leverage the potential of AI characters.
