LLMAI Plugin
Conversational AI built for Unreal Engine 5, intelligent characters and systems that respond through realtime text, voice, and function calling. Engineered by Reflective Simulations and available on Fab.
LLMAI brings cutting-edge conversational AI directly into Unreal Engine projects. Whether you are building games, training simulations, or interactive applications, the plugin gives you tools to create responsive AI that can talk, listen, and act on your world through a unified Realtime API workflow.
AI providers
- OpenAI (cloud), Realtime API text and voice
- Grok / xAI (cloud), Realtime voice with optional web search
- LocalAI (self-hosted), offline or LAN-hosted models on the same protocol
- Switch providers via project settings without rewriting your integration
Voice & conversation
- Natural voice conversations through OpenAI, Grok, or LocalAI Realtime APIs
- Voice activity detection, interruptions, and seamless voice/text switching
- Multiple AI voice personalities (including OpenAI voices such as Alloy, Echo, Shimmer)
- Bidirectional audio streaming with noise reduction and automatic mic gating
- LiveLink support for MetaHuman lip-sync driven by AI speech
Function calling
- Blueprint-friendly function definitions created in the Content Browser
- Let AI spawn objects, adjust settings, and control gameplay at runtime
- Function profiles for grouping related capabilities
- Included demos: Rocketeer arcade (AI-controlled gameplay) and LiveLink MetaHuman
Requirements
- Unreal Engine 5.6 or 5.7 on Windows 10/11 (64-bit)
- Enabled engine plugins: AudioCapture, LiveLink, MetaHuman
- API keys for OpenAI and/or Grok where used; LocalAI install for self-hosted models
- Internet connection for cloud providers; microphone and headset for voice features
Listing details, demos, and licensing are on Fab. Provider features and version notes may change, refer to the Fab page for the latest information.