LLM for Unity

Create characters in Unity with LLMs!

LLM for Unity enables seamless integration of Large Language Models (LLMs) within the Unity engine.
It allows to create intelligent AI characters that players can interact with for an immersive experience.
The package includes a Retrieval-Augmented Generation (RAG) system for semantic search across your data, which can be used to enhance the character's knowledge.

The LLM backend, LlamaLib, is built on top of the awesome llama.cpp library and  provided as a standalone C++/C# library.

At a glance  • 
How to help  • 
Games / Projects using LLM for Unity  • 
Setup  • 
Quick start  • 
Advanced usage  • 
RAG  • 
LLM model management  • 
Examples  • 
License

At a glance
- 💻 Runs anywhere: PC, mobile or VR!
- ⚡ Blazing fast inference on CPU and GPU (Nvidia, AMD, Apple Metal)
- 🏠 Runs locally without internet access. No data ever leave your game!
- 📡 Supports remote server setup
- 🤗 Supports all major LLM models
- 🔍 Advanced RAG System (ANN search)
- 🔧 Easy to setup, call with a single line of code
- 💰 Free to use for both personal and commercial purposes

🧪 Tested on Unity: 2021 LTS, 2022 LTS, 2023, Unity 6
🚦 Upcoming Releases

Business inquiries
For business inquiries you can reach out at hello@undream.ai.

How to help
- ⭐ Star the repo, leave a review and spread the word about the project!
- Join us at Discord and say hi.
- Contribute by submitting feature requests, bugs or even your own PR.
-  this work or buy me a  to allow even cooler features!

Games / Projects using LLM for Unity
- Verbal Verdict
- I, Chatbot: AISYLUM
- Nameless Souls of the Void
- Murder in Aisle 4
- Finicky Food Delivery AI
- AI Emotional Girlfriend
- Case Closed
- MaiMai AI Agent System
- Claria Chat
- Endless Casual Drive
- Dating App Simulator
- Virtual Reality Mock Interview
- Velesio AI server
- Dungeon Chat
- Tomonaka Desk
- Digital Humans
- CakeMix
- HeyWaifu
- Love and Lie
- Psycho Simulator
- False Flame
- CielChan: Anime Desktop AI Companion

Contact hello@undream.ai to add your project!

Setup
_Method 1: Install using the asset store_
- Open the LLM for Unity asset page and click Add to My Assets
- Open the Package Manager in Unity: Window > Package Manager
- Select the Packages: My Assets option from the drop-down
- Select the LLM for Unity package, click Download and then Import

_Method 2: Install using the GitHub repo:_
- Open the Package Manager in Unity: Window > Package Manager
- Click the + button and select Add package from git URL
- Use the repository URL https://github.com/undreamai/LLMUnity.git and click Add

Quick start

1. Setup the LLM

First you will setup the LLM for your game:
- Create an empty GameObject.In the GameObject Inspector click Add Component and select the LLM script.
- Download one of the default models with the Download Model button (~GBs).Or load your own .gguf model with the Load model button (see LLM model management).

2. Create an AI Character
Then you can setup each of your characters as follows:
- Create an empty GameObject for the character.I

……（后略，见原文）