# AI Game Maker - First Release!

**URL:** <https://forum.babylonjs.com/t/ai-game-maker-first-release/42803>\
**Category:** Demos and projects\
**Created:** [July 29, 2023, 5:37pm UTC](https://forum.babylonjs.com/t/ai-game-maker-first-release/42803 "2023-07-29T17:37:24Z")\
**Posts on this page:** 20\
**Page:** 1

<div class="post-metadata">

**Author:** ![bigrig](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/bigrig/32/5548_2.png) [@bigrig](https://forum.babylonjs.com/u/bigrig)\
**Post date:** [July 29, 2023, 5:37pm UTC](https://forum.babylonjs.com/t/ai-game-maker-first-release/42803/1 "2023-07-29T17:37:24Z")

</div>

Hi all!  
After many moons of work with _great gratitude_ to this community, I’d love to invite you to be the first try out my AI game maker. The concept is: describe your game - and then with AI as your co-pilot, create a video game that you can share and play with friends.

[https://extragreat.ai/make?code=babyonjsfriends](https://extragreat.ai/make?code=babyonjsfriends)

The genesis of the idea is: during the pandemic, I tried to get my 11yr old son into making games (which he was playing, of course, all the time). But learning Lua for Roblox Studio was just too big of a leap for him. So, I wanted to make a game-maker where anyone could turn their creative game ideas into reality without the technical barrier. Like Roblox, but AI powered and built for web browser.

 ![Screenshot 2023-07-29 at 10.15.32 AM](https://us1.discourse-cdn.com/flex024/uploads/babylonjs/original/3X/c/b/cb59bd83f61d2ce682c02790166abd74afb2613f.jpeg)

I would just love it if you would give it a try and let me know your thoughts / feedback / improvement ideas / bugs discovered. You are the first to give it a try!

In terms of roadmap, Phase 1 was to get environment building, publishing, multi-player, chat, and AI powered NPCs working:

- [done] environment: build env with ai-matched “game boards”
- [done] multi-player: with share via link
- [done] multi-player: play and collaborative edit modes
- [done] multi-player: friends-can-edit on/off
- [done] magic bar: make environmental edits via prompts
- [done] magic bar: add/adjust assets via prompt (eg: add a boulder)
- [done] skyboxes: pre-set and generated via blockade (eg: add a sky with fireworks)
- [done] weather: fog, rain, smoke
- [done] time of day: morning to night
- [done] ground: pre-set material options (don’t like how this came out yet)
- [done] object edit: object picking and editing options (copy, move, size, rotate, 6of, delete)
- [done] object edit: add gravity
- [done] NPCs: create new NPC / give AI personality
- [done] NPCs: insert into game / edit AI personality
- [done] Chat: chat with other players or AI-NPCs
- [done] Chat: generate speech audio for NPCs
- [done] Avatar: change color
- [done]: Avatar: change avatar
- [_next_]: Avatar: swim
- [_next_]: Player to object actions (eg: open door, pick up)
- [_next_]: Undo edits
- [_next_]: NPC behaviors (chase, attack, follow, give object/currency, take object/currency)
- [_next_]: Mobile controls
- [_next_]: Players can physically interact with physics objects
- [_next_]: Portal to other boards

And phase II is _gameplay_.  
I’m currently working out how to best do gameplay - will most likely pick one genre to start with, like RPG and create a RPG templating system. Happy to hear your ideas!

cheers,  
ben

---

<div class="post-metadata">

**Author:** ![DavidL](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/davidl/32/34549_2.png) [@DavidL](https://forum.babylonjs.com/u/DavidL)\
**Post date:** [July 29, 2023, 7:02pm UTC](https://forum.babylonjs.com/t/ai-game-maker-first-release/42803/2 "2023-07-29T19:02:11Z")

</div>

Looks good, website is nice. Make any game? Ok. Went to make a Bulldozer ('95) clone and got stuck on picking the game board. Fancy and nice, but lacking true customization. Just my 2 cents!

Nice work, thx for sharing 😃

---

<div class="post-metadata">

**Author:** ![bigrig](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/bigrig/32/5548_2.png) [@bigrig](https://forum.babylonjs.com/u/bigrig)\
**Post date:** [July 29, 2023, 10:43pm UTC](https://forum.babylonjs.com/t/ai-game-maker-first-release/42803/3 "2023-07-29T22:43:52Z")

</div>

Thanks. What do you mean you got stuck? What happened?

---

<div class="post-metadata">

**Author:** ![DavidL](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/davidl/32/34549_2.png) [@DavidL](https://forum.babylonjs.com/u/DavidL)\
**Post date:** [July 31, 2023, 5:59am UTC](https://forum.babylonjs.com/t/ai-game-maker-first-release/42803/4 "2023-07-31T05:59:50Z")

</div>

My apologies. “Stuck” is the wrong word. I had the wrong idea thinking we could literally make any game, but the presets are kinda “your” game. I actually went back to try again but was greeted with a login signup screen right after that so I can’t tell you more.

Website is good though, just a little hang loading the boards but it’s nice

---

<div class="post-metadata">

**Author:** ![carolhmj](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/carolhmj/32/25918_2.png) [@carolhmj](https://forum.babylonjs.com/u/carolhmj)\
**Post date:** [July 31, 2023, 10:27am UTC](https://forum.babylonjs.com/t/ai-game-maker-first-release/42803/5 "2023-07-31T10:27:50Z")

</div>

Interesting idea! cc @PirateJC

---

<div class="post-metadata">

**Author:** ![bigrig](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/bigrig/32/5548_2.png) [@bigrig](https://forum.babylonjs.com/u/bigrig)\
**Post date:** [July 31, 2023, 2:45pm UTC](https://forum.babylonjs.com/t/ai-game-maker-first-release/42803/6 "2023-07-31T14:45:06Z")

</div>

Im not familiar with Bulldozer 95, but looks like kind of a 2d puzzle game from the screenshots? If you wanted to do something like that you could start with the empty “game board” and build out walls and boulders and drop in a bulldozer.

That said - I’m at “environment build” phase of the roadmap to date - building out game play mechanics/tools is the next phase… I’m super interested in the kinds of games people would like to make - so that I can build out the most useful mechanics building tools first. My gut is to tackle RPG mechanics as the first go.

Here’s a sample of how you might do a bulldozer game environment:

 ![Screenshot 2023-07-31 at 7.37.38 AM](https://us1.discourse-cdn.com/flex024/uploads/babylonjs/original/3X/0/e/0e09f0be425db5f40698c712ee84de8655d701e1.jpeg)

 ![Screenshot 2023-07-31 at 7.44.25 AM](https://us1.discourse-cdn.com/flex024/uploads/babylonjs/original/3X/b/4/b45f0075b6992f85ad08f231d43c4ec8f21ed13b.jpeg)

---

<div class="post-metadata">

**Author:** ![bigrig](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/bigrig/32/5548_2.png) [@bigrig](https://forum.babylonjs.com/u/bigrig)\
**Post date:** [August 7, 2023, 11:43pm UTC](https://forum.babylonjs.com/t/ai-game-maker-first-release/42803/7 "2023-08-07T23:43:31Z")

</div>

Here is first demo video:

[![](https://img.youtube.com/vi/5YgVS1K-vLM/maxresdefault.jpg "Demo 01: Concept to Environment") ](https://www.youtube.com/watch?v=5YgVS1K-vLM)

---

<div class="post-metadata">

**Author:** ![DavidL](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/davidl/32/34549_2.png) [@DavidL](https://forum.babylonjs.com/u/DavidL)\
**Post date:** [August 8, 2023, 5:01am UTC](https://forum.babylonjs.com/t/ai-game-maker-first-release/42803/8 "2023-08-08T05:01:27Z")

</div>

If you remove the login registration stuff (at least temporarily) I’ll try again, very cool. Nice quality video 👍

So the AI part, what is it? What’s going on behind the scenes? Are you using some kind of OpenAI functionality with machine learning or is it more custom hard coded AI?

---

<div class="post-metadata">

**Author:** ![bigrig](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/bigrig/32/5548_2.png) [@bigrig](https://forum.babylonjs.com/u/bigrig)\
**Post date:** [August 8, 2023, 2:07pm UTC](https://forum.babylonjs.com/t/ai-game-maker-first-release/42803/9 "2023-08-08T14:07:35Z")

</div>

Sure thing. Here’s a beta code that you can use (and for anyone else on this thread): babyonjsfriends

In terms of AI, there are a number of things going on:

- interpretation of “magic bar” commands to one or more internal API calls (this is the heart of using the LLM as copilot for game environment making)
- semantic matching of game concept or object concept prompts to library assets
- generation of skybox assets (currently using blockade)
- NPC chat responses and speech generation

And upcoming is 3d awareness for the LLM - so that it can run as a sort of OS for game play.

---

<div class="post-metadata">

**Author:** ![DavidL](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/davidl/32/34549_2.png) [@DavidL](https://forum.babylonjs.com/u/DavidL)\
**Post date:** [August 8, 2023, 4:20pm UTC](https://forum.babylonjs.com/t/ai-game-maker-first-release/42803/10 "2023-08-08T16:20:46Z")

</div>

Really? Thx! That deserves a fresh beer! 🍻

---

<div class="post-metadata">

**Author:** ![DavidL](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/davidl/32/34549_2.png) [@DavidL](https://forum.babylonjs.com/u/DavidL)\
**Post date:** [August 8, 2023, 4:23pm UTC](https://forum.babylonjs.com/t/ai-game-maker-first-release/42803/11 "2023-08-08T16:23:55Z")

</div>

Uh oh…

 ![Screen Shot 2023-08-08 at 12.22.19-fullpage](https://us1.discourse-cdn.com/flex024/uploads/babylonjs/original/3X/b/8/b832b740c52cfb1020c64def1f31d3c50281a084.jpeg)

---

<div class="post-metadata">

**Author:** ![bigrig](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/bigrig/32/5548_2.png) [@bigrig](https://forum.babylonjs.com/u/bigrig)\
**Post date:** [August 8, 2023, 4:25pm UTC](https://forum.babylonjs.com/t/ai-game-maker-first-release/42803/12 "2023-08-08T16:25:21Z")

</div>

Ah - that first link now requires the code… here’s an updated link:  
[https://extragreat.ai/make?code=babyonjsfriends](https://extragreat.ai/make?code=babyonjsfriends)

---

<div class="post-metadata">

**Author:** ![PirateJC](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/piratejc/32/1003_2.png) [@PirateJC](https://forum.babylonjs.com/u/PirateJC)\
**Post date:** [August 8, 2023, 7:53pm UTC](https://forum.babylonjs.com/t/ai-game-maker-first-release/42803/13 "2023-08-08T19:53:30Z")

</div>

@bigrig I seriously have been waiting for this moment all summer! So excited for what you’ve been building!

Just starting to jump in and it looks like the link you provided is still requiring a sign in. Not a problem for me though.

Your starting video tutorial was fantastic as well.

I can’t wait to try out the AI copilot stuff!

---

<div class="post-metadata">

**Author:** ![PirateJC](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/piratejc/32/1003_2.png) [@PirateJC](https://forum.babylonjs.com/u/PirateJC)\
**Post date:** [August 8, 2023, 8:02pm UTC](https://forum.babylonjs.com/t/ai-game-maker-first-release/42803/14 "2023-08-08T20:02:39Z")

</div>

I’m not going to say that you’ve already captured the imagination of the child inside of me…but…

 ![image](https://us1.discourse-cdn.com/flex024/uploads/babylonjs/original/3X/8/2/826649a8ec2351689eb78b3c7c110945e3b75167.jpeg)

---

<div class="post-metadata">

**Author:** ![bigrig](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/bigrig/32/5548_2.png) [@bigrig](https://forum.babylonjs.com/u/bigrig)\
**Post date:** [August 8, 2023, 8:21pm UTC](https://forum.babylonjs.com/t/ai-game-maker-first-release/42803/15 "2023-08-08T20:21:57Z")

</div>

Nice! You can also put a pirate NPC in there that talks salty…

---

<div class="post-metadata">

**Author:** ![bigrig](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/bigrig/32/5548_2.png) [@bigrig](https://forum.babylonjs.com/u/bigrig)\
**Post date:** [August 15, 2023, 11:19pm UTC](https://forum.babylonjs.com/t/ai-game-maker-first-release/42803/16 "2023-08-15T23:19:12Z")

</div>

Got a video showing how to generate a skybox

[![](https://img.youtube.com/vi/gPxqbEleZKg/maxresdefault.jpg "Demo 02: Generating a Sky") ](https://www.youtube.com/watch?v=gPxqbEleZKg)

---

<div class="post-metadata">

**Author:** ![arcman7](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/arcman7/32/20249_2.png) [@arcman7](https://forum.babylonjs.com/u/arcman7)\
**Post date:** [August 16, 2023, 1:18am UTC](https://forum.babylonjs.com/t/ai-game-maker-first-release/42803/17 "2023-08-16T01:18:11Z")

</div>

I’m trying it out, and I’m here to be one of your first Q&A people:

 ![image](https://us1.discourse-cdn.com/flex024/uploads/babylonjs/original/3X/9/a/9a6895e2d12d256f5682f8e41570b667634e4c11.jpeg)

- fix height of the physics ground
- make npc’s a little larger lol

Otherwise, this is an amazing project. Kudos man, I love it!

---

<div class="post-metadata">

**Author:** ![slin](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/slin/32/36084_2.png) [@slin](https://forum.babylonjs.com/u/slin)\
**Post date:** [August 16, 2023, 1:19am UTC](https://forum.babylonjs.com/t/ai-game-maker-first-release/42803/18 "2023-08-16T01:19:19Z")

</div>

You are supposed to swallow that NPC!

---

<div class="post-metadata">

**Author:** ![arcman7](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/arcman7/32/20249_2.png) [@arcman7](https://forum.babylonjs.com/u/arcman7)\
**Post date:** [August 16, 2023, 1:22am UTC](https://forum.babylonjs.com/t/ai-game-maker-first-release/42803/19 "2023-08-16T01:22:20Z")

</div>

Um… LOL

 ![image](https://us1.discourse-cdn.com/flex024/uploads/babylonjs/original/3X/1/0/102cdc97b2929c5921099ad112852d81eaa7103a.png)

This game rocks. 10/10 for npc realism

---

<div class="post-metadata">

**Author:** ![arcman7](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/arcman7/32/20249_2.png) [@arcman7](https://forum.babylonjs.com/u/arcman7)\
**Post date:** [August 16, 2023, 2:03am UTC](https://forum.babylonjs.com/t/ai-game-maker-first-release/42803/20 "2023-08-16T02:03:58Z")

</div>

I decided to use babylon.js or three.js after watching one Unity tutorial. This is on point.

[Next page](https://forum.babylonjs.com/t/ai-game-maker-first-release/42803.md?page=2)
