Pirate-themed Babylon.js GPT

Hey all, I made a custom pirate-themed Babylon.js-specific ChatGPT chatbot that specializes in creating Babylon scenes:

You’ll need to sign in to use it, but it should work with accounts on the free tier.

Try it out!

10 Likes

Nice ! I never tried to create a custom GPT with ChatGPT, but I guess it’s about writting your self some system prompts ? Or so you have more “low level” access ?



Following a similar feature request by @tapanij , I’m currently working on a custom LLM specific to BabylonJS… It’s not easy ! I’m running locally gemma3:4b model, and my process is like so :

(pre-processed, python)

  • Extracing all the .md files from the doc sources
  • Summarize the content by extracting, for all pages, the title and some keywords
  • Export in a JSON

(run-time, NodeJS & Python)

  • Input a prompt from the user
  • First LLM call to choose the most relevant pages from the (short) JSON, based on the system prompt
  • Python retreival of the full content of the choosen pages
  • Second LLM call to answer the question based on the previous retrieval

My final goal is to target an “up to date” LLM, where you can ask somethink like “Hey, how can I setup self-shadowing on my mesh ?” and the answer would be 100% up to date with the last state of the documentation :slight_smile:

5 Likes

cc @georgie

1 Like