I am very beginner to babylon js. I need do create a talking chat bot. Means, when asking some questions the character can give answer with with face expression or at least lip some lips movements. Actually my target is a chat bot using babylon js with artificial intelligence. Please share anything you know about this topic. I am not expect a answer, I am looking for the best way to solve this requirement.
1 Like
Hi and welcome to the community,
Glad to see your enthousiasm and your will to create with BJS. Please keep with this energy 
However, babylon.js is a 3D rendering framework. It will not do your lipsync nor your AI. So it worries me a little when someone comes with this level of complexity and says âI do not expect answersâ. Answers and a clear project management is what you would first need to run this kind of project. Already you would need to split down the project for all different aspects: character modelling, animations, lipsync, text recognition, AI, API,⌠You could use an existing chatbot and its API and from there âsimplyâ animate your chatbot avatar. That would be the easiest.
Though, when I say âeasiestâ, youâre not there yet. I donât want to discourage you but I think you are in for a long journey here if you want to do that (and youâre welcome .
Please allow for some time for the team and experts to reply (and that is not me for this subject 
Itâs holiday season and it could take a bit more time before you get more input and answersâŚ
Meanwhile, I hope you are enjoying your first experience with BJS and I shall wish you a great day 
1 Like
I know bjs is 3D rendering library. The lip sync what i means that just lip animation for a human character.
Is anyone aware of open-source projects that do anything of this nature using babylon.js as the rendering engine?
Please share links.
âanything of this natureâ may be a rock (or a beautifully rendered human figure with moving lips or anything in-between) that is maybe following and/or talking to the only âobserverâ (or âall observersâ) in a scene. i.e. such âbotâ would track the position of the camera and calculate its actions based on that, and render results of those calculations (e.g. a rock moving within the scene) in the scene such that the camera (observer) can see them.
The botâs code may live in the observerâs browser or on a server. This may be a minimalistic or a mature game engine (with an ECS and/or a webrtc stuff that captures camera/microphone on the user(s)â client machine, etc) or anything of that nature - that uses babylon.js as a rendering engine.
Has anyone heard of anything of this nature in existence? Please share links. Thank you!
Seva