Augmented reality with BabylonJs

Hello, Babylon community.

I am trying to build an AR that is integrated with the Babylon scene,
where you can track the face of a person and then put the mesh(model like glasses on the face) it’s like a filter on the face,
I did a lot of research and didn’t find a lot of resources between Babylon and face tracker(recognition),
I did find only one resource(example) on GitHub jeelizFaceFilter/demos/babylonjs/cube at master · jeeliz/jeelizFaceFilter · GitHub

and in this example is using an old version of Babylon so there aren’t a lot of features included.

so if anyone can give me a resource or example or tips for my research I will be glad.
Thank you.

I want to make a web app like this site.
https://www.modakatech.com/demo.html

2 Likes

This project is great. I just found this site that can recognize a face with javascript. Maybe it will help you.

linked to : GitHub - jeeliz/jeelizFaceFilter: Javascript/WebGL lightweight face tracking library designed for augmented reality webcam filters. Features : multiple faces detection, rotation, mouth opening. Various integration examples are provided (Three.js, Babylon.js, FaceSwap, Canvas2D, CSS3D...).

2 Likes

Thank you for your answer.

I needed a resource that has the integration between face tracking and Babylon where the models will be placed on the user’s face and move with him as he moves.
like a face mask filter.

Thanks anyway.