# Project an image to a 3D world

**URL:** <https://forum.babylonjs.com/t/project-an-image-to-a-3d-world/5170>\
**Category:** Questions\
**Created:** [August 19, 2019, 10:07am UTC](https://forum.babylonjs.com/t/project-an-image-to-a-3d-world/5170 "2019-08-19T10:07:47Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![chao\_pan](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/chao_pan/32/4055_2.png) [@chao\_pan](https://forum.babylonjs.com/u/chao_pan)\
**Post date:** [August 19, 2019, 10:07am UTC](https://forum.babylonjs.com/t/project-an-image-to-a-3d-world/5170/1 "2019-08-19T10:07:47Z")

</div>

Hey guys,  
I have been stuck with this problem in Babylon.js for days and still couldn’t get it work.

Basically, I want to do sth like an AR application in Babylon. Take a video, and render some 3d objects inside the video. Any ideas about how to achieve this?  
Most of the materials are talking about projecting 3d points to 2d images, but we want to do the opposite way.

Thanks!

---

<div class="post-metadata">

**Author:** ![Wingnut](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/wingnut/32/53_2.png) [@Wingnut](https://forum.babylonjs.com/u/Wingnut)\
**Post date:** [August 19, 2019, 12:09pm UTC](https://forum.babylonjs.com/t/project-an-image-to-a-3d-world/5170/2 "2019-08-19T12:09:15Z")

</div>

Hi CP, welcome to the BabylonJS forum.

BabylonJS is not really designed for camera tracking and compositing. That may be a Blender/other-modeler task. Check-out this short Blender tutorial: [YouTube](https://www.youtube.com/watch?v=kzym73lhmD4)

Let’s take a look at our previous forum… see if we can find some “augmented reality” and “mixed reality” topics. [old forum search for AR](http://www.html5gamedevs.com/search/?&q=Augmented%20Reality&type=forums_topic&nodes=28,29,30,31,38&search_and_or=and&sortby=relevancy)

Let’s try this new forum, too. [new forum search for AR](https://forum.babylonjs.com/search?q=augmented%20reality)

With Blender, you are working in an environment that is designed for video-rendering. BabylonJS is not really the proper tool for your project, me thinks.

That’s all I have, so far. Sorry for the possible bad news. Again, welcome. Stay tuned for more comments/ideas.

---

<div class="post-metadata">

**Author:** ![Deltakosh](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/deltakosh/32/26635_2.png) [@Deltakosh](https://forum.babylonjs.com/u/Deltakosh)\
**Post date:** [August 19, 2019, 2:54pm UTC](https://forum.babylonjs.com/t/project-an-image-to-a-3d-world/5170/3 "2019-08-19T14:54:16Z")

</div>

Pinging our AR mastermind @syntheticmagus

---

<div class="post-metadata">

**Author:** ![syntheticmagus](https://sea2.discourse-cdn.com/flex024/user_avatar/forum.babylonjs.com/syntheticmagus/32/395_2.png) [@syntheticmagus](https://forum.babylonjs.com/u/syntheticmagus)\
**Post date:** [August 19, 2019, 5:24pm UTC](https://forum.babylonjs.com/t/project-an-image-to-a-3d-world/5170/4 "2019-08-19T17:24:56Z")

</div>

Hi chao\_pan,

Awesome to hear about people trying this stuff! We have a project called [BabylonAR](https://github.com/BabylonJS/BabylonAR) (blog post about it [here](https://medium.com/@babylonjs/babylon-ar-7823ab4a80c1)) that’s beginning to tackle issues like these. However, the project is very young (alpha), so there are still a lot of features we have yet to add to it.

Can you tell me a little bit more about your use case? Depending on the constraints on your video – for example, if you can include markers, at least in the short term – it might be possible to do what you’re hoping for with just the current capabilities. If what you need is more general case, that may veer into an extremely difficult problem called [SLAM](https://en.wikipedia.org/wiki/Simultaneous_localization_and_mapping), which BabylonAR doesn’t have the capability to solve. (Not yet, anyway. 😉)

So, in short, there may be several possibilities both inside and outside Babylon, depending on what exactly you’re trying to do. If you can share a bit more about the use case you have in mind, I’ll be happy to discuss what options might work for you. Thanks!
