Medical software for interventional electrophysiology in MRI scanners

we are working for Imricor on a medical software which allows the application of their MRI-compatible catheters to treat patients suffering from heart arrhythmia.

The clinical data is from an animal study with a fake name, so no actual patient data.

The main challenges were/are

  • lots of complex interfaces to various medical devices (e.g. a MRI scanner),
  • real-time data (new images or tracking positions of the devices can come in any time).* robustness (medial data must not be lost when the software crashes),
  • resilience (recover full functionality in a few seconds after a crash),
  • real-time data (new images or tracking positions of the devices can come in any time).

As you can see, there’s quite some stuff to visualize with lots of semi-opaque and intersecting objects (segmentations of the various heart chambers and vessels). Therefore, order-independent transparency rendering is vital for us.

Another challenge was that the physicians didn’t like the behavior of any of the available cameras (how rotations are being handled) in Babylon.js, so I had the implement a new one (with quite some help here in the forum).

All in all we are very happy with Babylon.js and the support we get from the Babylon teams is simply amazing! Thank you so much! In the end you are helping physicians to give their patients a better treatment! :heart:

DISCLAIMER: The product is not yet available. I’m not an Imricor employee, but I got their permission to showcase what we are doing with Babylon.js.


Gosh this is excellent! @PirateJC
Any chance we can communicate online about it @7om ?

so im sure this is handled in other code that can listen to IO events from the OS? babylon is just the 3D viewport then within the application? What applications or frameworks did you use if you are willing to share such info?

Looks awesome :wink: great project

1 Like

This is amazing! What a beautiful visualization and important work :heart:

1 Like

This is such an amazing use of the framework !!!

1 Like

Thanks for all the nice feedback! I see a few people commenting who have actively contributed to making this happen. Thanks again!

@shaderbytes Yes, Babylon.js handles the right part of the screen, the rest is custom HTML/JS stuff (with some help from alpine.js) with a custom backend which does the communication and data persistence. We would love to share more details about the employed libraries and the architecture, but since it will be a commercial product of Imricor we unfortunately can’t.

ok thanks , i do understand that it is not possible to disclose info about the product based on its commercial nature. thanks for sharing what you could with us , always great to see how far babylon engine reaches around the planet :wink:

1 Like