OMG
It is fast: https://playground.babylonjs.com/?snapshot=refs/pull/15713/merge#IW43EB#16
It seems like dynamic-holes-in-walls kind of fast. Previously major lag after a few holes. Now, as long as you give it some time between each hole, 60fps!!
Oooh and look at this: vertex count much better too!