This may be obvious but the distortion in LensRenderingPipeline will offset the pointer position so it doesn’t seem quite accurate. I imagine fixing this would be a nightmare, but perhaps a strong note in the docs would be helpful!
I can try to submit a simple PR if anyone agrees.