In my case (Digital Twin) we have a lot of same objects, mainly chairs and tables (rendered as instances of course) and I was so happy when I started to read this topic because picking is a bottleneck in my app at this time.
To be more precise why I’m a bit sad after reading the GPU picking docs is because we use the vertex colors this way and it’s quite common in games to fake AO as well:
