Yet again, Newbie question: mesh import - #8 by nogalo
I touched on how you could solve this in a different thread (or two of them 
)
I believe that best thing you could do is to wrap your object (pole) with a Box and add collision on the box instead of the pole itself. And I would pretty much do this with every mesh that you might have troubles with (like gates, walls, sharp corners, etc…)
Note: I am not throwing away the possibility that something else might be in play here, but I feel like this would solve your issue.