Hi @oli and welcome to the forum. The issue is that the shape you are extruding is concave and the capping method does not work with concave shapes.
You can combine ExtrudeShape and CreatePolygon to get what you want https://www.babylonjs-playground.com/#G0A3MW#1
If you do not want the final mesh to be open you can just use ExtrudePolygon