Looks like this is a known bug (DEF-1117). Rotating y of the game object cause collision shapes to become upside down.
Is there any workaround for this?
Separating collider to different game object and moving them at the same time is not a quite practical solution I guess
go.set_rotation(vmath.quat_rotation_y(math.rad(180)))