The solution is to have only one tilemap+collision object per game object. Try splitting your three tilemaps into three game objects.