When you go to a women’s leadership conference, you don’t expect to see men — but that’s exactly what happened here