I think I remember seeing a show recently that found Neanderthal DNA among the human population. It's hard for me to believe that bipedal man didn't interbreed.
Regarding brain size, our modern brains are actually shrinking. That explains a lot of recent human events IMO. But no joke. our modern brains are shrinking.