Maybe it's some kind of imprinting? Dru sired him and therefore he'll always have this affinity to crazy women, just as Angel does to small green-eyed blondes?

Well, maybe not. I think rahirah probably has the right of it.