No, it shouldn't matter. Any newcomer will jostle the pecking order, of course, but they should eventually settle in. I think it could be more difficult if you removed the rooster, but kept the same flock of hens together. There'd probably be more fighting amongst the hens for the top spot. Some hens would mourn him too.