From what I have noticed:
If you have a LR server, WoE and PVP lovers will most likely ignore your server, but players that love grinding/leveling or anything a low rate can offer, they will stay surely for a long time(grind to 99 ftw)
If you have a HR server, WoE/PVP players will come, but they may not last. Or they simply get bored and wanted to play a different HR.
I personally love a HR server with multiple quests though. Tired of PVP? Do quests. It's like leveling too.