Well, the thing is, you have skill delay and animation delay. To make it short, the one that is longer is actually in effect. In most cases, it is skill delay. That is fixed for each skill and can be only modified by some items or Bragi. Animation delay depends on your aspd.