It's not a question of going fast or slow, it's getting the correct speed.
If you want to do a few swaps on a rail, slower is better. If you're looking to slide the rail straight, and wind up a 4 out, faster is better.
Slower is better for technical rails.
Speed check each rail, think about what you want to, and try and get an optimal speed