What does the term "Speed" mean in a speaker?

I think our perception of speed has more to do with how fast a speaker driver stops making sound after the signal stops than how fast it reacts to a signal. That's why larger drivers often sound slower than smaller drivers. It's not too difficult to get a driver to respond quickly when its voice coil is energized. It's a lot harder to get it to stop vibrating once the signal goes away. 

Servo controlled drivers can overcome some of these limitations because they can use power to stop the driver quickly when the input signal stops.