I looked into it as a couple other people had mentioned it in other threads, and two others also emailed me.

Here is a clue I omitted in the past.
Look at the 'wallclock' line down at the bottom.

First number is time in the 'queue'. Second is time to process your command. If the total CPU time is over 1 second on a consistent basis then that means there could be an issue at the server end.
Anything below 0.30 is "lightning fast"
If it is a fast time but there are delays for you then it is not the server.

That is actually why the wallclock line is there
I'm actually surprised no one has ever asked what it is.