It all depends on the server you're dowloading from .
But this I will say - for a 4m connection, your average should NOT be 100+ kbps. - thats the average of a 1mbps connection actually.
so - either your line quality is bad - or C@W is just being the turd it typically is.
that 20kbps was prolly from a slow server / peak time.