It's all about the detail. If you cram it into the spare cycles during a light load frame, you have to make do with whatever elbow room you have at that moment so you lower your fidelity target as a precaution against overreaching. If you offload it, latency becomes your main concern but that's far more consistent than the local hardware's dynamic load. You can therefore potentially set your targets higher and even scale them with the connection speed.