If you can't avoid wifi then make sure that nothing else is saturating the upstream or downstream. Any P2P apps, Spotify, and so on will use that connection for uploading.
However if it's not that, then it's up to you to deal with your ISP, which will certainly involve plugging a computer directly into the cablemodem.