I called their support line tonight and I was told that it's the location I'm downloading from. When I told the guy that I was getting 90mbps+ both down and up on speedtest.net, but 500 KILOBYTES per second on any download, he stuck to his story. When I told him that I am getting 1.1 Megabytes per second on my 10mbps ADSL line (it's still in the cancellation period), he stuck to his story (he must've been hating himself at this point, but wanted to go home more).
I sent a mail the the sales guy to see if he can help. I believe it's a TT Connect issue, but I'm willing to take the hit and change ISP to see if this issue persists. I'll update you on my progress as this goes on.
Edit: Speedtest.net on LAN gives me 90mbps+ both up and down. Real world download speeds are less than 5% of this. Even YouTube buffers.