It seems that Internet Explorer 5 (and up) only allows two concurrent downloads. So, if you want to download more than 2 big files simultaneously you are out of luck.
But there is a quick registry fix! (beware, if you're not sure what you're doing!)
Microsoft Knowledge Base Article - 282402
How to Configure Internet Explorer to Have More Than Two Download Sessions
(Thanks to GregorS)