if you're using port forwarding you should also have static IPs in your network :P
But anyway, this problem has nothing to do with ports from what I've read. Many things could be causing this, your ms could go sky high if you're downloading via torrents (uTorrent or w.e other one for that matter).
__________________
-- Viva Canada! --  |