Make sure your router/firmware is on the list of approved LIVE routers.
http://www.xbox.com/en-US/support/co.../equipment.htm

The behaviour that you're describing sounds very much like you're behind a router that LIVE does not like. A quick way to test this is to connect your computer directly to the modem, and see if you get different behaviour.