yeah easiest way is switch one off and connect to the other using browser.
I would recommend though that you change the ip of one or both so that they are not the same and so they are not default.
so dont use 192.168.0.1 or 192.168.0.100, as it is a very easy hack to get into your router if you leave it on the default ip, as if you dont chnage the ip chances are you havnt changed the router id or password
ive had a few friends get there routers jacked, funny when someone blocked them from using there on internet connecection but doubt you see the funny side if it happens to you.