The trick is to stop Remote Desktop from grabbing the Windows keys, such as Alt+Tab. Once you've done that, switching out of Remote Desktop is easy, but you need to learn some new key combinations for switching applications within Remote Desktop.
In case you have trouble finding the settings for Remote Desktop, they're available just before you open a connection. Here's an answer from the FAQ's:
Open Remote Desktop Connection by clicking the Start button, clicking All Programs, clicking Accessories, and then clicking Remote Desktop Connection.
Before connecting, click Options, and then make the changes you want on the Display, Local Resources, Programs, Experience, and Advanced tabs.
On the Local Resources tab, set the keyboard to, "On this computer".
Connect to the remote computer, and launch a couple of programs. Alt+Tab will now switch out of Remote Desktop. How do you switch between the two programs within Remote Desktop? There's a helpful list of key combinations on Coding Horror, but the one I use the most is Alt+PgUp.
Let me put it here as well: I don't want to use my mouse, but moving away from full screen is a pain in the ??? just to switch to the local system. I want to use a shortcut apart from the "Toggle Fullscreen" one to switch. – private_meta – 2010-08-07T19:51:06.213