To view and access all running apps, double click on the Home button. 
The most recently used apps appear in the recents list at the bottom of the screen. 
Flick left to see more apps.

To switch to a running app, just tap on it here in this bar.
*This is where you will close an open app--there is no way to close an open app when it is open.