You should only need to close an app on your Apple TV if it’s not behaving properly.
If you ever lose your Apple TV remote, you can use your iPhone.
If you just want to switch to the app, press the center of the clickpad or touch surface. Tap the Back button (Siri Remote 2nd generation or later) or Menu button (1st generation) to leave the app-switching view.