Surprisingly the solution is very simple!
Select the Video source you want to delete, press and Hold "Menu" (which is equivalent to "C") if your Apple TV 2 Remote Control. a menu will appear for editing, removing, etc...
review for all gadget information