Selecting Exit from the File menu has the same effect as closing The Edge using the close button.
Notice that Exit will completely close The Edge, not just the selected window.