If you want to remove a folder, you can do so with the folder selected. Note that the drafts within the folder will not be archived, they will just be removed from the folder itself.
To remove a folder:
Select the folder
In the action menu (on the right), select 'Remove folder'
Confirm the dialog