Delete Collection
Open the Collection, click the … menu next to Modify, then Delete.

Note
Deleting a Collection removes its generated category pages. The underlying module (the Datatable or Calendar the categories came from) and its entries are not deleted — only the Collection's page-generation layer on top of them.