You can rename or delete folders through the pencil icon in the breadcrumb.
This will open the settings from that folder in the right panel, allowing you to edit or delete.
