Go to Control Panel and then open the display properties. Navigate to the theme tab, and you will be able to see a drop down list box containing all the installed themes.
To delete a theme, just select the theme and the click the delete button which is present on the right side of the drop down list box.
However, deleting themes directly from the themes folder in the windows directory is not recommended.