Deleted items are placed in the Trash folder and remain there until you manually empty the trash or until the folder is purged automatically. Mail is purged from this folder after a specified period of time, as specified by your email administrator.
You can empty the trash by right-clicking the folder from the left-hand pane and choosing Empty Trash.