Clicking on the Delete Permanently option under any media file title will delete the media file permanently.

Caution: Once a media file has been deleted, you cannot get it back.