Once you chose the option to set a cover picture, you cannot go back to the default cover. Pinterest does not give the option to delete your cover photo as of now.
You can however replace it with a new photo that better suits your blog or brand.
This article shows how you can edit the profile cover.