I just had this issue today. It seems now it is possible to to delete an attachment from a Task, but not from a conversation.
I hope this gets fixed up. An attachment with a content error can’t be removed in this case, and uploading with the same name just creates a duplicate file with the same name.