Revert "Properly propagate failure when ref deletion fails"

This reverts commit ced058a15a212b76dcd858cc5bdb6d883def88cb.

Reason for revert: Ref deletion upon fetches was not properly
implemented in stable-3.5 and therefore this fix should not be applied
in this branch.

Bug: Issue 288965464
Change-Id: I334812e07639ff4c6e4f89f9d3cce62a25b1246e