Replacing a Private File Results in Access Denied

I’m working on getting private files setup on my site and everything was working well. However, a need came up to update a file so that the file path stayed exactly the same. Trying to use the “replace” functionality appended a _0 to the file name which can’t happen in this case. 

I deleted the Media entity for that file, deleted the old file from the server, and created a new Media Entity with a file with the same name as the old one. The file is uploaded correctly (I can see it on the server), the media entity points to the correct path, but I get Access Denied, even logged in as administrator.

What am I doing wrong? 

Thank you!

Drupal version: 


Source: https://www.drupal.org/taxonomy/term/22/feed