How to cleanup garbage in remote git repo
If anyone else is experiencing this, the answer turned out to be yes.
Bitbucket support ran the following:
git reflog expire --expire="1 hour" --all
git reflog expire --expire-unreachable="1 hour" --all
git prune --expire="1 hour" -v
git gc --aggressive --prune="1 hour"
The before and after reduced the remote repo size from over 2GB, to under 1GB.
We think we had the same problem today and were able to solve it without contacting Bitbucket support, as below. Note that the method discards last commit from the repo - so you probably want to have its backup.
Bitbucket reported that our repo was about 2.1GB, while when cloned, it only took about 250MB locally. From this, we concluded that it's most likely from big files in unreachable commits (thanks to this answer).
This is how to see unreachable commits locally, where we don't take into account reachability via reflog:
git fsck --unreachable --no-reflog
Locally, unreachable commits can be cleaned with:
git reflog expire --expire-unreachable="now" --all
git prune --expire="now" -v
git gc --aggressive --prune="now"
We cannot however run any of these commands remotely on Bitbucket. But, they say on the page about reducing repo size (section Remove the repository limitation) that they run git gc
themselves in response to doing git reset --hard HEAD~1
(which discards last commit) followed by git push -f
. Also, they say in the section Garbage collecting dead data that one can try the sequence: git reflog expire --expire=now --all
, git gc --prune=now
, git push --all --force
. Given all this, I decided to try the following locally, hoping it'd cut out the reflog and do a prune locally, and then push them to remote Bitbucket repository, on which it'd start a gc:
git reflog expire --expire-unreachable="30m" --all
git prune --expire="30m" -v
git gc --prune="30m"
git reset --hard HEAD~1
git push -f
This worked, repo size immediately went from 2.1GB to ca. 250MB. :)
Note that the time param to expire / expire-unreachable / prune sets the expiration cut-off point measuring from now back. So e.g. "now" means expire / prune everything, and "30m" means except for changes in last 30 minutes.