Every time I install or remove a package I get LVM2 error

What worked for me was to completely get rid of lvm2 and then reinstall it:

$ sudo apt purge lvm2 && sudo apt install lvm2

After the purge (split above commands) you could also check if /etc/lvm is gone. If not delete it.
It was not enough to apt remove lvm2.

rm -rf /etc/lvm2 did not work for me or at least was not enough.