However, in lvm (which in turn uses dmsetup, I will note), "remove" is how you permanently blow away a volume and overwrite its label. To make something "inactive", which seems to be the semantically equivalent operation, you use "vgchange -a n".
Intuitive, no?