They are an interference fit to the hub so should stay in place when you remove the wheel.
My spacers bolt to the hub, then the wheel to the spacer.
My spacers bolt to the hub, then the wheel to the spacer.