Lever them off with a small flat blade screwdriver. Be carefull with your paintwork though.
I've some silver side indicator bulbs from my previous car which I was going to fit to get rid of the orange look. Unfortunately the insides of the lens are orange. You can buy clear ones and I haven't got round to doing it yet.