You dont have to remove the centre console at all to fit the armrest. All you have to do is remove 4 of the securing screws so you can lift the centre console up at the rear with enough height to access the bolts for the handbrake and to fit the two clips to the opposite side to secure the bracket.
Look at either sides of the centre console by the gear stick. You will see 2 covers. Remove them and take the screws out. Then remove the ashtray from the rear and undo the two screws there. This gives enough room to work with.
Make sure you cut out the coin tray first though. I found a Stanley knife was the best for cutting the plastic. Was like cutting butter