You are correct except that if yours is assembled like my 2004 model, you will need to first remove the radio. This is achieved by removing the rectangular plastic trim from the radio and then using a blade to disengage the clips which hold the radio in the 'cradle' (two clips each side).
Having done this you just have to be brave and pull! I've done this myself to allow the installation of electric brake controller and two-way radio head in the console rather than attaching them to the underside of the dash. I don't smoke so the ashtray has gone west to allow fitment of the radio.