You have to pry off the window switches and the trim around the door handle, incluing the latch. From there take out the bolts that secure the handle to the door. Remove the speaker compartment, that is held on with just clips by pulling on the bottom, there should be room right under the speaker I believe.
Once all that is off, the remainder of the panel is held on with press in clips. Just pull gently and you might want to have a large flat head screwdriver to help with that. good luck