No, I do not believe you need to remove the mirror from the truck. The top cap needs to be removed first. Then, if I remember correctly, the lower cover can be removed much like the top cover was. You can find videos on youtube on how to remove the upper cover. Also, when searching for a new lower cover, keep in mind whether you need one with the puddle light or not.