No you don't have to remove your door as long as you are brushing and/or rolling it. Do remove the door knob and dead bolt. It also a good idea to remove the weather stripping from the frame for a couple of days. This way the new fresh paint won't stick or be damaged by touching the weather stripping.