The factory substrate is a good foundation to start. Pull the handle, lock cylinder, and door panel. I'd pull the hinge plates too, but not absolutely necessary. Clean the surface with a good mutipurpose cleaner and a gray scotchbrite pad. Dry and wipe down again with wax/grease remover. Wet sand with 400-600 grit wet/dry sandpaper. Try not to sand thru the basecoat if you can help it. When everything looks dull and uniform, clean again with wax/grease remover(always use clean, lint free, disposable towels for cleaning), and apply your primer. Let the primer dry for a bit and check your work. The primer will tell you what you've missed, and what is acceptable. Sand with 600 grit and apply more primer if needed. Your top coat will only look as good as what is under it, so it is important to have the final primer coat looking good.