Follow the directions on the product you are using. Aluminum forms a protective layer of aluminum oxide almost instantly upon exposure to the normal atmosphere. The thicker that layer gets, the more it becomes a bond breaker.
Prep and then scuff the aluminum right before you hit it with the primer.
Ease all the edges with a file or sandpaper. That will help the paint roll around the edge better and not give it a place to start peeling.
Aluminum is not really a dirty metal. The aluminum oxide just shows up as very dark gray to black when it is rubbed off due to the very fine particle size.
Do not spray too dry, everyone sprays too dry because they are afraid of runs and then the paint looks like crap. Also with self etching primers, you need to get a heavy enough layer that etching can happen. If it dries too fast from being too thin, it won't etch.