Women Painters.com: Paint Issues and Fixes:

FADING / POOR COLOR RETENTION

Premature and/or excessive lightening of the paint color, which often occurs on surfaces with sunny southern exposure. Fading/poor color retention can also be a result of chalking of the coating.

Possible Causes:

Solution

When fading/poor color retention is a result of chalking, it is necessary to remove as much of the chalk as possible (see Chalking). In repainting, be sure to use a quality exterior house paint in colors recommended for exterior use.