Alzheimer's disease (AD) and non-pathological cognitive aging have phenotypic similarities which may be influenced by an overlapping set of genetic variants. Genome-wide complex trait analysis estimates that common genetic variants account for about 24% of the variation contributing to liability for AD. It is also estimated that 24% of the variance of non-pathological cognitive aging is accounted for by common single nucleotide polymorphisms. However, although the APOE locus is associated with both AD and cognitive aging, it is not known to what extent other common genetic variants, with smaller effect sizes that influence both, overlap. We test the hypothesis that polygenic risk for AD is associated with cognitive ability and cognitive change in about 3,000 non-demented older people (Cognitive Ageing Genetics England and Scotland-CAGES-consortium). We found no significant association of polygenic risk for AD with cognitive ability or cognitive change in CAGES, indicating that the genetic etiologies of AD and non-pathological cognitive decline differ.