There is increasing interest in Alzheimer's disease related plasma biomarkers due to their accessibility and scalability. We hypothesized that integrating plasma biomarkers with other commonly used and available participant data (MRI, cardiovascular factors, lifestyle, genetics) using machine learning (ML) models can improve individual prediction of cognitive outcomes. Further, our goal was to evaluate the heterogeneity of these predictors across different age strata. This longitudinal study included 1185 participants from the Mayo Clinic Study of Aging who had complete plasma analyte work-up at baseline. We used the Quanterix Simoa immunoassay to measure neurofilament light, Aβ and Aβ (used as Aβ/Aβ ratio), glial fibrillary acidic protein, and phosphorylated tau 181 (p-tau181). Participants' brain health was evaluated through gray and white matter structural MRIs. The study also considered cardiovascular factors (hyperlipidemia, hypertension, stroke, diabetes, chronic kidney disease), lifestyle factors (area deprivation index, body mass index, cognitive and physical activities), and genetic factors (, single nucleotide polymorphisms, and polygenic risk scores). An ML model was developed to predict cognitive outcomes at baseline and decline (slope). Three models were created: a base model with groups of risk factors as predictors, an enhanced model included socio-demographics, and a final enhanced model by incorporating plasma and socio-demographics into the base models. Models were explained for three age strata: younger than 65 years, 65-80 years, and older than 80 years, and further divided based on amyloid positivity status. Regardless of amyloid status the plasma biomarkers showed comparable performance (² = 0.15) to MRI (² = 0.18) and cardiovascular measures (² = 0.10) when predicting cognitive decline. Inclusion of cardiovascular or MRI measures with plasma in the presence of socio-demographic improved cognitive decline prediction (² = 0.26 and 0.27). For amyloid positive individuals Aβ/Aβ, glial fibrillary acidic protein and p-tau181 were the top predictors of cognitive decline while Aβ/Aβ was prominent for amyloid negative participants across all age groups. Socio-demographics explained a large portion of the variance in the amyloid negative individuals while the plasma biomarkers predominantly explained the variance in amyloid positive individuals (21% to 37% from the younger to the older age group). Plasma biomarkers performed similarly to MRI and cardiovascular measures when predicting cognitive outcomes and combining them with either measure resulted in better performance. Top predictors were heterogeneous between cross-sectional and longitudinal cognition models, across age groups, and amyloid status. Multimodal approaches will enhance the usefulness of plasma biomarkers through careful considerations of a study population's socio-demographics, brain and cardiovascular health.