Fall-risk assessment studies generally focus on identifying characteristics that affect postural balance in a specific group of subjects. However, falls affect a multitude of individuals. Among the groups with the most recurrent fallers are the community-dwelling elderly and stroke survivors. Thus, this study focuses on identifying a set of features that can explain fall risk for these two groups of subjects. Sixty-five community dwelling elderly (forty-nine female, sixteen male) and thirty-five stroke-survivors (twenty-two male, thirteen male) participated in our study. With the use of an inertial sensor, some features are extracted from the acceleration data of a Timed Up and Go (TUG) test performed by both groups of individuals. A short-form berg balance scale (SFBBS) score and the TUG test score were used for labeling the data. With the use of a 100-fold cross-validation approach, Relief-F and Extra Trees Classifier algorithms were used to extract sets of the top 5, 10, 15, 20, 25, and 30 features. Random Forest classifiers were trained for each set of features. The best models were selected, and the repeated features for each group of subjects were analyzed and discussed. The results show that only the stand duration was an important feature for the prediction of fall risk across all clinical tests and both groups of individuals.