Despite Degenerative Cervical Myelopathy (DCM) being the most common form of spinal cord injury, effective methods to evaluate patients for its presence and severity are only starting to appear. Evaluation of patient images, while fast, is often unreliable; the pathology of DCM is complex, and clinicians often have difficulty predicting patient prognosis. Automated tools, such as the Spinal Cord Toolbox (SCT), show promise, but remain in the early stages of development. To evaluate the current state of an SCT automated process, we applied it to MR imaging records from 328 DCM patients, using the modified Japanese Orthopedic Associate scale as a measure of DCM severity. We found that the metrics extracted from these automated methods are insufficient to reliably predict disease severity. Such automated processes showed potential, however, by highlighting trends and barriers which future analyses could, with time, overcome. This, paired with findings from other studies with similar processes, suggests that additional non-imaging metrics could be added to achieve diagnostically relevant predictions. Although modeling techniques such as these are still in their infancy, future models of DCM severity could greatly improve automated clinical diagnosis, communications with patients, and patient outcomes.