The use of electronic health records (EHRs) has grown significantly in the past decade. Health information databases contain sensitive patient information, including their names and addresses, tests, diagnoses, treatment, and medical history. This information should be secured and protected from manipulation and fraudulent use by third parties. EHRs are expected to increase efficiency in healthcare delivery, improve healthcare quality, and relieve increased financial pressure. Despite these expected benefits, EHRs are potentially vulnerable to security concerns that may affect the confidentiality and privacy of patients' personal information. This paper presents a literature review of EHRs, factors that support the security and safety of health records, potential security breaches, and solutions to inherent security concerns. The study collects data through a systematic review of past studies that have addressed the topic of EHRs and security issues, and other relevant publications on EHR systems, and procedures that help safeguard health records databases. A total of 30 sources are analyzed for all pertinent information regarding security concerns of health records databases. These sources were obtained through an internet search on credible databases, including Google Scholar, PubMed, and CINAHL databases. The results of the current study reveal the perceived vulnerability of EHRs to security concerns, common security issues, the nature of these common security concerns, Health Insurance Portability and Accountability Act rules, provider responsibilities, and recommendations for reducing EHR security risks. This paper also reveals effective strategies such as privacy-protection awareness and staff training to enhance the security of health records databases.