The digital world has recently experienced a swift rise in worldwide popularity due to Virtual (VR) and Augmented Reality (AR) devices. However, concrete evidence about the effects of VR/AR devices on the physical workload imposed on the human body is lacking. We reviewed 27 articles that evaluated the physical impact of VR/AR-based tasks on the users using biomechanical sensing equipment and subjective tools. Findings revealed that movement and muscle demands (neck and shoulder) varied in seven and five studies while using VR, while in four and three studies during AR use, respectively, compared to traditional methods. User discomfort was also found in seven VR and three AR studies. Outcomes indicate that interface and interaction design, precisely target locations (gestures, viewing), design of virtual elements, and device type (location of CG as in Head-Mounted Displays) influence these alterations in neck and shoulder regions. Recommendations based on the review include developing comfortable reach envelopes for gestures, improving wearability, and studying temporal effects of repetitive movements (such as effects on fatigue and stability). Finally, a guideline is provided to assist researchers in conducting effective evaluations. The presented findings from this review could benefit designers/evaluations working towards developing more effective VR/AR products.