With the rapid development of micro/nano machining, there is an elevated demand for high-performance microdevices with high reliability and low cost. Due to their outstanding electrochemical, optical, electrical, and mechanical performance, carbon materials are extensively utilized in constructing microdevices for energy storage, sensing, and optoelectronics. Carbon micro/nano machining is fundamental in carbon-based intelligent microelectronics, multifunctional integrated microsystems, high-reliability portable/wearable consumer electronics, and portable medical diagnostic systems. Despite numerous reviews on carbon materials, a comprehensive overview is lacking that systematically encapsulates the development of high-performance microdevices based on carbon micro/nano structures, from structural design to manufacturing strategies and specific applications. This review focuses on the latest progress in carbon micro/nano machining toward miniaturized device, including structural engineering, large-scale fabrication, and performance optimization. Especially, the review targets an in-depth evaluation of carbon-based micro energy storage devices, microsensors, microactuators, miniaturized photoresponsive and electromagnetic interference shielding devices. Moreover, it highlights the challenges and opportunities in the large-scale manufacturing of carbon-based microdevices, aiming to spark further exciting research directions and application prospectives.