The various forms of cellulose-based materials possess high mechanical and thermal stabilities, as well as three-dimensional open network structures with high aspect ratios capable of incorporating other materials to produce composites for a wide range of applications. Being the most prevalent natural biopolymer on the Earth, cellulose has been used as a renewable replacement for many plastic and metal substrates, in order to diminish pollutant residues in the environment. As a result, the design and development of green technological applications of cellulose and its derivatives has become a key principle of ecological sustainability. Recently, cellulose-based mesoporous structures, flexible thin films, fibers, and three-dimensional networks have been developed for use as substrates in which conductive materials can be loaded for a wide range of energy conversion and energy conservation applications. The present article provides an overview of the recent advancements in the preparation of cellulose-based composites synthesized by combining metal/semiconductor nanoparticles, organic polymers, and metal-organic frameworks with cellulose. To begin, a brief review of cellulosic materials is given, with emphasis on their properties and processing methods. Further sections focus on the integration of cellulose-based flexible substrates or three-dimensional structures into energy conversion devices, such as photovoltaic solar cells, triboelectric generators, piezoelectric generators, thermoelectric generators, as well as sensors. The review also highlights the uses of cellulose-based composites in the separators, electrolytes, binders, and electrodes of energy conservation devices such as lithium-ion batteries. Moreover, the use of cellulose-based electrodes in water splitting for hydrogen generation is discussed. In the final section, we propose the underlying challenges and outlook for the field of cellulose-based composite materials.