The acquisition and utilization of cell walls have fundamentally shaped the plant lifestyle. While the walls provide mechanical strength and enable plants to grow and occupy a three-dimensional space, successful sessile life also requires the walls to undergo dynamic modifications to accommodate size and shape changes accurately. Plant cell walls exhibit substantial mechanical heterogeneity due to the diverse polysaccharide composition and different development stages. Here, we review recent research advances, both methodological and experimental, that shed new light on the architecture of cell walls, with a focus on the mechanical heterogeneity of plant cell walls. Facilitated by advanced techniques and tools, especially atomic force microscopy (AFM), research efforts over the last decade have contributed to impressive progress in our understanding of how mechanical properties are associated with cell growth. In particular, the pivotal importance of pectin, the most complex wall polysaccharide, in wall mechanics is rapidly emerging. Pectin is regarded as an important determinant for establishing anisotropic growth patterns of elongating cells. Altogether, the diversity of plant cell walls can lead to heterogeneity in the mechanical properties, which will help to reveal how mechanical factors regulate plant cell growth and organ morphogenesis.