Crystallization plays a critical role in determining crystal size, purity and morphology. Therefore, uncovering the growth dynamics of nanoparticles (NPs) atomically is important for the controllable fabrication of nanocrystals with desired geometry and properties. Herein, we conducted in situ atomic-scale observations on the growth of Au nanorods (NRs) by particle attachment within an aberration-corrected transmission electron microscope (AC-TEM). The results show that the attachment of spherical colloidal Au NPs with a size of about 10 nm involves the formation and growth of neck-like (NL) structures, followed by five-fold twin intermediate states and total atomic rearrangement. The statistical analyses show that the length and diameter of Au NRs can be well regulated by the number of tip-to-tip Au NPs and the size of colloidal Au NPs, respectively. The results highlight five-fold twin-involved particle attachment in spherical Au NPs with a size of 3-14 nm, and provide insights into the fabrication of Au NRs using irradiation chemistry.