Controlled-release systems that respond to external stimuli have received great interest for use in medical treatments such as for drug delivery to specific sites. Gold nanorods have an absorption band at the near-infrared region and convert the absorbed light energy into heat, which is known as a "photothermal effect". Therefore, gold nanorods are expected to act not only as an on-demand thermal converter for photothermal therapy but also as a controller of a drug-release system capable of responding to the near-infrared light irradiation. In this study, to construct a controlled-release system that responds to near-infrared light irradiation, we modified gold nanorods with polyethylene glycol (PEG) through Diels-Alder cycloadducts. When the modified gold nanorods were irradiated by near-infrared light, the PEG chains were released from the gold nanorods because of the retro Diels-Alder reaction induced by the photothermal effect. As a result of the PEG release, the gold nanorods formed aggregates. This type of controlled-release system coupled with the aggregate formation of the gold nanorods triggered by near-infrared light could be expanded to applications of gold nanorods in medical fields such as drug and photothermal therapy.