Poly(-isopropylacrylamide) (pNIPAm) undergoes a hydrophilicity/hydrophobicity change around its lower critical solution temperature (LCST). Therefore, pNIPAm-based polymer nanoparticles (NPs) shrink above their LCST and swell below their LCST. Although temperature responsiveness is an important characteristic of synthetic polymers in drug and gene delivery, few studies have investigated the temperature-responsive catch and release of low-molecular-weight drugs (LMWDs) as their affinity to the target changes. Since LMWDs have only a few functional groups, preparation of NPs with high affinity for LMWDs is hard compared with that for peptides and proteins. However, LMWDs such as anticancer drugs often have a stronger effect than peptides and proteins. Therefore, the development of NPs that can load and release LMWDs is needed for drug delivery. Here, we engineered pNIPAm-based NPs that capture paclitaxel (PTX), an anticancer LMWD that inhibits microtubules, above their LCST and release it below their LCST. The swelling transition of the NPs depended on their hydrophobic monomer structure. NPs with swelling ratios (=NP size at 25 °C/NP size at 37 °C) exceeding 1.90 released captured PTX when cooled to below their LCST by changing the affinity for PTX. On the other hand, NPs with a swelling ratio of only 1.14 released melittin. Therefore, optimizing the functional monomers of temperature-responsive NPs is essential for the catch and release of the target in a temperature-dependent manner. These results can guide the design of stimuli-responsive polymers that catch and release their target molecules.