The development of class- and isoform-selective histone deacetylase (HDAC) inhibitors is highly desirable for the study of the complex interactions of these proteins central to transcription regulation as well as for the development of selective HDAC inhibitors as drugs in epigenetics. To provide a structural basis for the rational design of such inhibitors, a combined computational and experimental study of inhibition of three different histone deacetylase isoforms, HDAC1, -6, and -8, with three different hydroxamate inhibitors is reported. While SAHA was found to be unselective for the inhibition of class I and class II HDACs, the other inhibitors were found to be selective toward class II HDACs. Molecular dynamics simulations indicate that this selectivity is caused by both the overall shape of the protein surface leading to the active site and specific interactions of an aspartate residue in a polar loop and two phenylalanines and a methionine in a nonpolar loop. Monitoring the specific interactions as a function of the simulation time identifies a key sulfur-pi interaction. The implications of the structural motifs for the design of class II-selective HDAC inhibitors are discussed.