Prosopagnosia is a selective visual agnosia characterized by the inability to recognize the identity of faces. There are both acquired forms secondary to brain damage and developmental forms without obvious structural lesions. In this review, we first discuss the diagnosis of acquired and developmental prosopagnosia, and the challenges present in the latter case. Second, we discuss the evidence regarding the selectivity of the prosopagnosic defect, particularly in relation to the recognition of other objects, written words (another visual object category requiring high expertise), and voices. Third, we summarize recent findings about the structural and functional basis of prosopagnosia from studies using magnetic resonance imaging, functional magnetic resonance imaging, and event-related potentials. Finally, we discuss recent attempts at rehabilitation of face recognition in prosopagnosia.