Pathogenic yeasts are an increasing concern in healthcare, with species like often displaying drug resistance and causing high mortality in immunocompromised patients. The need for rapid and accessible diagnostic methods for accurate yeast identification is critical, especially in resource-limited settings. This study presents a convolutional neural network (CNN)-based approach for classifying pathogenic yeast species from microscopy images. Using transfer learning, we trained the model to identify six yeast species from simple micrographs, achieving high classification accuracy (93.91% at the patch level, 99.09% at the whole image level) and low misclassification rates across species, with the best performing model. Our pipeline offers a streamlined, cost-effective diagnostic tool for yeast identification, enabling faster response times in clinical environments and reducing reliance on costly and complex molecular methods.