The expansion rate of medical data during the past ten years has rapidly expanded due to the vast fields. The automated disease diagnosis system is proposed using a deep learning (DL) algorithm, which automates and helps speed up the process efficiently. Further, this research concentrates on improving computation time based on the detection process. So, this research introduces a hybrid DL model for improving prediction performance andreducing time consumption compared to the machine learning (ML)model.Describing a pre-processing method utilizing statistical co-relational evaluation to improve the classifier's accuracy.The features are then extracted from the Region of Interest (ROI) images using the wrapping technique and a fast discrete wavelet transform (FDWT). The extracted curvelet coefficients and the turn-time difficulty are too excessive to be categorized. Utilizing swarm intelligence, the Adaptive Grey Wolf Optimization Algorithm (AGWOA) was presented to reduce the time difficulty and choose the key characteristics. Here, it introduces a new building block identified as the Fuzzy Scoring Resnet-Convolutional Neural Network(FS-Resnet CNN) framework to optimize the network. The performance of the proposed model was assessedutilizing metrics such as recall, precision, F-measure, and accuracy.Furthermore, the suggested framework is computationally effective, less noise-sensitive, and efficiently saves memory. The simulation findings indicate that the suggested framework has a higher detection rate than the existing prediction model.