Transforming Early Autism Screening with Multimodal Machine Learning in Digital Health
DOI:
https://doi.org/10.22581/0517Keywords:
Autism Spectrum Disorder, Deep Learning , Image Classification , Mobile Application , Questionnaire Model, Early DetectionAbstract
Early and accurate detection of Autism Spectrum Disorder (ASD) is the key factor in facilitating early interventions and enhancing development in children with ASD. This paper proposes an innovative, multimodal diagnostic framework that utilizes machine learning methods by combining both behavioral testing through questionnaires and facial image analysis. Each modality was trained independently, and the results were fused in a user-friendly mobile application, increasing accessibility as well as clinical utility. The proposed system demonstrates high performance in identifying ASD-related characteristics, achieving high predictive accuracy through a non-invasive, cost-effective, and scalable method. Our results demonstrate the transformative potential of machine learning to improve early ASD screening (especially in resource-limited contexts) and contribute to the development of intelligent digital health solutions. The integrated model was found to have an overall diagnostic accuracy of 85%, with the questionnaire-based classifier having almost perfect accuracy and the image-based model showing a promising generalizability. These findings show that the proposed system has the potential to become a practical solution for early ASD detection and effectively enable timely, life-changing interventions.
Downloads
References
[1] WHO, “Autism,” https://www.who.int/news-room/fact-sheets/detail/autism-spectrum-disorders, D.O.A: 05-06-2024
[2] Aba Discovery, “51 Autism Statistics,” https://www.discoveryaba.com/statistics/how-many-people-have-autism#:~:text=Around%201%25%20of%20the%20worlds,diagnosed%20with%20autism%20spectrum%20disorder, D.O.A: 30-03-2025
[3] Clinic Mayo, “Autism Spectrum Disorder - Symptoms and Causes - MayoClinic,” https://www.mayoclinic.org/diseases-conditions/autism-spectrum-disorder/symptoms-causes/syc-20352928, D.O.A: 28-05-2025
[4] Radha, S., Abinaya, M. N., Divya Darshini, K., Kamalnath, K. N., & Jayanthi, P. (2023). Ensemble of Behavioral Features for Early Detection of Autism Spectrum Disorder. In International Conference on Soft Computing for Security Applications (pp. 681-694). Singapore: Springer Nature Singapore.
[5] Shrivastava, T., Singh, V., & Agrawal, A. (2024). Autism spectrum disorder detection with kNN imputer and machine learning classifiers via questionnaire mode of screening. Health Information Science and Systems, 12(1), 18.
[6] Themistocleous, C. K., Andreou, M., & Peristeri, E. (2024). Autism Detection in Children: Integrating Machine Learning and Natural Language Processing in Narrative Analysis. Behavioral Sciences, 14(6), 459.
[7] B. Twala and E. Molloy, "On effectively predicting autism spectrum disorder therapy using an ensemble of classifiers," Scientific Reports, vol. 13, no. 1, p. 19957, 2023, doi: 10.1038/s41598-023-46379-3.
[8] I. A. Ahmed et al., “Eye Tracking-Based Diagnosis and Early Detection of Autism Spectrum Disorder Using Machine Learning and Deep Learning Techniques,” Electronics (Switzerland), vol. 11, no. 4, Feb. 2022, doi: 10.3390/electronics11040530.
[9] F. W. Alsaade and M. S. Alzahrani, "Classification and Detection of Autism Spectrum Disorder Based on Deep Learning Algorithms," Computational Intelligence and Neuroscience, vol. 2022, Article ID 8709145, 2022. [Online]. Available: https://doi.org/10.1155/2022/8709145. (Retraction published Comput. Intell. Neurosci., Oct. 4, 2023, Article ID 9893015. doi: 10.1155/2023/9893015).
[10] I. Ahmad, J. Rashid, M. Faheem, A. Akram, N. A. Khan, and R. ul Amin, “Autism spectrum disorder detection using facial images: A performance comparison of pretrained convolutional neural networks,” Healthc Technol Lett, 2024.
[11] M. S. Farooq, R. Tehseen, M. Sabir, and Z. Atal, "Detection of autism spectrum disorder (ASD) in children and adults using machine learning," Scientific Reports, vol. 13, no. 1, p. 9605, 2023, doi: 10.1038/s41598-023-35910-1.s.
[12] T. D. Dhamale, S. U. Bhandari, V. K. Harpale, and D. Nandan, "Autism spectrum disorder detection using parallel deep convolution neural network and generative adversarial networks," Traitement Du Signal, vol. 41, no. 2, 2024.
[13] Mian, T. S. (2023). Efficient Net-based Transfer Learning Technique for Facial Autism Detection. Scalable Computing: Practice and Experience, 24(3), 551-560.
[14] B. R. G. Elshoky, E. M. G. Younis, A. A. Ali, and O. A. S. Ibrahim, "Comparing automated and non-automated machine learning for autism spectrum disorders classification using facial images," ETRI Journal, vol. 44, no. 4, pp. 613–623, 2022, doi: 10.4218/etrij 2021-0097.
[15] A. Genovese and M. G. Butler, "The autism spectrum: Behavioral, psychiatric and genetic associations," Genes, vol. 14, no. 3, p. 677, 2023, doi: 10.3390/genes14030677.
[16] W. Liang, Y. Liang, and J. Jia, "MiAMix: Enhancing image classification through a multi-stage augmented mixed sample data augmentation method," Processes, vol. 11, no. 12, 2023, doi: 10.3390/pr11123284.
[17] M. Liao, H. Duan, and G. Wang, "Application of machine learning techniques to detect children with autism spectrum disorder," Journal of Healthcare Engineering, vol. 2022, 2022, doi: 10.1155/2022/9340027
[18] F. Hajjej, S. Ayouni, M. A. Alohali, and M. Maddeh, "Novel framework for autism spectrum disorder identification and tailored education with effective data mining and ensemble learning techniques," IEEE Access, vol. 12, pp. 35448–35461, 2024, doi: 10.1109/ACCESS.2024.3349988.
[19] Mujeeb Rahman, K. K., & Subashini, M. M. (2022). Identification of autism in children using static facial features and deep neural networks. Brain Sciences, 12(1), 94.
[20] Centers for Disease Control and Prevention (CDC). (n.d). Data and Statistics on Autism Spectrum Disorder, https://www.cdc.gov/ncbddd/autism/data.html (2024, July 2024)
[21] Milling, M., Baird, A., Bartl-Pokorny, K. D., Liu, S., Alcorn, A. M., Shen, J., ... & Schuller, B. W. (2022). Evaluating the impact of voice activity detection on speech emotion recognition for autistic children. Frontiers in Computer Science, 4, 837269
[22] Shrivastava, T., Singh, V., & Agrawal, A. (2024). Autism spectrum disorder detection with kNN imputer and machine learning classifiers via questionnaire mode of screening. Health Information Science and Systems, 12(1), 18.
[23] Hu, C., Thrasher, J., Li, W., Ruan, M., Yu, X., Paul, L. K., ... & Li, X. (2024). Exploring Speech Pattern Disorders in Autism using Machine Learning. arXiv preprint arXiv:2405.05126.
[24] Siddiqui, M. A., Haider, N. G., & Mustafa, S. M. N. (2024). Hybrid model for speech emotion recognition of normal and autistic children (SERNAC). Mehran University Research Journal of Engineering & Technology, 43(2), 20-33
[25] Lee, S., Mun, J., Kim, S., & Chung, M. (2024). Speech Corpus for Korean Children with Autism Spectrum Disorder: Towards Automatic Assessment Systems. arXiv preprint arXiv:2402.15539.
[26] Ahmed, I. A., Senan, E. M., Rassem, T. H., Ali, M. A., Shatnawi, H. S. A., Alwazer, S. M., & Alshahrani, M. (2022). Eye tracking-based diagnosis and early detection of autism spectrum disorder using machine learning and deep learning techniques. Electronics, 11(4), 530.
[27] Themistocleous, C. K., Andreou, M., & Peristeri, E. (2024). Autism Detection in Children: Integrating Machine Learning and Natural Language Processing in Narrative Analysis. Behavioral Sciences, 14(6), 459.
[28] Trayvick, J., Barkley, S. B., McGowan, A., Srivastava, A., Peters, A. W., Cecchi, G. A., ... & Corcoran, C. M. (2024). Speech and language patterns in autism: towards natural language processing as a research and clinical tool. Psychiatry Research, 116109.
[29] Grande-Ramírez, J. R., Roldán-Reyes, E., Delgado-Maciel, J., Cortes-Robles, G., & Meza-Palacios, R. (2024, October). Model to Early Detection of Autism Spectrum Disorder Through Opinion Mining Approach. In International Conference on Hybrid Artificial Intelligence Systems (pp. 61-72). Cham: Springer Nature Switzerland.
[30] Ahmed, M., Hussain, S., Ali, F., Gárate-Escamilla, A. K., Amaya, I., Ochoa-Ruiz, G., & Ortiz-Bayliss, J. C. (2025). Summarizing recent developments on autism spectrum disorder detection and classification through machine learning and deep learning techniques. Applied Sciences, 15(14), 8056.
[31] Ahmad, I., Rashid, J., Faheem, M., Akram, A., Khan, N. A., & Amin, R. U. (2024). Autism spectrum disorder detection using facial images: A performance comparison of pretrained convolutional neural networks. Healthcare Technology Letters.
[32] Vakadkar, K., Purkayastha, D., & Krishnan, D. (2021). Detection of autism spectrum disorder in children using machine learning techniques. SN Computer Science, 2, 1-9.
Published
Issue
Section
License
Copyright (c) 2026 Mehran University Research Journal of Engineering and Technology
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
How to Cite
Most read articles by the same author(s)
- Naveed Kaimkhani, Memoona Sami, Amirita Dewani, Junaid Ahmed, Mariam Jawed, Depression Detection in Social Media Data for Resource-Constrained Roman Urdu Using Machine Learning Methods , Mehran University Research Journal of Engineering and Technology: Vol. 45 No. 3 (2026): July Issue
Similar Articles
- Ayesha Rafique , Rabia Noor Enam, Madiha Abbasi , Noreen Akram, Application of deep learning models for pest detection and identification , Mehran University Research Journal of Engineering and Technology: Vol. 44 No. 2 (2025): April Issue
- Roshni Mustafa, Shafi Muhammad Jiskani, Muhammad Aamir Panhwar, Sanam Narejo, Zohaib Ahmed, YOLO-Scan: A Real-Time Deep Learning Framework for Brain Tumor Detection in MRI , Mehran University Research Journal of Engineering and Technology: Vol. 45 No. 2 (2026): April Issue
- Maryam Arain, Sheeraz Ahmed Memon, Attiya Baqai, Mohsin Memon, Kundan Kumar, Sajid Hussain, Zuhaib Siddiqui, Rapid Detection and Classification of Escherichia Coli, Salmonella Typhi, and Staphylococcus Aureus using Smartphone-Based Deep Learning System , Mehran University Research Journal of Engineering and Technology: Vol. 45 No. 3 (2026): July Issue
- Maria Saleem, Bushra Naz Soomro, Almas Ali, Zartasha Baloch, Multi-Modal Bio signal Transformer Based Deep Learning Approach for Mental Stress Detection , Mehran University Research Journal of Engineering and Technology: Vol. 45 No. 1 (2026): January Issue
- Zeeshan Ali Haider, Nasser A Alsadhan, Fida Muhammad Khan, Waleed Al-Azzawi, Inam Ullah Khan, Inam ullah, Deep learning-based dual optimization framework for accurate thyroid disease diagnosis using CNN architectures , Mehran University Research Journal of Engineering and Technology: Vol. 44 No. 2 (2025): April Issue
- Syed Noor Hussain Shah, Muhammad Shahan Ibad, Sumaira Johar, Omar Bin Samin, Afsheen Khalid, Sami Ur Rahman, Enhancing Malaria Diagnosis: A Hybrid Deep Learning Approach Integrating CNN-Swin Transformer, and Grad-CAM , Mehran University Research Journal of Engineering and Technology: Vol. 45 No. 2 (2026): April Issue
- Syed Mibran Hassan Zaidi, Maria Khan, Mustafa Latif, Ali Akhtar, Sallar Khan , Use of deep learning in early software bug detection , Mehran University Research Journal of Engineering and Technology: Vol. 44 No. 3 (2025): July Issue
- Muhammad Usman Malik, Muhammad Faisal Hayat, Prediction and classification of wheat plant disease in Pakistan using deep learning techniques , Mehran University Research Journal of Engineering and Technology: Vol. 44 No. 3 (2025): July Issue
- Saad Rehman Lodhi, Sobia Arshad, Junaid Ali Khan , Saad Rehman , A Semi-Supervised Approach utilizing Deep Learning Pseudo-Label Refinement and Confidence Filtering for Enhanced Image Segmentation: An application towards Skin Lesion Analysis , Mehran University Research Journal of Engineering and Technology: Vol. 45 No. 2 (2026): April Issue
- Ashar Ahmed, Mario Muñoz-Organero, Bushra Aijaz, Exploring commuter stress dynamics through machine learning and double optimization , Mehran University Research Journal of Engineering and Technology: Vol. 44 No. 2 (2025): April Issue
You may also start an advanced similarity search for this article.