MUET logo

Transforming Early Autism Screening with Multimodal Machine Learning in Digital Health

Authors

  • Abdul Razaque

    Department of Software Engineering, Mehran University of Engineering and Technology, Jamshoro, Pakistan
    Author

  • Pawang Rai

    Xoomtec, Karachi, Pakistan
    Author

  • Memoona Sami

    Department of Software Engineering, Mehran University of Engineering and Technology, Jamshoro, Pakistan
    Author

  • Junaid Baloch

    Department of Software Engineering, Mehran University of Engineering and Technology, Jamshoro, Pakistan
    Author

  • Amirita Dewani

    Department of Software Engineering, Mehran University of Engineering and Technology, Jamshoro, Pakistan
    Author

  • Mariam Memon

    Department of Software Engineering, Mehran University of Engineering and Technology, Jamshoro, Pakistan
    Author

DOI:

https://doi.org/10.22581/0517

Keywords:

Autism Spectrum Disorder, Deep Learning , Image Classification , Mobile Application , Questionnaire Model, Early Detection

Abstract

Early and accurate detection of Autism Spectrum Disorder (ASD) is the key factor in facilitating early interventions and enhancing development in children with ASD. This paper proposes an innovative, multimodal diagnostic framework that utilizes machine learning methods by combining both behavioral testing through questionnaires and facial image analysis. Each modality was trained independently, and the results were fused in a user-friendly mobile application, increasing accessibility as well as clinical utility. The proposed system demonstrates high performance in identifying ASD-related characteristics, achieving high predictive accuracy through a non-invasive, cost-effective, and scalable method. Our results demonstrate the transformative potential of machine learning to improve early ASD screening (especially in resource-limited contexts) and contribute to the development of intelligent digital health solutions. The integrated model was found to have an overall diagnostic accuracy of 85%, with the questionnaire-based classifier having almost perfect accuracy and the image-based model showing a promising generalizability. These findings show that the proposed system has the potential to become a practical solution for early ASD detection and effectively enable timely, life-changing interventions.

Downloads

References

[1] WHO, “Autism,” https://www.who.int/news-room/fact-sheets/detail/autism-spectrum-disorders, D.O.A: 05-06-2024

[2] Aba Discovery, “51 Autism Statistics,” https://www.discoveryaba.com/statistics/how-many-people-have-autism#:~:text=Around%201%25%20of%20the%20worlds,diagnosed%20with%20autism%20spectrum%20disorder, D.O.A: 30-03-2025

[3] Clinic Mayo, “Autism Spectrum Disorder - Symptoms and Causes - MayoClinic,” https://www.mayoclinic.org/diseases-conditions/autism-spectrum-disorder/symptoms-causes/syc-20352928, D.O.A: 28-05-2025

[4] Radha, S., Abinaya, M. N., Divya Darshini, K., Kamalnath, K. N., & Jayanthi, P. (2023). Ensemble of Behavioral Features for Early Detection of Autism Spectrum Disorder. In International Conference on Soft Computing for Security Applications (pp. 681-694). Singapore: Springer Nature Singapore.

[5] Shrivastava, T., Singh, V., & Agrawal, A. (2024). Autism spectrum disorder detection with kNN imputer and machine learning classifiers via questionnaire mode of screening. Health Information Science and Systems, 12(1), 18.

[6] Themistocleous, C. K., Andreou, M., & Peristeri, E. (2024). Autism Detection in Children: Integrating Machine Learning and Natural Language Processing in Narrative Analysis. Behavioral Sciences, 14(6), 459.

[7] B. Twala and E. Molloy, "On effectively predicting autism spectrum disorder therapy using an ensemble of classifiers," Scientific Reports, vol. 13, no. 1, p. 19957, 2023, doi: 10.1038/s41598-023-46379-3.

[8] I. A. Ahmed et al., “Eye Tracking-Based Diagnosis and Early Detection of Autism Spectrum Disorder Using Machine Learning and Deep Learning Techniques,” Electronics (Switzerland), vol. 11, no. 4, Feb. 2022, doi: 10.3390/electronics11040530.

[9] F. W. Alsaade and M. S. Alzahrani, "Classification and Detection of Autism Spectrum Disorder Based on Deep Learning Algorithms," Computational Intelligence and Neuroscience, vol. 2022, Article ID 8709145, 2022. [Online]. Available: https://doi.org/10.1155/2022/8709145. (Retraction published Comput. Intell. Neurosci., Oct. 4, 2023, Article ID 9893015. doi: 10.1155/2023/9893015).

[10] I. Ahmad, J. Rashid, M. Faheem, A. Akram, N. A. Khan, and R. ul Amin, “Autism spectrum disorder detection using facial images: A performance comparison of pretrained convolutional neural networks,” Healthc Technol Lett, 2024.

[11] M. S. Farooq, R. Tehseen, M. Sabir, and Z. Atal, "Detection of autism spectrum disorder (ASD) in children and adults using machine learning," Scientific Reports, vol. 13, no. 1, p. 9605, 2023, doi: 10.1038/s41598-023-35910-1.s.

[12] T. D. Dhamale, S. U. Bhandari, V. K. Harpale, and D. Nandan, "Autism spectrum disorder detection using parallel deep convolution neural network and generative adversarial networks," Traitement Du Signal, vol. 41, no. 2, 2024.

[13] Mian, T. S. (2023). Efficient Net-based Transfer Learning Technique for Facial Autism Detection. Scalable Computing: Practice and Experience, 24(3), 551-560.

[14] B. R. G. Elshoky, E. M. G. Younis, A. A. Ali, and O. A. S. Ibrahim, "Comparing automated and non-automated machine learning for autism spectrum disorders classification using facial images," ETRI Journal, vol. 44, no. 4, pp. 613–623, 2022, doi: 10.4218/etrij 2021-0097.

[15] A. Genovese and M. G. Butler, "The autism spectrum: Behavioral, psychiatric and genetic associations," Genes, vol. 14, no. 3, p. 677, 2023, doi: 10.3390/genes14030677.

[16] W. Liang, Y. Liang, and J. Jia, "MiAMix: Enhancing image classification through a multi-stage augmented mixed sample data augmentation method," Processes, vol. 11, no. 12, 2023, doi: 10.3390/pr11123284.

[17] M. Liao, H. Duan, and G. Wang, "Application of machine learning techniques to detect children with autism spectrum disorder," Journal of Healthcare Engineering, vol. 2022, 2022, doi: 10.1155/2022/9340027

[18] F. Hajjej, S. Ayouni, M. A. Alohali, and M. Maddeh, "Novel framework for autism spectrum disorder identification and tailored education with effective data mining and ensemble learning techniques," IEEE Access, vol. 12, pp. 35448–35461, 2024, doi: 10.1109/ACCESS.2024.3349988.

[19] Mujeeb Rahman, K. K., & Subashini, M. M. (2022). Identification of autism in children using static facial features and deep neural networks. Brain Sciences, 12(1), 94.

[20] Centers for Disease Control and Prevention (CDC). (n.d). Data and Statistics on Autism Spectrum Disorder, https://www.cdc.gov/ncbddd/autism/data.html (2024, July 2024)

[21] Milling, M., Baird, A., Bartl-Pokorny, K. D., Liu, S., Alcorn, A. M., Shen, J., ... & Schuller, B. W. (2022). Evaluating the impact of voice activity detection on speech emotion recognition for autistic children. Frontiers in Computer Science, 4, 837269

[22] Shrivastava, T., Singh, V., & Agrawal, A. (2024). Autism spectrum disorder detection with kNN imputer and machine learning classifiers via questionnaire mode of screening. Health Information Science and Systems, 12(1), 18.

[23] Hu, C., Thrasher, J., Li, W., Ruan, M., Yu, X., Paul, L. K., ... & Li, X. (2024). Exploring Speech Pattern Disorders in Autism using Machine Learning. arXiv preprint arXiv:2405.05126.

[24] Siddiqui, M. A., Haider, N. G., & Mustafa, S. M. N. (2024). Hybrid model for speech emotion recognition of normal and autistic children (SERNAC). Mehran University Research Journal of Engineering & Technology, 43(2), 20-33

[25] Lee, S., Mun, J., Kim, S., & Chung, M. (2024). Speech Corpus for Korean Children with Autism Spectrum Disorder: Towards Automatic Assessment Systems. arXiv preprint arXiv:2402.15539.

[26] Ahmed, I. A., Senan, E. M., Rassem, T. H., Ali, M. A., Shatnawi, H. S. A., Alwazer, S. M., & Alshahrani, M. (2022). Eye tracking-based diagnosis and early detection of autism spectrum disorder using machine learning and deep learning techniques. Electronics, 11(4), 530.

[27] Themistocleous, C. K., Andreou, M., & Peristeri, E. (2024). Autism Detection in Children: Integrating Machine Learning and Natural Language Processing in Narrative Analysis. Behavioral Sciences, 14(6), 459.

[28] Trayvick, J., Barkley, S. B., McGowan, A., Srivastava, A., Peters, A. W., Cecchi, G. A., ... & Corcoran, C. M. (2024). Speech and language patterns in autism: towards natural language processing as a research and clinical tool. Psychiatry Research, 116109.

[29] Grande-Ramírez, J. R., Roldán-Reyes, E., Delgado-Maciel, J., Cortes-Robles, G., & Meza-Palacios, R. (2024, October). Model to Early Detection of Autism Spectrum Disorder Through Opinion Mining Approach. In International Conference on Hybrid Artificial Intelligence Systems (pp. 61-72). Cham: Springer Nature Switzerland.

[30] Ahmed, M., Hussain, S., Ali, F., Gárate-Escamilla, A. K., Amaya, I., Ochoa-Ruiz, G., & Ortiz-Bayliss, J. C. (2025). Summarizing recent developments on autism spectrum disorder detection and classification through machine learning and deep learning techniques. Applied Sciences, 15(14), 8056.

[31] Ahmad, I., Rashid, J., Faheem, M., Akram, A., Khan, N. A., & Amin, R. U. (2024). Autism spectrum disorder detection using facial images: A performance comparison of pretrained convolutional neural networks. Healthcare Technology Letters.

[32] Vakadkar, K., Purkayastha, D., & Krishnan, D. (2021). Detection of autism spectrum disorder in children using machine learning techniques. SN Computer Science, 2, 1-9.

Published

2026-01-01

Issue

Vol. 45 No. 1 (2026): January Issue

Section

Articles

License

Copyright (c) 2026 Mehran University Research Journal of Engineering and Technology

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

How to Cite

Transforming Early Autism Screening with Multimodal Machine Learning in Digital Health. (2026). Mehran University Research Journal of Engineering and Technology, 45(1), 182-191. https://doi.org/10.22581/0517

Similar Articles

31-40 of 79

You may also start an advanced similarity search for this article.