Transforming Early Autism Screening with Multimodal Machine Learning in Digital Health
DOI:
https://doi.org/10.22581/0517Keywords:
Autism Spectrum Disorder, Deep Learning , Image Classification , Mobile Application , Questionnaire Model, Early DetectionAbstract
Early and accurate detection of Autism Spectrum Disorder (ASD) is the key factor in facilitating early interventions and enhancing development in children with ASD. This paper proposes an innovative, multimodal diagnostic framework that utilizes machine learning methods by combining both behavioral testing through questionnaires and facial image analysis. Each modality was trained independently, and the results were fused in a user-friendly mobile application, increasing accessibility as well as clinical utility. The proposed system demonstrates high performance in identifying ASD-related characteristics, achieving high predictive accuracy through a non-invasive, cost-effective, and scalable method. Our results demonstrate the transformative potential of machine learning to improve early ASD screening (especially in resource-limited contexts) and contribute to the development of intelligent digital health solutions. The integrated model was found to have an overall diagnostic accuracy of 85%, with the questionnaire-based classifier having almost perfect accuracy and the image-based model showing a promising generalizability. These findings show that the proposed system has the potential to become a practical solution for early ASD detection and effectively enable timely, life-changing interventions.
Downloads
References
[1] WHO, “Autism,” https://www.who.int/news-room/fact-sheets/detail/autism-spectrum-disorders, D.O.A: 05-06-2024
[2] Aba Discovery, “51 Autism Statistics,” https://www.discoveryaba.com/statistics/how-many-people-have-autism#:~:text=Around%201%25%20of%20the%20worlds,diagnosed%20with%20autism%20spectrum%20disorder, D.O.A: 30-03-2025
[3] Clinic Mayo, “Autism Spectrum Disorder - Symptoms and Causes - MayoClinic,” https://www.mayoclinic.org/diseases-conditions/autism-spectrum-disorder/symptoms-causes/syc-20352928, D.O.A: 28-05-2025
[4] Radha, S., Abinaya, M. N., Divya Darshini, K., Kamalnath, K. N., & Jayanthi, P. (2023). Ensemble of Behavioral Features for Early Detection of Autism Spectrum Disorder. In International Conference on Soft Computing for Security Applications (pp. 681-694). Singapore: Springer Nature Singapore.
[5] Shrivastava, T., Singh, V., & Agrawal, A. (2024). Autism spectrum disorder detection with kNN imputer and machine learning classifiers via questionnaire mode of screening. Health Information Science and Systems, 12(1), 18.
[6] Themistocleous, C. K., Andreou, M., & Peristeri, E. (2024). Autism Detection in Children: Integrating Machine Learning and Natural Language Processing in Narrative Analysis. Behavioral Sciences, 14(6), 459.
[7] B. Twala and E. Molloy, "On effectively predicting autism spectrum disorder therapy using an ensemble of classifiers," Scientific Reports, vol. 13, no. 1, p. 19957, 2023, doi: 10.1038/s41598-023-46379-3.
[8] I. A. Ahmed et al., “Eye Tracking-Based Diagnosis and Early Detection of Autism Spectrum Disorder Using Machine Learning and Deep Learning Techniques,” Electronics (Switzerland), vol. 11, no. 4, Feb. 2022, doi: 10.3390/electronics11040530.
[9] F. W. Alsaade and M. S. Alzahrani, "Classification and Detection of Autism Spectrum Disorder Based on Deep Learning Algorithms," Computational Intelligence and Neuroscience, vol. 2022, Article ID 8709145, 2022. [Online]. Available: https://doi.org/10.1155/2022/8709145. (Retraction published Comput. Intell. Neurosci., Oct. 4, 2023, Article ID 9893015. doi: 10.1155/2023/9893015).
[10] I. Ahmad, J. Rashid, M. Faheem, A. Akram, N. A. Khan, and R. ul Amin, “Autism spectrum disorder detection using facial images: A performance comparison of pretrained convolutional neural networks,” Healthc Technol Lett, 2024.
[11] M. S. Farooq, R. Tehseen, M. Sabir, and Z. Atal, "Detection of autism spectrum disorder (ASD) in children and adults using machine learning," Scientific Reports, vol. 13, no. 1, p. 9605, 2023, doi: 10.1038/s41598-023-35910-1.s.
[12] T. D. Dhamale, S. U. Bhandari, V. K. Harpale, and D. Nandan, "Autism spectrum disorder detection using parallel deep convolution neural network and generative adversarial networks," Traitement Du Signal, vol. 41, no. 2, 2024.
[13] Mian, T. S. (2023). Efficient Net-based Transfer Learning Technique for Facial Autism Detection. Scalable Computing: Practice and Experience, 24(3), 551-560.
[14] B. R. G. Elshoky, E. M. G. Younis, A. A. Ali, and O. A. S. Ibrahim, "Comparing automated and non-automated machine learning for autism spectrum disorders classification using facial images," ETRI Journal, vol. 44, no. 4, pp. 613–623, 2022, doi: 10.4218/etrij 2021-0097.
[15] A. Genovese and M. G. Butler, "The autism spectrum: Behavioral, psychiatric and genetic associations," Genes, vol. 14, no. 3, p. 677, 2023, doi: 10.3390/genes14030677.
[16] W. Liang, Y. Liang, and J. Jia, "MiAMix: Enhancing image classification through a multi-stage augmented mixed sample data augmentation method," Processes, vol. 11, no. 12, 2023, doi: 10.3390/pr11123284.
[17] M. Liao, H. Duan, and G. Wang, "Application of machine learning techniques to detect children with autism spectrum disorder," Journal of Healthcare Engineering, vol. 2022, 2022, doi: 10.1155/2022/9340027
[18] F. Hajjej, S. Ayouni, M. A. Alohali, and M. Maddeh, "Novel framework for autism spectrum disorder identification and tailored education with effective data mining and ensemble learning techniques," IEEE Access, vol. 12, pp. 35448–35461, 2024, doi: 10.1109/ACCESS.2024.3349988.
[19] Mujeeb Rahman, K. K., & Subashini, M. M. (2022). Identification of autism in children using static facial features and deep neural networks. Brain Sciences, 12(1), 94.
[20] Centers for Disease Control and Prevention (CDC). (n.d). Data and Statistics on Autism Spectrum Disorder, https://www.cdc.gov/ncbddd/autism/data.html (2024, July 2024)
[21] Milling, M., Baird, A., Bartl-Pokorny, K. D., Liu, S., Alcorn, A. M., Shen, J., ... & Schuller, B. W. (2022). Evaluating the impact of voice activity detection on speech emotion recognition for autistic children. Frontiers in Computer Science, 4, 837269
[22] Shrivastava, T., Singh, V., & Agrawal, A. (2024). Autism spectrum disorder detection with kNN imputer and machine learning classifiers via questionnaire mode of screening. Health Information Science and Systems, 12(1), 18.
[23] Hu, C., Thrasher, J., Li, W., Ruan, M., Yu, X., Paul, L. K., ... & Li, X. (2024). Exploring Speech Pattern Disorders in Autism using Machine Learning. arXiv preprint arXiv:2405.05126.
[24] Siddiqui, M. A., Haider, N. G., & Mustafa, S. M. N. (2024). Hybrid model for speech emotion recognition of normal and autistic children (SERNAC). Mehran University Research Journal of Engineering & Technology, 43(2), 20-33
[25] Lee, S., Mun, J., Kim, S., & Chung, M. (2024). Speech Corpus for Korean Children with Autism Spectrum Disorder: Towards Automatic Assessment Systems. arXiv preprint arXiv:2402.15539.
[26] Ahmed, I. A., Senan, E. M., Rassem, T. H., Ali, M. A., Shatnawi, H. S. A., Alwazer, S. M., & Alshahrani, M. (2022). Eye tracking-based diagnosis and early detection of autism spectrum disorder using machine learning and deep learning techniques. Electronics, 11(4), 530.
[27] Themistocleous, C. K., Andreou, M., & Peristeri, E. (2024). Autism Detection in Children: Integrating Machine Learning and Natural Language Processing in Narrative Analysis. Behavioral Sciences, 14(6), 459.
[28] Trayvick, J., Barkley, S. B., McGowan, A., Srivastava, A., Peters, A. W., Cecchi, G. A., ... & Corcoran, C. M. (2024). Speech and language patterns in autism: towards natural language processing as a research and clinical tool. Psychiatry Research, 116109.
[29] Grande-Ramírez, J. R., Roldán-Reyes, E., Delgado-Maciel, J., Cortes-Robles, G., & Meza-Palacios, R. (2024, October). Model to Early Detection of Autism Spectrum Disorder Through Opinion Mining Approach. In International Conference on Hybrid Artificial Intelligence Systems (pp. 61-72). Cham: Springer Nature Switzerland.
[30] Ahmed, M., Hussain, S., Ali, F., Gárate-Escamilla, A. K., Amaya, I., Ochoa-Ruiz, G., & Ortiz-Bayliss, J. C. (2025). Summarizing recent developments on autism spectrum disorder detection and classification through machine learning and deep learning techniques. Applied Sciences, 15(14), 8056.
[31] Ahmad, I., Rashid, J., Faheem, M., Akram, A., Khan, N. A., & Amin, R. U. (2024). Autism spectrum disorder detection using facial images: A performance comparison of pretrained convolutional neural networks. Healthcare Technology Letters.
[32] Vakadkar, K., Purkayastha, D., & Krishnan, D. (2021). Detection of autism spectrum disorder in children using machine learning techniques. SN Computer Science, 2, 1-9.
Published
Issue
Section
License
Copyright (c) 2026 Mehran University Research Journal of Engineering and Technology
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
How to Cite
Most read articles by the same author(s)
- Naveed Kaimkhani, Memoona Sami, Amirita Dewani, Junaid Ahmed, Mariam Jawed, Depression Detection in Social Media Data for Resource-Constrained Roman Urdu Using Machine Learning Methods , Mehran University Research Journal of Engineering and Technology: Vol. 45 No. 3 (2026): July Issue
Similar Articles
- Amina Shaikh, Imran Khan Keerio, Mutiullah Shaikh, Asadullah Shah, Enhanced Real-Time Face Detection in Challenging Environments: Leveraging YOLOv8 for Partially Occluded and Low-Light Conditions , Mehran University Research Journal of Engineering and Technology: Vol. 45 No. 1 (2026): January Issue
- Shabana Hajano, Sanam Narejo, Sofia Hajano, Fouzia Hajano, A Few-Shot Learning Framework for Understanding Mobile User Behavior , Mehran University Research Journal of Engineering and Technology: Vol. 44 No. 4 (2025): October Issue
- Kamran Kazi, Arbab Nighat, Farida Memon, Tarique Rafique, Azam Rafique Memon, Robust outdoor trajectory mapping using CNN features and loop closure optimization , Mehran University Research Journal of Engineering and Technology: Vol. 44 No. 3 (2025): July Issue
- Naveed Kaimkhani, Memoona Sami, Amirita Dewani, Junaid Ahmed, Mariam Jawed, Depression Detection in Social Media Data for Resource-Constrained Roman Urdu Using Machine Learning Methods , Mehran University Research Journal of Engineering and Technology: Vol. 45 No. 3 (2026): July Issue
- Muhammad Zubair, Syed Muhammad Sajjad Haider, Ans Rehman, Muhammad Saqib Javed, Aashir Waleed, Rimsha Chauhdary, PackMLP: A Patch Based MLP Model for Intelligent Inventory Forecasting and Automation with A-LIQ QR Scanning Integration , Mehran University Research Journal of Engineering and Technology: Vol. 45 No. 1 (2026): January Issue
- Shakeel Ahmad , Sheikh Muhammad Saqib , Asif Hassan Syed , Nashwan Alromema , Ali Kararay, Exploring the best fit: A comparative analysis of AFINN, Textblob, VADER, and Pattern on Arabic reviews for optimal dictionary extraction , Mehran University Research Journal of Engineering and Technology: Vol. 44 No. 2 (2025): April Issue
- Saifullah Samo, Sameh EZZT Mohamed Ali Bdran, Raheel Ahmed Nizamani, Zero-Shot Payload Adaptation for Robotic Manipulators via Domain-Randomized Deep Reinforcement Learning , Mehran University Research Journal of Engineering and Technology: Vol. 45 No. 2 (2026): April Issue
- Aqsa Mehmood, Ali Tahir, Salman Atif, Ejaz Hussain, Farrukh Baig, Hafiz Syed Hamid Arshad, A Citizen Centered Perspective on Smart Mobility: Identifying Key Factors through the Technology Acceptance Model , Mehran University Research Journal of Engineering and Technology: Vol. 45 No. 3 (2026): July Issue
- Yang Haoxuan, Faizan Qamar, Syed Hussain Ali Kazmi, Khairul Akram Zainol Ariffin, Kashif Nisar, Hybrid Model for Data-Driven Channel Estimation in mmWave Massive MIMO Systems with Compressed Sensing and Deep Learning , Mehran University Research Journal of Engineering and Technology: Vol. 45 No. 2 (2026): April Issue
- Zahid Hussain Khaskheli , Qasim Ali, M Shehram Shah , Din Muhammad , Farast Ali, Hina Ali, Maria Khalid, Zoha Waheed, Umer Gaffar, Improving Human Action Recognition Through Cross-View Camera-Aware Augmentation , Mehran University Research Journal of Engineering and Technology: Vol. 45 No. 3 (2026): July Issue
You may also start an advanced similarity search for this article.