Adnan KhanAdnanProduct & AI
San Francisco Bay Area
Get in touch

Source note2 min read

AI and Authenticity in Islamic Research: A Critical Evaluation of Generative AI Reliability, Hallucination, and Source Fidelity in Quranic, Hadith, and Fiqh Knowledge

Source

arXiv

arxiv.org/abs/2607.28237v1

Read the source

Source

Plain-Language Brief

The study evaluates the reliability of six leading generative AI systems in providing authentic and trustworthy Islamic knowledge, focusing on Qur'anic interpretation, Hadith, Fiqh, ethics, pastoral advice, and Madhhab-sensitive topics. The findings suggest that while AI can be useful for introductory Islamic learning, it should not be considered as an authoritative source without verification against authenticated primary sources and qualified scholarly expertise.

What the Document Says

  • Generative AI is being used by Muslims for religious guidance, interpretation, explanation, education, etc. but there's limited empirical evidence on its authenticity.
  • The study evaluates six leading AI systems using 50 Islamic questions covering various domains.
  • Responses were collected from participants in Australia and the UK under real-world conditions.
  • The analysis examines domain accuracy, citation verification, hallucinations, consistency, uncertainty handling, source provenance, geographical variation, etc.
  • The study addresses four research questions about AI's accuracy, hallucinations, consistency, and reliability for religious guidance and research.
  • Current AI systems are found to be valuable as assistive tools for introductory Islamic learning but not authoritative sources without verification.
  • The study offers practical guidance for researchers, educators, developers, and the Muslim community.
  • This is one of the first comprehensive empirical evaluations of AI reliability within Islamic knowledge.

Key Concepts Mentioned

  • Generative AI
  • Islamic knowledge
  • Qur'anic interpretation
  • Hadith
  • Fiqh
  • Ethics
  • Pastoral advice
  • Madhhab-sensitive topics
  • Authenticity
  • Verifiability
  • Trustworthiness

Claims Made by the Document

  • AI systems should not be treated as authoritative sources for religious rulings or Islamic research without verification.
  • Current AI systems are valuable as assistive tools for introductory Islamic learning.

Evidence Used

  • Results from the evaluation of six leading generative AI systems using fifty realistic open-ended Islamic questions

Methods / Approach

UNKNOWN

Limitations Stated by the Authors

UNKNOWN

Limitations Noted by the Agent

Agent interpretation — not from the source.

UNKNOWN

Open Questions

UNKNOWN

Notes for Future Q&A

May include interpretation. Labeled where it does.

UNKNOWN

Raw Abstract / Excerpt

Generative Artificial Intelligence (AI) is increasingly used by Muslims for religious guidance, Qur'anic interpretation, Hadith explanation, jurisprudential rulings, and Islamic education. Despite its growing adoption, there is limited empirical evidence on whether current AI systems provide authentic, verifiable, and trustworthy Islamic knowledge suitable for high-trust religious contexts. This study evaluates six leading generative AI systems using fifty realistic open-ended Islamic questions covering Qur'anic interpretation, Hadith, Fiqh, ethics, pastoral advice, and Madhhab-sensitive topics. Responses were collected under real-world conditions from participants in Australia and the United Kingdom and analysed using a mixed-method framework examining domain accuracy, citation verification, hallucinations, jurisprudential consistency, uncertainty handling, source provenance, and geographical variation. The study addresses four research questions: (1) How accurate and authentic are AI-generated responses across major Islamic knowledge domains? (2) To what extent do AI systems produce hallucinations, incomplete citations, or unverifiable religious references? (3) How consistently do models handle jurisprudential disagreement, Madhhab diversity, and uncertainty? (4) Are current AI systems sufficiently reliable for religious guidance, Islamic education, and scholarly research? Overall, current generative AI systems are valuable as assistive tools for introductory Islamic learning but should not be treated as authoritative sources for religious rulings or Islamic research without verification against authenticated primary sources and qualified scholarly expertise. This study provides one of the first comprehensive empirical evaluations of AI reliability within Islamic knowledge, offering practical guidance for researchers, educators, AI developers, and the wider Muslim community.