This resource is an XMLized version of Sahih Albukhari, the most authentic hadith book. It has the following characteristics:
- At the macro-logical level, the collection t is structured through sections in a hierarchical manner (see Structure.xml). From thsi structure, we extracted a list of domains (Domains.txt) and an index linkig domains to hadiths (Domain-Index.txt).
- At the micro-logical level,the hadiths are fully tagged; mainly narrator names, Quran verses and the real content of each hadith (metn) are recognized (see "Micro-Documents" folder). This resource may be used for Named Entity Recognition (NER) applications and in general for information extraction from Arabic documents. The main tags are summarized as follows:
|<Metn> or <M>||The real content of the hadith (المتن|
|<Sanad>||Chain of narrators (السند)|
|<TI>||Title of a section|
|<bkh>||The name of the author (i.e. Al-Bukhari)|
|<qwl>||Indicates the hadith contains a speech of the prophet PBUH.|
|<pbuh>||The name of the prophet PBUH.|
|<proph>||The names of the prophets.|
|<mlk>||The names of anges.|
|<trb>||Names of islamic doctrines|
|<rel>||Names of religions and holy books|
|<plc>||Names of places|
|<wem>||Names of women|
|<cmtbkh>||Comments of the author (i.e. Al-Bukhari)|
|<cmt>||Comments (e.g. definitions)|
|<fnarmetn>||First narrator and metn|
|<poepart>||Part of poesy|
|<qpart>||Names of quranic surats or parts|
|<qvpart>||A part of a quranic verse|
The attribute "l" of each section tag indicates its level e.g. <S l="1"> stands for a section of level one; <S l="2"> represents a sub-section.
- We also provide full documents containing hadiths and their explanations in the TREC XML format (Full-Documents-Trec folder)
- The collection is designed for assessing Information Retrieval (IR) systems. We collected a set of standard topics (Queries.xml) and relevance judgments according to standard topic development and sampling procedures of RI compagins (see Qrels.txt).
The resource is available for free usage for the research community. Click the following links to download:
- Structured XML files (without descriptions).
- Full documents (with descriptions).
- English Documents.
- Relevance judgements (Qrels).
- Domains (topics and document-topic links)
It is distributed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License. When using it, you are encouraged to cite:
I. Bounhas, “On the Usage of a Classical Arabic Corpus as a Language Resource: Related Research and Key Challenges”, ACM Transactions on Asian and Low-Resource Language Information Processing, vol. 18, no. 3, p. Article N°23, 2019.
O. Ben Khiroun, Ayed, R., Elayeb, B., Bounhas, I., Ben Saoud, N., and Evrard, F., “Towards a New Standard Arabic Test Collection for Mono- and Cross-Language Information Retrieval”, in Natural Language Processing and Information Systems - Proceedings of The 19th International Conference on Applications of Natural Language to Information Systems, NLDB'2014, Montpellier, France, June 18-20, 2014, 2014, pp. 168–171.
The project aims to build a multilingual standard IR collection. Queries and Qrels (relevance judgments) will be published later.
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.