CLARIN Resource Families

This is a list of computer-mediated communication corpora that are available as part of the CLARIN Resource Families initiative.

Computer-mediated communication (CMC) constitutes public and private communication on-line, such as posts on blogs, forums, comments on online news sites, social media and networking sites such as Twitter and Facebook, instant chat rooms such as, mobile phone applications such as WhatsApp and e-mail. Because corpora that compile computer-mediated communication often include very informal styles of writing, they are interesting for a wide range of research fields, such as language variation, pragmatics, media and communication studies, etc. They are also very important for the development of robust NLP tools that can deal with non-standard spelling, vocabulary and grammar. Compilation and dissemination of such corpora are hindered by the unclear legal status of CMC data when distributed as resource to the scientific community, which is further exacerbated by the rapidly changing terms of service by content providers.

This is a list of conceptual resources that are available as part of the CLARIN Resource Families initiative.

Concept-based resources include onomasiological lexical resources such as wordnets, framenets, thesauri and ontologies. Such resources are typically interlinked with semantic relations (e.g. hypernymy, hyponymy). In the vast majority of the cases, the conceptual resources can be directly downloaded from the national repositories or queried through easy-to-use online search environments.

This is a list of academic corpora that are available as part of the CLARIN Resource Families initiative.

Corpora of academic texts contain scholarly writing, which includes research papers, essays and abstracts published in academic journals, conference proceedings, and edited volumes, theses written by students at the undergraduate and graduate levels, and scientific monographs.

This is a list of dictionaries that are available as part of the CLARIN Resource Families initiative.

Dictionaries were primarily created for human use (e.g., language learning/teaching, translation, lexicology) and are typically semasiological, which means that they are organized around words and contain information on their meanings, definitions, pronunciation, etc. 

This is a list of glossaries that are available as part of the CLARIN Resource Families initiative.

Glossaries are specialised dictionaries that contain domain-specific terminology and/or expressions. In the vast majority of the cases, the glossaries can be directly downloaded from CLARIN national repositories or queried through easy-to-use online search environments.

This is a list of historical corpora that are available as part of the CLARIN Resource Families initiative.

The CLARIN ERIC infrastructure offers access to historical corpora that cover almost all of the languages spoken in countries that are either members or observers in CLARIN ERIC. In the vast majority of cases, the corpora can be directly downloaded from the national repositories or queried through easy-to-use online search environments. They are also richly tagged and mostly available under public licences.

This is a list of L2 learner corpora that are available as part of the CLARIN Resource Families initiative.

L2 learner corpora play a crucial role in second language research and pedagogy, allowing for a systematic study of how a learner of a second language acquires the new language on a lexical as well as syntactic level, and how it is influenced by his or her native language. A special characteristic of this type of corpora are the markup of errors and prosodic features of the learners.

This is a list of lexica that are available as part of the CLARIN Resource Families initiative.

Lexica are primarily used in NLP applications. They typically contain an extensive lexical inventory with specific linguistic information (e.g., morphosyntax, sentiment). In the vast majority of the cases, the lexica can be directly downloaded from CLARIN repositories or queried through easy-to-use online search environments.

This is a list of literary corpora that are available as part of the CLARIN Resource Families initiative.

Literary corpora comprise poetry and fictional prose texts, such as novels, short stories and plays. They bring together the collected works of a single author or representative from a specific literary period. Since the literary corpora are often available through powerful concordancers, they are especially well suited for a quantitative and qualitative approach to comparative literary analysis, within or across different genres and historical periods.

This is a list of manually annotated corpora that are available as part of the CLARIN Resource Families initiative.

Manual corpora are collections of texts containing manually validated or manually assigned linguistic information, such as morphosyntactic tags, lemmas, syntactic parses, named entities etc. These corpora can be used to train new language annotation tools as well as to test the accuracy of existing annotation tools. 

The corpora and corpus collections are classified into 6 categories based on the type of manual annotation:

• PoS/MSD tagging,
• Lemmatisation,
• Syntactic parsing,
• Named Entity recognition,
• Sentiment analysis, and
• Other.

This is a list of newspaper corpora that are available as part of the CLARIN Resource Families initiative.

Collections of newspapers in digital form are a rich source of information for researchers in a number of disciplines in the Humanities and Social Sciences and are especially valuable for synchronic as well as diachronic studies, ranging from history, media and communication studies to lexicography for which newspapers are a rich source of neologisms and other lexicographic phenomena.

This is a list of parallel corpora that are available as part of the CLARIN Resource Families initiative.

Parallel corpora are central to translation studies and contrastive linguistics. Many of the parallel corpora are accessible through easy-to-use concordancers which considerably facilitates the study of interlinguistic phenomena. Such corpora are also a rich source of materials for language teaching. Furthermore, parallel corpora serve as training data for statistical machine translation systems. 

This is a list of parliamentary corpora that are available as part of the CLARIN Resource Families initiative.

Parliamentary corpora are a very important multidisciplinary language resource that can be approached from many research perspectives, including not only political science, but also sociology, history, psychology, and applicative approaches to linguistics, for instance, critical discourse analysis. The good availability of parliamentary proceedings in digitized form and granted access rights to public information in the EU countries have motivated a number of national as well as international initiatives to compile, process and analyse parliamentary corpora.

This is a list of spoken corpora that are available as part of the CLARIN Resource Families initiative.

Corpora of spoken language contain transcriptions of spontaneous or planned speech, such as broadcast news or elicited narratives and dialogues. They are often aligned with the accompanying recordings. They are an invaluable resource for various kinds of linguistic research, such as phonology, conversational analysis, and dialectology. Such corpora are carefully sampled and rich in sociodemographic metadata. 

This is a list of tools for named entity recognition that are available as part of the CLARIN Resource Families initiative.

Named entity recognition (NER) is an information extraction task which identifies mentions of various named entities in unstructured text and classifies them into predetermined categories, such as person names, organisations, locations, date/time, monetary values, and so forth. They can, for example, help with the classification of news content, content recommentations and search algorithms.

This is a list of tools for text normalization that are available as part of the CLARIN Resource Families initiative.

Text normalization is the process of transforming parts of a text into a single canonical form. It represents one of the key stages of linguistic processing for texts in which spelling variation abounds or deviates from the contemporary norm, such as in texts published in historical documents or on social media. After text normalization, standard tools for all further stages of text processing can be used. Another important advantage of text normalization is improved search which can be performed with querying a single, standard variant but takes into account all its spelling variants, be it historical, dialectal, colloquial or slang.

This is a list of wordlists that are available as part of the CLARIN Resource Families initiative.

Wordlists are lexical resources which only provide alphabetical or frequency-based lexical inventories. In the vast majority of the cases, the wordlists can be directly downloaded from CLARIN national repositories or queried through easy-to-use online search environments.