linguistic:translation, quality:correction, linguistic:voice_change, information:extraction, information:classification
Corpus Development in Marathi

Text Corpus and Corpus Linguistics show how texts, sentences, or words from written or spoken language have changed over time or how they have been used in an organised way. The Volume VII: 'Indo-Aryan Languages (Southern Group) of the ' Linguistic Survey of India ' by George Abraham Grierson describes first systematic and structured attempt to create documentation of Marathi language data.

Corpora in Marathi

Attempts have been made to create Corpus of Marathi. One of the first efforts to make a corpus with Indian text was the Kolhapur Corpus of Indian English (Shastri, 1986). The corpus was developed at the University in Maharastra, but Indian English was studied. The IIT Bombay WordNet (IndoWordNet; Bhattacharya, 2010) project in Indian languages includes Marathi. WordNet do not give word counts for further useful data analysis. The raw text based corpus in Marathi (Ramamoorthy et al., 2019a) is based on sampled pages from different select books. This work is carried out at Central Institute of Indian Languages, Mysore. A corpus-based linguistic study at the University of Mumbai explores the language contact between English and Marathi by compiling and analyzing an over-arching corpus of English loan-words in Marathi existing between the years 2001 and 2020. The study also investigates the attitudes of Marathi speakers towards English loan-words in contemporary Marathi, attempting to understand their motivations for borrowing English words (Doibale, 2022).

The work at University of Mumbai by Belhekar and Bhargava (2023) provided the first Marathi word count collection (Marathi WordCorp). The bag-of-words (BoW) model was used to make 1-gram (single-word) Marathi WordCorp. They used more than 700 complete works of literature.

The Google Books Ngram Viewer (Michel et al., 2011) is a relatively new and advanced method that shows how the frequency of n-grams has changed over a specific period. There is no database of Indian languages in the Google Books Ngram viewer. The Indian Languages Word Corpus (ILWC) WebApp, which was made by Belhekar and Bhargava, shows how often words are used by decade from before 1920 to 2020. The limitation with the method is that it only gives researchers the raw OCR data to "combine and collapse frequencies of correctly and incorrectly recognised words" (p. 2).

Statistical Models for Marathi Corpora

Attempts to evaluate statistical models for Marathi language Corpuses and text-collections have been carried out. For the Marathi corpus (Marathi WordCorp), the y-intercept of Zipf's law is reported as 12.49, and the coefficient is 0.89 and these numbers show that Zipf's law is applicable for Marathi language. The coefficients show that the number of words and texts used in the corpus metadata is enough. Heaps' law intercept for the Marathi word corpora is 2.48, and the coefficient is 0.73. The coefficient values show that there are more unique words in Marathi writings than would be expected. The higher number of unique words could be due to the number of alphabets (36 consonant letters and 16 initial-vowel letters, with each consonant taking 14 forms with vowel pairs), the orthographic features of the Devanagari script (for example, the same word can be written in different ways), the use of consonant clusters (jodakshar), the number of suffixes a word can have, etc.