BanglaLM: Bangla Corpus For Language Model Research
A dataset that contains Bangla corpus for training unsupervised ML model, and it contains around 40GB of text data containing 3 versions of this dataset. This is around a 20 million sample size dataset. The title for the paper "BanglaLM: Bangla Corpus for Language Model Research"
The work was done in collaboration with researchers from Stevens Institute of Technology, Western Carolina University, Florida Atlantic University, Noakhali Science and Technology University, and Hajee Mohammad Danesh Science and Technology University, and has been accepted for publication at ICIRCA 2021.
https://github.com/Kowsher/BanglaLM-Dataset
A university or research institution
Bangladesh
BanglaLM: Bangla Corpus For Language Model Research
http://kowsher.org/
Yes - it has a direct download link or links
https://www.kaggle.com/gakowsher/bangla-language-model-dataset
Yes
Contents of this repository are restricted to only non-commercial research purposes under the Creative Commons Attribution 4.0 International License. Copyright of the dataset contents belongs to the original copyright holders.

Cite this dataset👍

@inproceedings{kowsher-etal-2021-banglalm,
    title = "BanglaLM: Bangla Corpus for Language Model Research",
    author ="Kowsher, Md. and
     Uddin, Md.Jashim and
     Tahabilder, Anik and
     Ruhul Amin, Md and
     Shahriar, Md. Fahim and 
     Sobuj, Md. Shohanur Islam
     ",
      
    conference = "International conference on inventive research in computing applications (ICIRCA)",
    month = "September",
    year = "2021",
    address = "Online",
    publisher = "IEEE",
    url = "https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3882903"
}
research use
cc-by-4.0: Creative Commons Attribution 4.0 International