Select Language

AI社区

公开数据集

阿拉伯语Wiki数据转储2018

阿拉伯语Wiki数据转储2018

127 浏览
0 喜欢
0 次下载
0 条讨论
NLP,Languages,Neural Networks Classification

数据结构 ? 0M

    Data Structure ?

    * 以上分析是由系统提取分析形成的结果,具体实际数据为准。

    README.md

    Context Arabic is a rich and major world language. Recent advances in computational linguistics and AI can be applied to Arabic but not in the generic way most languages are treated. This dataset (Arabic articles from Wikipedia) will be used to train Word2Vec and compare performance with publicly available pre-trained model from FastText (Facebook) in a generic way. A related model is now available: https://www.kaggle.com/abedkhooli/arabic-ulmfit-model Content All Wikipedia Arabic articles from the January 20, 2018 data dump (compressed) in wikimedia format. Cntent is expected to be (mostly) in modern standard Arabic Acknowledgements Thanks to Wikipedia for making public data dumps available and for Facebook for releasing pre-trained models. Inspiration The challenges (opportunities) here are mostly in the pre-processing of the token and text normalization, plus hyper parameter tuning for different purposes. It is easy to isolate Arabic tokens (many articles have non-Arabic words), but tokenization is a challenge: how to treat accented (7arakaat or tashkeel) and non-accented word forms, same word form with different meanings, suffixes and prefixes (especially w).
    ×

    帕依提提提温馨提示

    该数据集正在整理中,为您准备了其他渠道,请您使用

    注:部分数据正在处理中,未能直接提供下载,还请大家理解和支持。
    暂无相关内容。
    暂无相关内容。
    • 分享你的想法
    去分享你的想法~~

    全部内容

      欢迎交流分享
      开始分享您的观点和意见,和大家一起交流分享.
    所需积分:0 去赚积分?
    • 127浏览
    • 0下载
    • 0点赞
    • 收藏
    • 分享