Select Language

AI社区

公开数据集

160万条tweets空间嵌入

160万条tweets空间嵌入

1843.26M
138 浏览
0 喜欢
0 次下载
0 条讨论
Computer Science,NLP,Text Data,spaCy Classification

数据结构 ? 1843.26M

    Data Structure ?

    * 以上分析是由系统提取分析形成的结果,具体实际数据为准。

    README.md

    Context This dataset contains spaCy embeddings and their respective target labels for 1.6m tweets corresponding to an existing raw dataset that was published on Kaggle by Μαριο? Μιχαηλιδη? KazAnova around three years ago. From my personal experience with Kaggle kernels, spaCy seems to work quite slow on notebooks relative to my personal machine. So I believe this dataset can become really handy if you are training your own machine learning and deep learning models as it simply eliminates the first step of the process i.e. pre-processing 1.6m tweets and converting them to tweet embeddings ready to be used for learning without any hassle! Content The original dataset in its raw form can be accessed using this [link](https://www.kaggle.com/kazanova/sentiment140). Here, the dataset is divided into two files. The first `Spacy_training_full.pickle` has a shape of 1.6m x 300 as it contains standardized vectors for each tweet converted using spaCy `en_vectors_web_lg` the largest industrial strength language library provided by spaCy. A python file showing a variation for the same has been hosted on GitHub and can be accessed using this [link](https://github.com/akshaydnicator/Twitter-Sentiment-Analysis-Competition---Analytics-Vidhya/blob/master/Data_Preprocessing/Tweets_to_Spacy_embeddings.py). The second file `Spacy_targets_training_full.pickle` has corresponding target labels for the training. It is has been pre-processed using keras.utils to_categorical and can be used directly with keras. For the sake of simplicity, the order of the tweet embeddings is not changed and is kept as it is in the orginal raw dataset i.e. First 800,000 rows are labeled as '0' showing a negative sentiment and the last 800,000 rows are labeled as '1' showing positive sentiment. Acknowledgements Thanks to [Μαριο? Μιχαηλιδη? KazAnova](https://www.kaggle.com/kazanova) for the original raw tweet dataset. Inspiration Any new ideas are welcomed. For starters, it would be great to know how useful spaCy embeddings can be in machine learning and deep learning models on kaggle and what is the best accuracy that can be achieved using the huge lableled ready to use tweet embeddings public dataset.
    ×

    帕依提提提温馨提示

    该数据集正在整理中,为您准备了其他渠道,请您使用

    注:部分数据正在处理中,未能直接提供下载,还请大家理解和支持。
    暂无相关内容。
    暂无相关内容。
    • 分享你的想法
    去分享你的想法~~

    全部内容

      欢迎交流分享
      开始分享您的观点和意见,和大家一起交流分享.
    所需积分:0 去赚积分?
    • 138浏览
    • 0下载
    • 0点赞
    • 收藏
    • 分享