Select Language

公开数据集

2019用于意图分类和范围外预测的评估数据集

2019用于意图分类和范围外预测的评估数据集

Scene:

N/A

Data Type:

Classification
所需积分:15 去赚积分?
  • 256浏览
  • 1下载
  • 0点赞
  • 收藏
  • 分享

Data Preview ? 1M

    Data Structure ?

    *数据结构实际以真实数据为准

    Data Set Information:

    There are 4 versions of the dataset:
    - data_full.json: each of the 150 in-domain intent classes have 100 train, 20 val, and 30 test samples. The out-of-domain class has 100 train, 100 val, and 1,000 test samples. Note that the out-of-domain class does not necessarily need to be used at training time. This is the main version of the dataset.
    - data_small.json: each of the 150 in-domain intent classes have 50 train, 20 val, and 30 test samples. The out-of-domain class has 100 train, 100 val, and 1,000 test samples. Note that the out-of-domain class does not necessarily need to be used at training time.
    - data_imbalanced.json: each of the 150 in-domain intent classes have either 25, 50, 75, or 100 train, 20 val, and 30 samples. The out-of-domain class has 100 train, 100 val, and 1,000 test samples. Note that the out-of-domain class does not necessarily need to be used at training time.
    - data_oos_plus.json: same as data_full.json except there are 250 out-of-domain training samples.


    Attribute Information:

    All samples are in text format. No tokenization has been applied. Users of this dataset are free to use whatever sentence representation (e.g. bag-of-words, sentence embeddings) they choose.


    Relevant Papers:

    This dataset is from this paper: [Web link]

    'Stefan Larson, Anish Mahendran, Joseph J. Peper, Christopher Clarke, Andrew Lee, Parker Hill, Jonathan K. Kummerfeld, Kevin Leach, Michael A. Laurenzano, Lingjia Tang, and Jason Mars. 2019. An evaluation dataset for intent classification and out-of-scope prediction. In Proceedings of EMNLP-IJCNLP.'



    Citation Request:

    Please cite as: 'Stefan Larson, Anish Mahendran, Joseph J. Peper, Christopher Clarke, Andrew Lee, Parker Hill, Jonathan K. Kummerfeld, Kevin Leach, Michael A. Laurenzano, Lingjia Tang, and Jason Mars. 2019. An evaluation dataset for intent classification and out-of-scope prediction. In Proceedings of EMNLP-IJCNLP.'

    Bibtex link: [Web link]

    Paper link: [Web link]

    Email contact: stefan.dataset '@' gmail.com


    Please cite as: 'Stefan Larson, Anish Mahendran, Joseph J. Peper, Christopher Clarke, Andrew Lee, Parker Hill, Jonathan K. Kummerfeld, Kevin Leach, Michael A. Laurenzano, Lingjia Tang, and Jason Mars. 2019. An evaluation dataset for intent classification and out-of-scope prediction. In Proceedings of EMNLP-IJCNLP.'

    Bibtex link: https://www.aclweb.org/anthology/D19-1131.bib

    Paper link: https://www.aclweb.org/anthology/D19-1131/

    Email contact: stefan.dataset '@' gmail.com

    0相关评论
    ×

    帕依提提提温馨提示

    该数据集正在整理中,为您准备了其他渠道,请您使用

    注:部分数据正在处理中,未能直接提供下载,还请大家理解和支持。