Select Language



文字袋数据集 可用于了解路透社的哪些文章是关于“企业收购”的

文字袋数据集 可用于了解路透社的哪些文章是关于“企业收购”的

496 浏览
0 喜欢
4 次下载
0 条讨论
NLP Classification

Data Set Information:The original data were formatted by Thorsten Joachims in the “bag-of-words” representation. There......

数据结构 ? 1.21M

    Data Structure ?

    * 以上分析是由系统提取分析形成的结果,具体实际数据为准。

    Data Set Information:

    The original data were formatted by Thorsten Joachims in the “bag-of-words” representation. There were 9947 features (of which 2562 are always zeros for all the examples) representing frequencies of occurrence of word stems in text. The task is to learn which Reuters articles are about 'corporate acquisitions'. We added a number of distractor feature called 'probes' having no predictive power. The order of the features and patterns were randomized.

    DEXTER -- Positive ex. -- Negative ex. -- Total  
    Training set --150 -- 150 -- 300  
    Validation set -- 150 -- 150 -- 300  
    Test set -- 1000 -- 1000 -- 2000  
    All -- 1300 -- 1300 -- 2600

    Number of variables/features/attributes:
    Real: 9947
    Probes: 10053
    Total: 20000

    This dataset is one of five datasets used in the NIPS 2003 feature selection challenge. Our website [Web link] is still open for post-challenge submissions. Information about other related challenges are found at: [Web link]. The CLOP package includes sample code to process these data: [Web link].

    All details about the preparation of the data are found in our technical report: Design of experiments for the NIPS 2003 variable selection benchmark, Isabelle Guyon, July 2003, [Web link] (also included in the dataset archive). Such information was made available only after the end of the challenge.

    The data are split into training, validation, and test set. Target values are provided only for the 2 first sets. Test set performance results are obtained by submitting prediction results to: [Web link].

    The data are in the following format:
    dataname.param: Parameters and statistics about the data
    dataname.feat: Identities of the features (withheld, to avoid biasing feature selection). Training set (a sparse matrix, patterns in lines, features in columns: feature number followed by value). Validation set. Test set.
    dataname_train.labels: Labels (truth values of the classes) for training examples.  
    dataname_valid.labels: Validation set labels (withheld during the benchmark, but provided now).
    dataname_test.labels: Test set labels  (withheld, so the data can still be use as a benchmark).

    Attribute Information:

    We do not provide feature information to avoid biasing feature selection.

    Relevant Papers:

    The best challenge entrants wrote papers collected in the book:
    Isabelle Guyon, Steve Gunn, Masoud Nikravesh, Lofti Zadeh (Eds.), Feature Extraction, Foundations and Applications. Studies in Fuzziness and Soft Computing. Physica-Verlag, Springer. [Web link]

    See also:
    Isabelle Guyon, et al, 2007. Competitive baseline methods set new standards for the NIPS 2003 feature selection benchmark. Pattern Recognition Letters 28 (2007) 1438–1444.
    and the associated technical report:
    Isabelle Guyon, et al. 2006. Feature selection with the CLOP package. Technical Report. [Web link].

    Citation Request:

    Isabelle Guyon, Steve R. Gunn, Asa Ben-Hur, Gideon Dror, 2004. Result analysis of the NIPS 2003 feature selection challenge. In: NIPS. [Web link].

    a. Original owners
    The original data set we used is a subset of the well-known Reuters text categorization benchmark. The data was originally collected and labeled by Carnegie Group, Inc. and Reuters, Ltd. in the course of developing the ConSTRUE text categorization system.  It is hosted by the UCI KDD repository: David D. Lewis is hosting valuable resources about this data (see We used the “corporate acquisition” text classification class pre-processed by Thorsten Joachims <thorsten '@'>. The data is one of the examples of the software package SVM-Light., see The example can be downloaded from

    b. Donor of database
    This version of the database was prepared for the NIPS 2003 variable and feature selection benchmark by Isabelle Guyon, 955 Creston Road, Berkeley, CA 94708, USA (isabelle '@'




    • 分享你的想法


    所需积分:10 去赚积分?
    • 496浏览
    • 4下载
    • 0点赞
    • 收藏
    • 分享