Searching for just a few words should be enough to get started. If you need to make more complex queries, use the tips below to guide you.
Article type: Research Article
Authors: Daas, Piet J.H.a; b; * | van der Doef, Suzannec
Affiliations: [a] Statistics Netherlands, Division of Corporate services, IT and methodology, Sector Process Development and Methodology, 6401 CZ, Heerlen, The Netherlands | [b] Department of Mathematics and Computer Science, Section Stochastics, Eindhoven University of Technology, 5600 MB, Eindhoven, The Netherlands | [c] Statistics Netherlands, Division of Data collection, Sector Design, 6401 CZ, Heerlen, The Netherlands
Correspondence: [*] Corresponding author: Piet J.H. Daas, Center for Big Data Statistics, Room 0C13, CBS-weg 11, 6412 EX, Heerlen, The Netherlands. Tel.: +31 45 570 6964; Fax: +31 45 572 7440; E-mail: [email protected].
Abstract: Producing an overview of innovative companies in a country is a challenging task. Traditionally, this is done by sending a questionnaire to a sample of companies. This approach, however, usually only focuses on large companies. We therefore investigated an alternative approach: determining if a company is innovative by studying the text on its website. For this task a model was developed based on the texts of the websites of companies included in the Community Innovation Survey of the Netherlands. The latter is a survey carried out every two years that focusses on the detection of innovative companies with 10 or more working persons. We found that the text-based model developed was able to reproduce the result from the Community Innovation Survey and was also able to detect innovative companies with less than 10 employees, such as startups. Model stability, model bias, the minimal number of words extracted from a website and companies without a website were found to be important issues in producing high quality results. How these issues were dealt with and the findings on the number of innovative companies with large and small numbers of employees are discussed in the paper.
Keywords: Innovation, webscraping, text analysis, Big data, concept drift
DOI: 10.3233/SJI-200627
Journal: Statistical Journal of the IAOS, vol. 36, no. 4, pp. 1239-1251, 2020
IOS Press, Inc.
6751 Tepper Drive
Clifton, VA 20124
USA
Tel: +1 703 830 6300
Fax: +1 703 830 2300
[email protected]
For editorial issues, like the status of your submitted paper or proposals, write to [email protected]
IOS Press
Nieuwe Hemweg 6B
1013 BG Amsterdam
The Netherlands
Tel: +31 20 688 3355
Fax: +31 20 687 0091
[email protected]
For editorial issues, permissions, book requests, submissions and proceedings, contact the Amsterdam office [email protected]
Inspirees International (China Office)
Ciyunsi Beili 207(CapitaLand), Bld 1, 7-901
100025, Beijing
China
Free service line: 400 661 8717
Fax: +86 10 8446 7947
[email protected]
For editorial issues, like the status of your submitted paper or proposals, write to [email protected]
如果您在出版方面需要帮助或有任何建, 件至: [email protected]