Unlocking Web Data for Research: Legal and Technical Foundations for Web Scraping

Project Summary

Research in the Social Sciences and Humanities increasingly depends on web data. However, a lack of technical skills, legal uncertainty, and unclear institutional guidance often block such progress. This project aims to instruct researchers and administrators at knowledge institutions on how to use web data (through web scraping) in an ethical, legal, and responsible way. By addressing this gap, the results will enable researchers to carry out innovative research with confidence, ensuring that their use of web data is transparent, FAIR, and socially responsible.

Institutions

Tilburg University | Erasmus University Rotterdam | Utrecht University

Keywords

Web Scraping, Technical Training, Legal Framework, Social Science & Humanities Research, FAIR data