Publication

Towards Transparent Linguistic Analysis of Dutch Newspaper Article Genres using Machine Learning

Systematic study of genre in newspapers sheds light on the development of journalism discourse. The genre conventions that can be discerned in a newspaper text signal the underlying discursive norms and practices of journalism as a profession. Historical newspapers are increasingly becoming available thanks to digital newspaper archives (in the Netherlands available through Delpher.nl), providing the opportunity for large-scale empirical research. However, the digital archives do not contain fine-grained genre information that is required for this purpose. Therefore, we use machine learning to automatically assign genre labels to newspaper articles.

Machine learning facilitates substantial improvements to the outcomes of existing research by providing increased amounts of enriched data. However, the decision-making process of the machine learning pipeline needs to be verified. Our previous findings (Bilgin et al., 2018) show that accuracy scores alone are not enough to assess the performance of these pipelines and that making an informed choice not only empowers optimal study of the historical development of genre, but also increases the trustworthiness of the results. This work shows that employing a transparent approach driven by model interpretability facilitates fair comparison as well as validation of the underlying decision-making criteria of the machine learning pipelines. The criteria are presented in the form of important features, creating insights on interactions between genre-related linguistic features and bag-of-words features.

https://ir.cwi.nl/pub/28283

Analysing NL articles using Machine Learning

pdf | 22.254 kB

Recent Articles

Read more about our Media & Events
Learn More
  • Blog Item

    29% of Dutch households already use voice assistants, are you prepared?

    READ POST
  • Blog Item

    You have watched data storytelling this week and you don’t even know it

    READ POST
  • Blog Item

    The added value of utilizing external unstructured data and using it for AI4GOOD

    READ POST
Check
Thanks for reaching out. We'll be in touch.

Check
Successfully subscribed to the VIQTOR DAVIS newsletter