Diachronic and diatopic word embeddings from newspapers digitised by the British Library (1830-1889): North and South England

Abstract

Diachronic word embeddings (decade-level) trained with Word2Vec (via Gensim) on different geographic subcorpora of the Heritage Made Digital British and the Living with Machines historical newspaper collections:

  • North England (north.zip)

  • South England (south.zip)

At the moment, for each subcorpus, Word2Vec models are available for each decade in the period 1830-1889. More models are on the way for the following:

  • each decade in the periods 1780-1829 and 1890-1920 for both North and South England.

  • diachronic models for the following regions: Scotland, Wales, and Midlands.

The models were trained using the following parameters:

sg = True

min_count = 1

window = 5

vector_size = 200

epochs = 5

Like the embeddings in this repository, the model for each decade was aligned to the most recent one with Orthogonal Procrustes.

See related GitHub repository for the full documentation: https://github.com/Living-with-machines/DiachronicEmb-BigHistData.

Project website (Living with Machines): https://livingwithmachines.ac.uk

Data related to: Nilo Pedrazzini & Barbara McGillivray, Diachronic and diatopic word embeddings from British historical newspapers, presented at AIUCD (Convegno dell’Associazione per l’Informatica Umanistica e la Cultura Digitale) in Siena (Italy), June 2023.

Citation information

Nilo Pedrazzini, & Barbara McGillivray. (2023). Diachronic and diatopic word embeddings from newspapers digitised by the British Library (1830-1889): North and South England [Data set]. Zenodo. https://doi.org/10.5281/zenodo.7892460

Turing affiliated authors