Skip to content

Latest commit

 

History

History
22 lines (12 loc) · 1.32 KB

README.md

File metadata and controls

22 lines (12 loc) · 1.32 KB

Leeds City Council Members Scraper

A scraper which looks at the table of councillors on the Leeds City Council website, then at each individual councillor's page in turn to figure out their elected terms.

This scraper runs on Morph on a daily basis.

Maintainability

Why?

The data is used to inform two comparisons with the data in Wikidata, with the aim of keeping Wikidata up to date. These are:

In theory, neither of these pages should highlight any differences.

Mapping IDs

Leeds City Council IDs need mapping to Wikidata IDs - this is done in lcc_id_map.py. Missing IDs are flagged at the end of a scraper run.

All IDs in this list are scraped, even if they are not current councillors. This lets us keep a historic comparison.