All projects
Angie
Data extraction scripts made 65% faster through Python parallelism.
Context
The work was about data extracted from the web and social networks. The extraction scripts ran sequentially, and their duration limited what the team could collect.
My role
Data Engineer intern, five months, on extraction and scraping.
Approach
Parallelise the extraction in Python rather than rewrite the scripts, and extend the scraping to social networks.
Outcome
65% of extraction time saved.