Alex Portugal
Developer and data analyst. I build systems that collect, organise and analyse data, from the crawler that captures it to the API or report that puts it to use.
What I do
I work across the whole data chain: I find the data, collect it automatically, store it in a sound structure, validate it and turn it into a figure, a report or an API someone can use.
Cercand is my project and my calling card: I designed, built and deployed everything you see here, and it runs every night without anyone touching it.
Capabilities
Web scraping at scale, data modelling and SQL, data quality and validation.
Python, Django, REST APIs and multilingual websites.
Docker, Linux, nginx and TLS, self-run servers and monitoring.
Price indices, descriptive statistics and market comparisons.
Reference project: the price observatory
A complete system, from collection to publication, that measures supermarket and pharmacy prices every day.
- CollectionCrawlers that go through eight websites every night.
- DataA database holding the full price history.
- AnalysisA chained price index, built with the method statistics offices use.
- PublicationThis website in four languages and two public APIs.
How I work
Only with public data, or with the data you give me. Every figure has a source and a date, and before publishing one I check that it measures what it claims: a format change or a duplicated product must not pass for a price rise.
Have a data project?
Tell me what you need and I'll tell you how I would do it.