While in theory we can gather the internet we need from the open web, in most cases we are constrained by the compute resources we have access to. One way round this is looking at some of the aggregated resources available and looking at how we can use these and apply them to our problem.

I’ll go through some of the large publicly available resources that it is worth being aware of, looking at how we access them, and some worked examples of using them in real projects, in particular how we can combine different datasets to unlock answers to a problem we’re trying to solve.