Developing a Beginner's Roadmap to Learn Julia High Performance Computing for Data Science

Yeah, I agree with that too. Even though memory per core is maybe not increasing the way it used to year-over-year (and has maybe even decreased in some cases?), total memory and memory per node are both still growing quite well.

It’s actually quite hard to have a dataset that does not all fit in memory in HPC land when you have clusters with petabytes of ram.

Which I suppose also fits in with the theme that you generally don’t need HPC for “data science” in the ordinary use of the term. But that doesn’t mean you can’t do lots of things that arguably qualify as data science in the HPC realm – just more things where there is also some modelling or simulation or something otherwise computationally expensive you need to do with all that data.