Memory limitation for large notebooks

Not sure how your datasets map to variables, but you can use functions or let blocks to define local scopes. Variables that are local to a scope will be garbage collected as usual after they go out of scope. So, for example, you can write a function that loads the dataset, does all the processing (perhaps by calling other functions defined in other cells), and returns whatever processing results/figures you need, but does not return the variable holding the dataset.

2 Likes