What is the difference between "Size" and "Memory" in the Properties/Data tab of the main IDE window?

I frequently work with very large datasets and like to get the dataset smaller before certain operations to improve compute speed. Which is the more relevant property for this purpose?