Aug 30, 2023
Hi Great article, just one question: What happens if the original file had records ordered by some type and let's say that each type had memory_limit size of records, wouldn't each smaller file get to shuffle only records of the same type ?