Range Partitioning in DataFusion: Replacing the Hash Shuffle with Boundaries Chosen from the Data
DataFusion’s range partitioning cuts an ordered key space into N partitions at sampled boundaries, so a shuffle stays balanced even under skew and the partitions keep their order.