DataFusion’s statistics-based file group splitter assigns files to partitions by best-fit on their min/max ranges, preserving the table’s ordering while balancing the file counts.
DataFusion’s morsel-driven IO breaks files into independently-processable pieces and shares the work queue between scan tasks, so an unbalanced file distribution does not leave …