Skip to content
Opensource internals
  • Posts

Datafusion

DataFusion's Hash Join Keeps One Hash Table Per Partition and One Chain Per Key

Oct 21, 2026 13 min read Jay Hubbert

DataFusion’s hash join builds one hash table per partition: a hashbrown table maps a folded 64-bit hash to a chain of row indices stored in a flat u32/u64 array, and the payload …

DatafusionJoinsPerformanceInternals

Read more →

DataFusion's Group Values Are Columnar: How Multi-Column GROUP BY Keys Skip the Row Copy

Oct 21, 2026 10 min read Jay Hubbert

DataFusion splits group-key interning into a hash table of (hash, group id) plus one column builder per key column, so multi-column GROUP BY never materializes a row per group.

DatafusionAggregationPerformanceInternals

Read more →

← Newer Page 15 of 15 Older →

© 2026 Jay Hubbert · Built with Hugo 0.168.0

RSS ·