Skip to content
Opensource internals
  • Posts

Topk

Top K per Partition: How DataFusion Replaces a Full Sort with N Small Heaps

Oct 21, 2026 8 min read Jay Hubbert

DataFusion’s PartitionedTopK keeps one bounded heap per partition key, sharing a single row converter, memory reservation and row store, so a per-partition top-k costs O(N) instead …

DatafusionWindow functionsTopkPerformanceInternals

Read more →

© 2026 Jay Hubbert · Built with Hugo 0.168.0

RSS ·