All posts published on this site.
Everything published here, newest first.
DataFusion lists object-store prefixes, prunes partitions by path, fetches file metadata concurrently, and packs the surviving files into FileGroups.
DataFusion’s hash join inserts the build side in reverse order into a LIFO hash table, so the chain head is always the earliest matching row and the join output preserves the build …
DataFusion borrows the ambient Tokio runtime, funnels every spawn through a cancel-safe wrapper, and runs CPU work inline with cooperative yields instead of spawn_blocking.
DataFusion’s symmetric hash join hashes both streams, lets each side probe the other’s table, and prunes rows that can no longer match using interval arithmetic — trading memory …
DataFusion’s null-aware hash join tracks NOT IN’s three-valued logic with per-build-row bitmaps and a separate hash table of NULL-valued build rows, because the answer depends on …