How the ClickHouse Buffer Engine Holds Writes in RAM and Flushes Them in the Background
Buffer shards writes in RAM, flushes them on a min/max/flush threshold algebra, and restores the block if the destination write fails.
Buffer shards writes in RAM, flushes them on a min/max/flush threshold algebra, and restores the block if the destination write fails.
Kafka offsets are committed only after the block has been written to the views, and a cancelled block is rewound to its start offset and replayed.
Log stores one .bin per column stream plus a __marks.mrk file of (rows, offset) pairs, and truncates files back to a recorded size after a crash.