SWAR: How DuckDB Skips 64 CSV Bytes at a Time
A 256-byte by 19-state transition table drives the CSV parser, and a SWAR stop mask lets it skip runs of ordinary characters 64 bytes at a time.
A 256-byte by 19-state transition table drives the CSV parser, and a SWAR stop mask lets it skip runs of ordinary characters 64 bytes at a time.