Ardis Lu [Sat, 4 Jan 2025 07:22:00 +0000 (23:22 -0800)]
Avoid flushing to disk
Performance cost is too great (for a 100k row/100MB CSV, increases write time from 6s to 60s) for benefit (memory usage, partial recoverability if interrupted). Need to use a more intelligent approach than flushing on every row.