42.parquet – A Zip Bomb for the Big Data Age

A 42 KB Parquet file can contain over 4 PB of data due to its compression methods. This exploit, similar to a Zip Bomb, highlights the potential dangers of Parquet files and the importance of careful interpretation. DuckDB can read the file, but materializing the entire table would require over 4 PB of memory.

Source: https://duckdb.org/2024/03/26/42-parquet-a-zip-bomb-for-the-big-data-age.html