Hi everyone,
I’m having an issue importing Parquet files into Dashtera and would like to know which Parquet compression codecs and encodings are officially supported.
In my tests, Snappy works correctly, but files compressed with ZSTD, with or without BYTE_STREAM_SPLIT, show the error: “Unable to parse this file”.
Could someone clarify which compression / encoding formats Dashtera currently supports? In particular: ZSTD, ZSTD + BYTE_STREAM_SPLIT, GZIP, LZ4 / LZ4_RAW, and Brotli.
Thanks!
Re: Which Parquet compression / encoding formats are supported?
2Thanks for asking!
We use Hyparquet library for parsing Parquet files, with its supported formats.
Hopefully this helps!
We use Hyparquet library for parsing Parquet files, with its supported formats.
Hopefully this helps!