Lightening fast, Parquet to CSV

[giscus[bot]]

Lightening fast, Parquet to CSV

TL;DR
This post will expose you how to convert in a very convenient and fast way 🚀 some Apache Parquet
files to CSV, and vice-versa, using either DuckDB 🦆 or Pandas 🐍 for a baseline comparison
As a quick bonus, we will embedded this tool in a small convient CLI script, easily triggered from your favorite
shell 👨‍💻
Let’s go !
Intro
Recently, I’ve been working a little bit more on Data Engineering tasks (setup a Datalake, convert data,
design pipelines, make cleanup of some data). 📊

https://emilien-foissotte.github.io/posts/2023/08/fast-convert/