ETL scripts for Bitcoin, Litecoin, Dash, Zcash, Doge, Bitcoin Cash. Available in Google BigQuery https://goo.gl/oY5BCQ

Clojure API for a more dynamic Google Dataflow

Streaming Ethereum and Bitcoin blockchain data to Google Pub/Sub or Postgres in Kubernetes

Export a whole BigQuery table to Google Datastore with Apache Beam/Google Dataflow

Blockchain ETL Architecture

Stream Twitter Data into BigQuery with Cloud Dataprep

Tokenize Japanese text on BigQuery with Kuromoji in Apache Beam/Google Dataflow at scale

Metrics collection library for Google Dataflow

ETL scripts for Hedera Hashgraph

Statistical processing of COVID-19 data using Apache Beam for Google Cloud Dataflow in Python. Project for the exam of "Sistemi ed Applicazioni Cloud" (2019-20), Magistrale di Ingegneria Informatica at the Dipartimento di Ingegneria Enzo Ferrari.

ETL scripts for EOS.

Tutorials on Google Cloud Platform

Getting Started with Apache Beam: inverted index

A go daemon that collects monitoring metrics from Google Dataflow workers and exposes them to Prometheus

Dataflow pipeline for detecting anomalous transactions on the Ethereum and Bitcoin blockchains

Solace connector for Apache Beam / Google Cloud Dataflow

Cookiecutter template for Google Cloud Dataflow Python projects

Read files from s3 and create pcollection from it.

Slides and code for my talk 'Data pipelines. From zero to cloud scale'

Apache Beam (Google Dataflow) demo