Skip to content

alexmarco/datamesh

This branch is up to date with dgkatz/trino-hive-superset-docker:main.

Folders and files

NameName
Last commit message
Last commit date

Latest commit

bd025bc · Aug 10, 2021

History

6 Commits
Aug 7, 2021
Aug 7, 2021
Aug 10, 2021
Aug 7, 2021
Aug 10, 2021
Aug 7, 2021
Aug 10, 2021

Repository files navigation

Cloud-native Trino (prestosql) + Hive + Minio + Superset

Technologies:

Query Engine is Trino (PrestoSQL)

Metadata Store is Apache Hive

Object Storage is Minio (S3 compatable)

Data Viz is Apache Superset

Get things running

  1. Clone repo
  2. Install docker + docker-compose
  3. Run docker-compose --compatibility up
  4. Run bash bootstrap-superset.sh
  5. Done! Checkout the service endpoints:

Trino: http://localhost:8080/ui/ (username can be anything)
Minio: http://localhost:9001/ (username: minio_access_key, password: minio_secret_key)
Superset: http://localhost:8088/ (username: admin, password: admin)

Connect to Trino in Superset:

  1. Go to data dropdown and click databases
  2. Click the + database button
  3. For Select a database to connect choose presto
  4. In SQLALCHEMY URI put trino://hive@trino-coordinator:8080/hive
  5. Switch over to Advanced tab
  6. In SQL Lab select all options
  7. In Security select Allow data upload

About

Components for build datamesh

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Dockerfile 84.6%
  • Shell 15.4%