Releases: bruin-data/bruin
Releases · bruin-data/bruin
v0.11.137
Changelog
- caf45cf ClickHouse: Add Support for Secure Connection
- 3ea879d Merge pull request #443 from bruin-data/feature/support-empty-run-path
- 482e0a1 Merge pull request #444 from bruin-data/snowflake/add-view
- d3de2d6 hotfix: fixed column lineage bug with get asset name (#441)
- 271ead7 hotfix: fixed column name for query where column used as (#440)
- d028990 skip views
- 00d4190 snowflake test for the column lineage (#439)
- 3ba2f76 support empty run path
v0.11.136
Changelog
- c1ff4ad add metadapush operator
- 537d98a add return statement
- 17f8272 added unit tests
- a23c067 change operator logic
- 1eae02f deleted the type flag and made environment flag optional
- 7d112a1 make backwards compatible
- b3c0194 setup metadata executors
- b9f2bdf Bump vite from 5.4.10 to 5.4.14
- 2d6df8f Merge branch 'gcs-source/BRU-1421' into gcs-s3-bucket-in-source-table/BRU-1481
- b7c6485 Merge branch 'main' into gads-merge
- d096aec Merge branch 'main' into google-ads-source/BRU-1329
- 155fef7 Merge branch 'main' into mysql-conn-test
- b0ca8d4 Merge branch 'main' into refactor-connections-test
- 1f2b6d7 Merge branch 'main' into snowflake-columnDescription-push
- d21bcf1 Merge branch 'main' into snowflake-columnDescription-push
- d766c45 Merge branch 'main' into snowflake-columnDescription-push
- 426acdb Merge pull request #380 from bruin-data/google-ads-source/BRU-1329
- 71e7b8e Merge pull request #400 from bruin-data/snowflake-columnDescription-push
- 4564e1c Merge pull request #422 from bruin-data/primary-key-validation
- 45d41ba Merge pull request #424 from bruin-data/incremental-key-validation
- 2ec4bb4 Merge pull request #425 from bruin-data/dependabot/npm_and_yarn/vite-5.4.14
- eb078f1 Merge pull request #426 from bruin-data/refactor-connections-test
- c41dfa2 Merge pull request #427 from bruin-data/mysql-conn-test
- 39ce86c Merge pull request #428 from bruin-data/patch/1k
- e428f6f Merge pull request #430 from bruin-data/gcs-s3-bucket-in-source-table/BRU-1481
- 4335682 Merge pull request #438 from bruin-data/sql-escaping
- 6f0b272 Update cmd/connections.go
- 6a70def [Feature] Add default option to pipeline spec (#412)
- 7a1026f add a note about dry-run
- 900b5b1 add clickhouse connection
- d74f3c3 add column description push
- e1f6c19 add env docs
- 1c0b91a add googleads connection
- 37d7f73 add googleads docs
- 1586f08 add mock function
- 2771ac5 add ping:mysql
- 7b0c868 add sql escape
- e3eff51 add:unit tests
- 03a37b1 added validation
- fe18dd4 added validation for incremental keys
- 54f95a5 change tests
- 62f2ef9 change:test
- 008f334 config manager: add tests for googleads
- c21d696 config: test: fix erronous testdata
- 9376b52 conn manager: handle googleads connections
- 1324060 connection: handle googleads
- f6ffb86 deps: bump ingestr version to 0.13.0
- 7b24dbe do not call paralell
- 9c2d381 examples: add googleads default connection
- 4f60fbd fix lint issues
- eb1caa0 fix name
- b549a35 fix name
- 4c52e70 fix rule
- bca092d fix seed asset docs
- d126873 fix: improve column lineage handling and table name extraction (#434)
- 5424cf1 fix:lint
- 676cae5 fix:lint
- d020e1f gcs: add validation for missing credentials
- b7d6305 gcs: bump ingestr version to 0.12.11
- 2836003 gcs: improve error message when source fails validation
- 2bf86d7 gcs: remove bucket name from connection
- b4a89d1 gcs: update docs
- 25953de generate test cases to avoid data races
- f1920c3 googleads: add client
- a419636 googleads: add config
- fa42e75 hotfix: column lineage bug (#437)
- 60e1545 hotfix: remove duplicate column name in lineage (#435)
- 8c2b631 integrate GCS Ingestr source
- b45032b integration tests: update connections schema
- 4955744 lint: fix
- 4bd0481 more changes
- a335b99 pipeline: handle asset mapping for googleads
- 93cc923 run test 1k times
- b48631f tests: add schema for googleads
- f0d46f4 update docs
- c39ca42 update function logic
- 93b1adb update tests
v0.11.135
Changelog
- 42b8cfb Merge pull request #418 from bruin-data/patch/fix-athena-conn-issue
- 0ecd685 Merge pull request #419 from bruin-data/patch/clickhouse-template-doc-plus-amends
- 023b98e Merge pull request #420 from bruin-data/patch/fix-metadata-push-for-bq-sensors
- ef52bdb Merge pull request #421 from bruin-data/snowflake-fix
- 7a12ace add clickhouse temaplte docs and better error messages
- 80db4a8 change tests
- 1196467 delete error
- 6424d3a fix metadata push for bq sensors
- 3533877 fix the connection naming convention for athena
v0.11.134
v0.11.133
Changelog
- 28aa1b3 * ignore all duck db * Fix select methods to work with clickhouse * Fix tests
- b75e9a2 add byte to string for select
- 80f87f6 added select and withschema
- 5ff69a6 added tests
- a1906d0 lose whitespace
- 32d9c42 Add unit tests for lint checking in run_test.go; minor formatting updates in checks_test.go files
- 04d0fd7 Enhance linting functionality by integrating SQL parser into lint checks. Updated CheckLint function to accept a SQLParser instance, modified related calls in run.go and run_test.go, and adjusted GetRules to utilize the parser for improved validation rules.
- 2f13430 Merge branch 'feature/clickhouse-docs' of github.com:bruin-data/bruin into feature/clickhouse-docs
- c0392eb Merge branch 'main' into fix-memory-leak
- 5df1319 Merge branch 'main' into fix-memory-leak
- a6c7692 Merge branch 'main' of github.com:bruin-data/bruin
- c51233a Merge pull request #397 from bruin-data/feature/clickhouse
- c49fb70 Merge pull request #404 from bruin-data/fix-memory-leak
- 1548d54 Merge pull request #410 from bruin-data/mysql-query
- 4829127 Merge pull request #411 from bruin-data/feature/clickhouse-docs
- 77e3131 Merge pull request #414 from bruin-data/format-changes
- 0489cd6 Merge pull request #415 from bruin-data/feature/upgrade-sqlglot-26-2-1
- 5cbb589 Refactor MySQL DSN Construction for Compatibility and Default Port Handling
- 0dd053d Update clickhouse.md
- b8b2ccd add clickhouse
- 184bdd5 add clickhouse package
- ac5b212 add clickhouse windows
- 7fcfc51 add config and basic db
- bbf617d add connection
- f7f629d add docs
- 4739c6a add dummy materializer
- da8604e add linkedin connection
- 42ce5b4 add missing mappings
- a78fe66 add new asset type
- a337f6e add some more stuff
- 573da0c addapt to one query per statment, adjust materializations and tests
- 59fb1f3 bump sqlglot to v26.2.1
- 2ab8c1f change tests
- 5b2c288 comment out connection interface
- 16370c0 convert byte to string
- 30d59c7 delete bq instance
- 7322aa6 delete comments
- 362f9d4 delete unnecesarry comments
- b0c8703 do not instantiate munnecessary custom check runners
- 597aec5 ensure checks sql works with clickhouse
- a3ac40a fix annotations
- a208c66 fix athena
- 4944449 fix integration test
- 9214bda fix lint
- 241b560 fix linting issues
- 8375e3e fix materialization
- 7b918ec fix parser
- 866a811 fix: integer overflow conversion uint64 -> int64 (gosec)
- 908beaa more changes
- 75b5c14 more changes
- e0359e3 more changes
- c9b7f4d move things around
- 68e04f6 remove duck db revert pointer changes
- dce749d remove lint from run
- 7a4f40a remove panic from telemetry
- aaece5b update tests
v0.11.132
Changelog
- 74cba39 add else statement
- 6f0e927 add mutex
- 7431f03 add tests for recreate table on materialization mismatch
- f4bbfd4 change err
- 0bad5eb change error handling logic
- 44e11cf change function logic
- fcf61b4 change operator logic
- a66e238 handle materialization type changes
- 31ba94f merge delete functions
- b2670fd update create dataset
- 3ad6be4 update tests
- a028cdd Merge pull request #399 from bruin-data/snowflake-materialization-changes
- 8c133fd Merge pull request #401 from bruin-data/add-snowflake-tests
- b69b2c1 Merge pull request #402 from bruin-data/bigquery-patch
- 546f6d2 Merge pull request #403 from bruin-data/appstore-connection/BRU-1384
- 212e944 Merge pull request #405 from bruin-data/bq-patch
- 4e0949f add appstore
- db1fa5c add mockquerier
- 6b95d4b add new func to materializer
- 8d1838d add tests for create schema if not exist
- 69afdb4 appstore: allow inline keys
- c11428a appstore: tests: fix manager tests on windows
- 06e10ad change error message
- 1ffb871 change function logic
- 5238ae1 change function name
- b1781f7 changes in unit test
- 82b1d4b delete print statements
- 0372d21 fix linting issues
- e19bd98 fix linting issues
- 7598155 fix linting issues
- fcb4749 handle 404 for metadata
- df9c420 handle errors
- 52d675b handle table name
- 602d188 more test cases
- 5d56db6 python: bump ingestr version
- 1a9f0a7 python: bump ingestr version to 0.12.9
- 74aceb3 refactor function
- f2e2293 refactor function
- 77c7861 reformat operator
- 4226c6a update interfaces
- c1206f4 update the operator
v0.11.131
v0.11.130
Changelog
- 3b5d998 add mock function
- 56a85fe add mock tests
- 7eec08d add mockquerier
- 1891125 handle materialization type changes
- 4d00038 Add Dockerfile for the Bruin cli (#385)
- df1b7c2 Merge branch 'main' into feat/add-github-conn
- 8ad317f Merge pull request #390 from bruin-data/handle-materialization-type-changes
- b54de6c Merge pull request #391 from bruin-data/feat/add-github-conn
- 1178028 Merge pull request #394 from bruin-data/add-dataset-snowflake
- 91ca82c Merge pull request #398 from bruin-data/handle-encrypted-keys
- 2ab0ef7 Update pkg/snowflake/config.go
- 537978b Update pkg/snowflake/config.go
- d100ba1 Update pkg/snowflake/config.go
- 1efb884 add client
- 216def1 add config to get tiktok uri
- c35a594 add default connection
- 295aca3 add doc
- d8a7b53 add encrypted key validation
- c0e55a5 add error handling
- f924ed2 add github connection
- bf1c76c add name handling
- 5e26f2b add test data
- 9f7dbde add/remove GitHub connection from environment
- 8556d05 call the function in operator
- 402d8a4 change function name
- d54dbac check error
- ed651f6 fix gci
- b2b24a2 fix lint
- 78e80f8 fix lint issues
- 7aa9f7b fix linting issues
- 3bef07f fix logic
- 5ed2e61 fix mock function
- ad456d0 fix tests
- 3a2ebb0 fix: added git in bruin docker file (#396)
- 1330bf1 handle error
- 0fd6caf handle github connection
- 36c69f9 handle unexisting databases
- 0eaf8c5 make access token optional
- 780bcf9 use string concenation
v0.11.129
Changelog
- 4e97963 add error handling
- 88126de add error handling
- 8d86bff add mock function
- eb284c7 added caching
- 55c8982 change error messagws
- 6ee6fa5 create dataset if it doesnt exist
- a362d52 delete uv assets
- 212dbd5 handle when meta has zero clusters and partitions
- 43e98a7 new cache for every client
- 51d2e5e remove sync map from operator struct
- cd1aee6 Added documentation for seed assets across multiple platforms (#377)
- a7cdd51 Added support for new seed asset types: Postgres, Redshift, MsSQL, Databricks, Snowflake, Athena, and Synapse. (#375)
- 4e57f19 Fix SynapseDialect constant value from "synapse" to "mssql" in dialect.go (#392)
- e265ac3 Hotfix: Refactor asset type validation for seed assets in lint rules (#389)
- bdc6d3b Merge branch 'main' into handle-cluster-change
- 8625bae Merge branch 'main' into handle-cluster-change
- 24964de Merge pull request #376 from bruin-data/handle-cluster-change
- 09d1e0f Merge pull request #379 from bruin-data/parallel-tests
- 9614b2f Merge pull request #382 from bruin-data/change-pipelines
- 2c5a55c Merge pull request #383 from bruin-data/bq-add-dataset
- 873966e Merge pull request #387 from bruin-data/integration-tests-fast
- c5b905d Merge pull request #388 from bruin-data/bq-create-dataset
- bc9b884 Merge pull request #393 from bruin-data/feature/snowflake-rsa-key
- 4e5aaf3 Reverted pkg/bigquery/db_test.go to its state in commit 1f648d3
- c2152b9 add docs
- 5e202ab add gitignore
- 18a79cf add gocurrent
- 0c94c7e add instance type docs
- 28416b1 add integration test light
- 9ea2898 add mockmoterializer function
- adf221d add mockquerierwith result
- 6cb18ab add new filters pipeline
- 4ea19ff add new tags pipeline
- f7cf4e2 add new uv assets
- 731976d add tiktok connection
- afaa9eb added cluster and partioning handling
- 934f91e added new main with filters pipeline
- dc27dab added unit tests
- e519dd6 added unit tests
- 185d355 bump ingestr
- 96c493a change mock logic
- 4429f8c create dataset if not exist
- fbabbf7 delete false function decleration
- 49b8719 delete filters pipeline
- c97e11a delete goroutines
- a594f82 delete tags pipeline
- 3f21843 delete unecessary pipeline
- 1381080 delete unncessary lines
- 53f329e delete unnecesarry comments
- aabae70 delete unnecessary comments
- 2721add delete unnecessary file
- 1d6b20f deleted main with filters pipeline
- 50e0690 feat: experimental support for RSA key auth for snowflake
- a2c5f6f fetch clustering and partioning info
- 8e3433f fix expected state
- 168a8fc fix imports
- 0e0d564 fix lint
- 0676a19 fix lint issues
- be81312 fix python asset
- 813009a fix tests
- 7720646 fix unit tests
- 0ce29c2 handle for different projects
- 22e4619 modify test case: continue
- 7992f21 more changes
- 817be5c new env
- 272cdfd new environment for run-seed-data
- 98097c0 new pipeline
- 2af3c7a update happy path
- fe3527f update test case
- 7ed17da update test cases
- 06b9abf update tests
- a454d00 updated test case
- d8dcfd3 updated test case
v0.11.128
Changelog
- f9b08c1 changed pipeline
- 8e37aa3 more changes
- ff69b68 run tests in dif environments
- 1d76ff2 seperate pipelines for integration tests
- 730bf36 Added 'bq.source' asset type (#365)
- 3118a1c Added logging for command execution in the Task.Run() method.
- ba236c2 Fix lint (#373)
- a57b20b Fix: use temp file for backup a assets in integration test (#364)
- dd78839 Hotfix: fix bq.source handling (#367)
- 70d8215 Merge pull request #363 from bruin-data/downstream-integration-test
- e6645fe Merge pull request #366 from bruin-data/make-tests-independent
- fc89281 Merge pull request #369 from bruin-data/run-tests-dif-env
- 1810345 Merge pull request #372 from bruin-data/add-new-template
- 6c14f58 Merge pull request #374 from bruin-data/log-error-e2e
- b8b91a5 Merge pull request #378 from bruin-data/fix-lint-2
- a09b92d Refactor: Integration test (#361)
- d49c858 Seed data into the destination databases (#368)
- a6b7bf7 Update Makefile to specify golangci-lint version and clean up struct definitions in pipeline.go
- 4c6e6fc add logs/runs to the gitignore as well
- f9a889d add new pipeline template
- b692177 added integration test for the downstream flag
- b904247 change in make file
- fa5f86e change in makefile
- c6fddac change makefile
- e9c1180 delete more files
- 63a26d9 delete unnecessary files
- 494eb80 ensure state is in gitignore
- 8289b28 find bruin markers even if the file starts with empty lines
- 476c32b inject dates to ingestr on every load
- 07b705b more changes
- b1760ac more changes
- b2178ce more pipelines