Development Release - v0.1.33

What's Changed

• chore: Start 0.1.33 dev by @mediuminvader in #1828
• feat: synchronize GrpcConfig with proto and add phase in AppResponse by @duonganhthu43 in #1830
• feat: implement live code reload experience. by @v3g42 in #1826
• refactor: Remove nested record ref. Add ProcessorRecordStore by @chubei in #1835
• chore: add autdit field created_at updated_at, allow sort input by @duonganhthu43 in #1836
• chore: Rename err_threshold to error_threshold. Remove unused parameter. by @chubei in #1837
• feat: udf onnx config placeholder by @chloeminkyung in #1831
• Fix JavaScript capitalization by @friederbluemle in #1840
• chore: Add "persist" message to pipeline by @chubei in #1841
• chore: Move Epoch from dozer-types to dozer-core by @chubei in #1843
• feat: Add list_endpoints to internal server by @chubei in #1823
• fix: Should use tokio mutex in async context by @chubei in #1842

New Contributors

• @friederbluemle made their first contribution in #1840

Full Changelog: v0.1.32...v0.1.33

Development Release - v0.1.32

What's Changed

• Start v0.1.32 dev by @mediuminvader in #1808
• chore: LogClient automatically retries on network error by @chubei in #1811
• chore/add slug as criteria for fetching account metadata by @duonganhthu43 in #1815
• chore: Add SourceFactory::get_output_port_name to simplify ui graph generation by @chubei in #1812
• feat: Allow to use client properties in login command by @karolisg in #1813
• fix: Fix inconsistent prost enum tag annotation by @chubei in #1817
• chore: Add phase and last_error to DeploymentStatus by @chubei in #1818
• fix: Don't hardcode s3 storage region by @chubei in #1822
• fix: Remove s390x from log js publishing by @mediuminvader in #1827

Full Changelog: v0.1.31...v0.1.32

Development Release - v0.1.31

What's Changed

• Start v0.1.31 dev by @mediuminvader in #1779
• chore: Remove Schema::identifier by @chubei in #1776
• fix: Truncate credentials file when new profiles added or updated by @karolisg in #1783
• fix: Fix display of missing app error by @karolisg in #1784
• feat: refactor records by @v3g42 in #1781
• test: Removed duplicate types by @gautamprikshit1 in #1780
• chore: Update geo to use latest stable Rust by @chubei in #1785
• chore: Remove unused trait ExpressionExecutor. by @chubei in #1787
• chore: Include column name in InvalidColumn error by @chubei in #1791
• perf: Replace Vec<u8> with u64 in join lookup table to save memory by @chubei in #1795
• feat: marker file detection for object storage by @chloeminkyung in #1790
• chore: Update arrow version and its ecosystem to 42 by @chubei in #1793
• perf: Optimize memory usage for Lifetime by @chubei in #1796
• chore: Remove unused function ProcessorRecord::extend_referenced_fields by @chubei in #1788
• chore: Change make_from! in from_arrow to func to improve readability by @chubei in #1792
• fix: From<Record> of ProcessorRecord didn't copy lifetime by @chubei in #1789
• chore: Remove unused Orchestrator trait by @chubei in #1797
• chore: Split ApiInitError out from ApiError by @chubei in #1798
• adding scaling e-commerce data in the samples table readme section by @cahyosubroto in #1799
• fix: temporary Remove python log s390x build by @mediuminvader in #1807
• chore: Remove AppSourceId which is no longer used by @chubei in #1803
• fix: custom enum row detection, support different type Coalesce by @chloeminkyung in #1802

New Contributors

• @gautamprikshit1 made their first contribution in #1780
• @cahyosubroto made their first contribution in #1799

Full Changelog: v0.1.30...v0.1.31

Development Release - v0.1.30

What's Changed

• chore: enhance label metrics for api_count and api_requests by @duonganhthu43 in #1752
• fix: Fix config generation and log output in init command by @karolisg in #1754
• chore: Rename more migrate to build by @chubei in #1755
• feat: Show correct error when organisation doesnt exist by @karolisg in #1756
• chore: Remove deprecated command line arguments by @chubei in #1757
• feat: Use config argument in deploy command by @karolisg in #1758
• fix: Replication log could panic if received request during persisting by @chubei in #1759
• feat: emit sql graph by @v3g42 in #1765
• feat: Add new label snapshotting to cache_operation metric by @chubei in #1737
• fix: Delete config file after delete of app by @karolisg in #1766
• fix: Add missing flags and comments in list and logs commands by @karolisg in #1767
• chore(deps): bump semver from 6.3.0 to 6.3.1 in /dozer-log-js by @dependabot in #1735
• fix: Show warning when metadata collect failed by @karolisg in #1772
• fix: Fix config combination with separated sql scripts by @karolisg in #1773
• fix: Fix target url from cli args usage by @karolisg in #1774
• refactor: Make config helper public by @karolisg in #1775
• feat: Register errors from error manager in jaeger by @karolisg in #1753
• Prepare v0.1.30 by @mediuminvader in #1778

Full Changelog: v0.1.29...v0.1.30

Development Release - v0.1.29

What's Changed

• chore/add list deployments endpoint by @duonganhthu43 in #1724
• chore: set bucket for histogram by @duonganhthu43 in #1723
• feat: Support read of configs from multiple files by @karolisg in #1718
• Revert "chore: set bucket for histogram (#1723)" by @duonganhthu43 in #1732
• chore: Rename num replicas to num api instances by @karolisg in #1725
• feat: Show deployment logs from deploy API by @karolisg in #1731
• chore: edit kafka feature with snowflake docker image release flow by @chloeminkyung in #1730
• refactor: Show more information when configuration not found by @karolisg in #1734
• feat: Implement config override by @chubei in #1736
• feat: MAX_VALUE(expr1, expr2) by @chloeminkyung in #1733
• chore: Remove outdated file by @chubei in #1741
• chore: Update commands descriptions by @karolisg in #1739
• fix: --config-overrides was not exposed in cli by @chubei in #1743
• feat: Serve replication log on internal grpc server by @chubei in #1722
• fix: Use different slot name everytime when dozer connects to postgres by @karolisg in #1742
• fix: synchronize schema change by @duonganhthu43 in #1744
• fix: Dont serialize app name if it is missing by @karolisg in #1746
• pin toolchain version to RUSTC_VERSION: 1.70.0 instead of stable by @chloeminkyung in #1748
• chore: added toolchain toml to pin version by @chloeminkyung in #1749
• feat: MIN_VALUE() implementation + unit tests by @chloeminkyung in #1740
• fix: Log reader was duplicating records that were persisted by @chubei in #1750
• chore: Prepare v0.1.29 by @mediuminvader in #1751

Full Changelog: v0.1.28...v0.1.29

Development Release - v0.1.28

What's Changed

• fix: Show error when app id is not stored by @karolisg in #1699
• chore: fix typo in source manager app test by @sonhmai in #1700
• chore: Use Utf8Path in HomeDir by @chubei in #1702
• fix: collide metric key cache_operation by @duonganhthu43 in #1687
• chore: Login to aws when running coverage job by @chubei in #1708
• fix: Ignore a failing test. Fix is in progress. by @chubei in #1709
• fix: Write commit epoch to log by @chubei in #1711
• fix: Handle rest path collision by @crajcan in #1693
• feat: Implement log replication server core by @chubei in #1710
• chore: add more context for metric api-latency by @duonganhthu43 in #1713
• feat: Support json files for cloud deployments by @karolisg in #1714
• refactor: improve CLI experience by @karolisg in #1703
• fix: Properly log error when internal pipeline server can't be started by @chubei in #1715
• chore: Print in the schema if a field is primary key by @chubei in #1717
• Prepare v0.1.28 by @mediuminvader in #1716
• feat: support InList clause in streaming SQL by @hi-rustin in #1694

New Contributors

• @sonhmai made their first contribution in #1700
• @crajcan made their first contribution in #1693
• @hi-rustin made their first contribution in #1694

Full Changelog: v0.1.27...v0.1.28

Development Release - v0.1.27

What's Changed

• fix: Use rustls for tls support when connecting to postgres by @chubei in #1502
• fix: Fix date conversion when date is more precise by @karolisg in #1682
• chore: Run CI scripts on merge groups instead of on pushes to main by @chubei in #1683
• Bump openssl from 0.10.48 to 0.10.55 by @dependabot in #1663
• fix: append only by @chloeminkyung in #1673
• chore: group CUD operation in cache/source as single metric by @duonganhthu43 in #1684
• fix: avoid include snapshot event in metrics count by @duonganhthu43 in #1686
• Support for syntax function() in SQL by @abcpro1 in #1679
• chore: add id in processor factory to support query metric on UI by @duonganhthu43 in #1685
• Fix snowflake client fetch_tables ordering by @nurikk in #1688
• feat: pg tls config connectivity by @chloeminkyung in #1672
• feat: Add cloud secrets API interfaces to cloud.proto by @karolisg in #1689
• feat: qualified wildcard by @chloeminkyung in #1674
• feature: Store app id to context file by @karolisg in #1691
• Fix snowflake parallel running instances by @nurikk in #1692
• feat: Implement secrets commands by @karolisg in #1695
• fix: Remove secrets value and add secrets support in deploy command by @karolisg in #1697
• Prepare v0.1.27 by @mediuminvader in #1698

New Contributors

• @abcpro1 made their first contribution in #1679

Full Changelog: v0.1.26...v0.1.27

Development Release - v0.1.26

What's Changed

• Update dozer-log-python/README.md by @chubei in #1647
• chore: enhance response for UI render by @duonganhthu43 in #1648
• doc: update samples table & other sample references by @abhishekmishragithub in #1652
• feat: Add data latency metrics. by @chubei in #1650
• feat: CASE statement by @chloeminkyung in #1656
• chore: add name fn for ProcessorFactory for UIDag in Cloud by @duonganhthu43 in #1658
• feat: support generate UI graph from dozer config by @duonganhthu43 in #1661
• feat: Implement append-last watcher by @mediuminvader in #1562
• Revert "chore: enhance response for UI render (#1648)" by @duonganhthu43 in #1664
• chore: update default cloud target url by @duonganhthu43 in #1667
• fix: Get a deterministic Processor id by @mediuminvader in #1665
• chore: Introduce Dozer dev flag by @mediuminvader in #1668
• fix: index in ui graph by @duonganhthu43 in #1671
• chore: Send CI env to metadata by @karolisg in #1669
• Implement TO_CHAR for Timestamp format by @mediuminvader in #1655
• chore: add error message for wrong !Table config format for Parquet and CSV by @chloeminkyung in #1675
• Prepare v0.1.26 by @mediuminvader in #1676

Full Changelog: v0.1.25...v0.1.26

Development Release - v0.1.25

What's Changed

• chore: Remove maturin sccache because it keeps failing by @chubei in #1623
• chore: Cloud api endpoint now includes protocol by @chubei in #1614
• feat: Refactor kafka connector to use schema registry by @karolisg in #1622
• feat: Add more cache metrics by @chubei in #1627
• chore: Remove extra http:// before cloud deployment endpoint by @chubei in #1625
• chore: Add instance type to cloud config by @chubei in #1629
• Bump handlebars from 4.3.6 to 4.3.7 by @dependabot in #1616
• Bump xml-rs from 0.8.4 to 0.8.14 by @dependabot in #1624
• feature: Implement progress printer and disable time display by @karolisg in #1630
• Bump pest from 2.5.6 to 2.6.0 by @dependabot in #1633
• Error Threshold Management by @chloeminkyung in #1555
• fix: Include progress printer only when cloud feature enabled by @karolisg in #1635
• feat: Implement cache dump and restore by @chubei in #1637
• feat: Switch to rdkafka by @karolisg in #1636
• chore: Rollback changes for kafka connector feature flag by @karolisg in #1639
• chore: Read metadata during cache dump transaction creation by @chubei in #1641
• feat: add api latency metric by @duonganhthu43 in #1642
• fix: ApiEndpoint::conflict_resolution and ApiEndpoint::version was not serialized by @chubei in #1643
• feat: Allow use kafka without schema registry by @karolisg in #1626
• chore: Add kafka to docker image by @karolisg in #1644
• feat: _text by @chloeminkyung in #1645
• Prepare v0.1.25 by @mediuminvader in #1646

Full Changelog: v0.1.24...v0.1.25

Development Release - v0.1.24

Bug Fixes

• Fix replication slot check (#1031)
• Remove non-existent proto include, which made cargo always rerun (#1064)
• Record readers not inserted in release builds (#1068)

Features

• Implement start from in postgres connector (#994)
• Add RoCacheEndpoint::redirect_cache. (#1027)
• Enhance python udf (#984)

Miscellaneous Tasks

• Refactor grpc types (#1036)

Refactor

• Make tables vector required for connector start (#1058)

Testing

• Add tests for local storage (#1030)

Support

Contact us at https://getdozer.io