diff --git a/connectors/activemq-sink/v3.0.3.1/io-activemq-sink.md b/connectors/activemq-sink/v3.0.3.4/io-activemq-sink.md similarity index 99% rename from connectors/activemq-sink/v3.0.3.1/io-activemq-sink.md rename to connectors/activemq-sink/v3.0.3.4/io-activemq-sink.md index 26f7013cb..4a80bc325 100644 --- a/connectors/activemq-sink/v3.0.3.1/io-activemq-sink.md +++ b/connectors/activemq-sink/v3.0.3.4/io-activemq-sink.md @@ -11,7 +11,7 @@ tags: apache-pulsar,pulsar-io,source-connector,sink-connector,apache-activemq alias: ActiveMQ sink connector features: ["ActiveMQ Connector integrates Apache Pulsar with Apache ActiveMQ. "] icon: "/images/connectors/activemq_logo_white_vertical.jpg" -download: https://api.github.com/repos/streamnative/pulsar-io-activemq/tarball/refs/tags/v3.0.3.1 +download: https://api.github.com/repos/streamnative/pulsar-io-activemq/tarball/refs/tags/v3.0.3.4 support: streamnative support_link: https://github.com/streamnative/pulsar-io-activemq support_img: "https://avatars.githubusercontent.com/u/44651383?v=4" diff --git a/connectors/activemq-sink/v3.2.1.2/io-activemq-sink.md b/connectors/activemq-sink/v3.2.1.3/io-activemq-sink.md similarity index 99% rename from connectors/activemq-sink/v3.2.1.2/io-activemq-sink.md rename to connectors/activemq-sink/v3.2.1.3/io-activemq-sink.md index 22aa77b65..16e143664 100644 --- a/connectors/activemq-sink/v3.2.1.2/io-activemq-sink.md +++ b/connectors/activemq-sink/v3.2.1.3/io-activemq-sink.md @@ -11,7 +11,7 @@ tags: apache-pulsar,pulsar-io,source-connector,sink-connector,apache-activemq alias: ActiveMQ sink connector features: ["ActiveMQ Connector integrates Apache Pulsar with Apache ActiveMQ. "] icon: "/images/connectors/activemq_logo_white_vertical.jpg" -download: https://api.github.com/repos/streamnative/pulsar-io-activemq/tarball/refs/tags/v3.2.1.2 +download: https://api.github.com/repos/streamnative/pulsar-io-activemq/tarball/refs/tags/v3.2.1.3 support: streamnative support_link: https://github.com/streamnative/pulsar-io-activemq support_img: "https://avatars.githubusercontent.com/u/44651383?v=4" diff --git a/connectors/activemq-source/v3.0.3.1/io-activemq-source.md b/connectors/activemq-source/v3.0.3.4/io-activemq-source.md similarity index 99% rename from connectors/activemq-source/v3.0.3.1/io-activemq-source.md rename to connectors/activemq-source/v3.0.3.4/io-activemq-source.md index 3fb7d4e8c..07ac84147 100644 --- a/connectors/activemq-source/v3.0.3.1/io-activemq-source.md +++ b/connectors/activemq-source/v3.0.3.4/io-activemq-source.md @@ -11,7 +11,7 @@ tags: apache-pulsar,pulsar-io,source-connector,sink-connector,apache-activemq alias: ActiveMQ source connector features: ["ActiveMQ Connector integrates Apache Pulsar with Apache ActiveMQ. "] icon: "/images/connectors/activemq_logo_white_vertical.jpg" -download: https://api.github.com/repos/streamnative/pulsar-io-activemq/tarball/refs/tags/v3.0.3.1 +download: https://api.github.com/repos/streamnative/pulsar-io-activemq/tarball/refs/tags/v3.0.3.4 support: streamnative support_link: https://github.com/streamnative/pulsar-io-activemq support_img: "https://avatars.githubusercontent.com/u/44651383?v=4" diff --git a/connectors/activemq-source/v3.2.1.2/io-activemq-source.md b/connectors/activemq-source/v3.2.1.3/io-activemq-source.md similarity index 99% rename from connectors/activemq-source/v3.2.1.2/io-activemq-source.md rename to connectors/activemq-source/v3.2.1.3/io-activemq-source.md index 81c300af9..a707303bb 100644 --- a/connectors/activemq-source/v3.2.1.2/io-activemq-source.md +++ b/connectors/activemq-source/v3.2.1.3/io-activemq-source.md @@ -11,7 +11,7 @@ tags: apache-pulsar,pulsar-io,source-connector,sink-connector,apache-activemq alias: ActiveMQ source connector features: ["ActiveMQ Connector integrates Apache Pulsar with Apache ActiveMQ. "] icon: "/images/connectors/activemq_logo_white_vertical.jpg" -download: https://api.github.com/repos/streamnative/pulsar-io-activemq/tarball/refs/tags/v3.2.1.2 +download: https://api.github.com/repos/streamnative/pulsar-io-activemq/tarball/refs/tags/v3.2.1.3 support: streamnative support_link: https://github.com/streamnative/pulsar-io-activemq support_img: "https://avatars.githubusercontent.com/u/44651383?v=4" diff --git a/connectors/amqp-1-0-sink/v3.0.3.1/amqp-1-0-sink.md b/connectors/amqp-1-0-sink/v3.0.3.4/amqp-1-0-sink.md similarity index 99% rename from connectors/amqp-1-0-sink/v3.0.3.1/amqp-1-0-sink.md rename to connectors/amqp-1-0-sink/v3.0.3.4/amqp-1-0-sink.md index 1362ffea1..f790a380e 100644 --- a/connectors/amqp-1-0-sink/v3.0.3.1/amqp-1-0-sink.md +++ b/connectors/amqp-1-0-sink/v3.0.3.4/amqp-1-0-sink.md @@ -11,7 +11,7 @@ tags: alias: AMQP 1.0 Sink Connector features: ["support sink/source for AMQP version 1.0.0"] icon: "/images/connectors/amqp-logo.png" -download: https://api.github.com/repos/streamnative/pulsar-io-amqp-1-0/tarball/refs/tags/v3.0.3.1 +download: https://api.github.com/repos/streamnative/pulsar-io-amqp-1-0/tarball/refs/tags/v3.0.3.4 support: streamnative support_link: https://github.com/streamnative/pulsar-io-amqp-1-0 support_img: "https://avatars.githubusercontent.com/u/44651383?v=4" @@ -27,7 +27,7 @@ id: "amqp-1-0-sink" The AMQP 1.0 sink connector pulls messages from Pulsar topics and persists messages to [AMQP 1.0](https://www.amqp.org/). -![](https://raw.githubusercontent.com/streamnative/pulsar-io-amqp-1-0/v3.0.3.1/docs/amqp-1-0-sink.png) +![](https://raw.githubusercontent.com/streamnative/pulsar-io-amqp-1-0/v3.0.3.4/docs/amqp-1-0-sink.png) ## Quick start diff --git a/connectors/amqp-1-0-sink/v3.2.1.2/amqp-1-0-sink.md b/connectors/amqp-1-0-sink/v3.2.1.3/amqp-1-0-sink.md similarity index 99% rename from connectors/amqp-1-0-sink/v3.2.1.2/amqp-1-0-sink.md rename to connectors/amqp-1-0-sink/v3.2.1.3/amqp-1-0-sink.md index 4be440d9d..729859bfa 100644 --- a/connectors/amqp-1-0-sink/v3.2.1.2/amqp-1-0-sink.md +++ b/connectors/amqp-1-0-sink/v3.2.1.3/amqp-1-0-sink.md @@ -11,7 +11,7 @@ tags: alias: AMQP 1.0 Sink Connector features: ["support sink/source for AMQP version 1.0.0"] icon: "/images/connectors/amqp-logo.png" -download: https://api.github.com/repos/streamnative/pulsar-io-amqp-1-0/tarball/refs/tags/v3.2.1.2 +download: https://api.github.com/repos/streamnative/pulsar-io-amqp-1-0/tarball/refs/tags/v3.2.1.3 support: streamnative support_link: https://github.com/streamnative/pulsar-io-amqp-1-0 support_img: "https://avatars.githubusercontent.com/u/44651383?v=4" @@ -27,7 +27,7 @@ id: "amqp-1-0-sink" The AMQP 1.0 sink connector pulls messages from Pulsar topics and persists messages to [AMQP 1.0](https://www.amqp.org/). -![](https://raw.githubusercontent.com/streamnative/pulsar-io-amqp-1-0/v3.2.1.2/docs/amqp-1-0-sink.png) +![](https://raw.githubusercontent.com/streamnative/pulsar-io-amqp-1-0/v3.2.1.3/docs/amqp-1-0-sink.png) ## Quick start diff --git a/connectors/amqp-1-0-source/v3.0.3.1/amqp-1-0-source.md b/connectors/amqp-1-0-source/v3.0.3.4/amqp-1-0-source.md similarity index 99% rename from connectors/amqp-1-0-source/v3.0.3.1/amqp-1-0-source.md rename to connectors/amqp-1-0-source/v3.0.3.4/amqp-1-0-source.md index 9049e9db0..eaebcd215 100644 --- a/connectors/amqp-1-0-source/v3.0.3.1/amqp-1-0-source.md +++ b/connectors/amqp-1-0-source/v3.0.3.4/amqp-1-0-source.md @@ -11,7 +11,7 @@ tags: alias: AMQP 1.0 Source Connector features: ["support sink/source for AMQP version 1.0.0"] icon: "/images/connectors/amqp-logo.png" -download: https://api.github.com/repos/streamnative/pulsar-io-amqp-1-0/tarball/refs/tags/v3.0.3.1 +download: https://api.github.com/repos/streamnative/pulsar-io-amqp-1-0/tarball/refs/tags/v3.0.3.4 support: streamnative support_link: https://github.com/streamnative/pulsar-io-amqp-1-0 support_img: "https://avatars.githubusercontent.com/u/44651383?v=4" @@ -27,7 +27,7 @@ id: "amqp-1-0-source" The AMQP 1.0 source connector receives messages from [AMQP 1.0](https://www.amqp.org/) and writes messages to Pulsar topics. -![](https://raw.githubusercontent.com/streamnative/pulsar-io-amqp-1-0/v3.0.3.1/docs/amqp-1-0-source.png) +![](https://raw.githubusercontent.com/streamnative/pulsar-io-amqp-1-0/v3.0.3.4/docs/amqp-1-0-source.png) ## Quick start diff --git a/connectors/amqp-1-0-source/v3.2.1.2/amqp-1-0-source.md b/connectors/amqp-1-0-source/v3.2.1.3/amqp-1-0-source.md similarity index 99% rename from connectors/amqp-1-0-source/v3.2.1.2/amqp-1-0-source.md rename to connectors/amqp-1-0-source/v3.2.1.3/amqp-1-0-source.md index 8527c9b5e..0d570b943 100644 --- a/connectors/amqp-1-0-source/v3.2.1.2/amqp-1-0-source.md +++ b/connectors/amqp-1-0-source/v3.2.1.3/amqp-1-0-source.md @@ -11,7 +11,7 @@ tags: alias: AMQP 1.0 Source Connector features: ["support sink/source for AMQP version 1.0.0"] icon: "/images/connectors/amqp-logo.png" -download: https://api.github.com/repos/streamnative/pulsar-io-amqp-1-0/tarball/refs/tags/v3.2.1.2 +download: https://api.github.com/repos/streamnative/pulsar-io-amqp-1-0/tarball/refs/tags/v3.2.1.3 support: streamnative support_link: https://github.com/streamnative/pulsar-io-amqp-1-0 support_img: "https://avatars.githubusercontent.com/u/44651383?v=4" @@ -27,7 +27,7 @@ id: "amqp-1-0-source" The AMQP 1.0 source connector receives messages from [AMQP 1.0](https://www.amqp.org/) and writes messages to Pulsar topics. -![](https://raw.githubusercontent.com/streamnative/pulsar-io-amqp-1-0/v3.2.1.2/docs/amqp-1-0-source.png) +![](https://raw.githubusercontent.com/streamnative/pulsar-io-amqp-1-0/v3.2.1.3/docs/amqp-1-0-source.png) ## Quick start diff --git a/connectors/aws-eventbridge-sink/v3.0.3.1/aws-eventbridge-sink.md b/connectors/aws-eventbridge-sink/v3.0.3.4/aws-eventbridge-sink.md similarity index 99% rename from connectors/aws-eventbridge-sink/v3.0.3.1/aws-eventbridge-sink.md rename to connectors/aws-eventbridge-sink/v3.0.3.4/aws-eventbridge-sink.md index 39479d8de..46a737de9 100644 --- a/connectors/aws-eventbridge-sink/v3.0.3.1/aws-eventbridge-sink.md +++ b/connectors/aws-eventbridge-sink/v3.0.3.4/aws-eventbridge-sink.md @@ -26,7 +26,7 @@ id: "aws-eventbridge-sink" The [Amazon EventBridge](https://aws.amazon.com/eventbridge/) sink connector pulls data from Pulsar topics and persists data to Amazon EventBridge. -![](https://raw.githubusercontent.com/streamnative/pulsar-io-aws-eventbridge/v3.0.3.1/docs/aws-eventbridge-sink.png) +![](https://raw.githubusercontent.com/streamnative/pulsar-io-aws-eventbridge/v3.0.3.4/docs/aws-eventbridge-sink.png) ## Quick start diff --git a/connectors/aws-eventbridge-sink/v3.2.1.2/aws-eventbridge-sink.md b/connectors/aws-eventbridge-sink/v3.2.1.3/aws-eventbridge-sink.md similarity index 99% rename from connectors/aws-eventbridge-sink/v3.2.1.2/aws-eventbridge-sink.md rename to connectors/aws-eventbridge-sink/v3.2.1.3/aws-eventbridge-sink.md index 2d362bd88..0d37065b0 100644 --- a/connectors/aws-eventbridge-sink/v3.2.1.2/aws-eventbridge-sink.md +++ b/connectors/aws-eventbridge-sink/v3.2.1.3/aws-eventbridge-sink.md @@ -26,7 +26,7 @@ id: "aws-eventbridge-sink" The [Amazon EventBridge](https://aws.amazon.com/eventbridge/) sink connector pulls data from Pulsar topics and persists data to Amazon EventBridge. -![](https://raw.githubusercontent.com/streamnative/pulsar-io-aws-eventbridge/v3.2.1.2/docs/aws-eventbridge-sink.png) +![](https://raw.githubusercontent.com/streamnative/pulsar-io-aws-eventbridge/v3.2.1.3/docs/aws-eventbridge-sink.png) ## Quick start diff --git a/connectors/aws-lambda-sink/v3.0.3.1/aws-lambda-sink.md b/connectors/aws-lambda-sink/v3.0.3.4/aws-lambda-sink.md similarity index 94% rename from connectors/aws-lambda-sink/v3.0.3.1/aws-lambda-sink.md rename to connectors/aws-lambda-sink/v3.0.3.4/aws-lambda-sink.md index eadcb1f1d..bc83a804e 100644 --- a/connectors/aws-lambda-sink/v3.0.3.1/aws-lambda-sink.md +++ b/connectors/aws-lambda-sink/v3.0.3.4/aws-lambda-sink.md @@ -25,7 +25,7 @@ id: "aws-lambda-sink" The [AWS Lambda](https://aws.amazon.com/lambda/) sink connector is a [Pulsar IO connector](http://pulsar.apache.org/docs/en/next/io-overview/) for pulling messages from Pulsar topics to AWS Lambda to invoke Lambda functions. -![](https://raw.githubusercontent.com/streamnative/pulsar-io-aws-lambda/v3.0.3.1/docs/lambda-sink.png) +![](https://raw.githubusercontent.com/streamnative/pulsar-io-aws-lambda/v3.0.3.4/docs/lambda-sink.png) # How to get @@ -35,7 +35,7 @@ This section describes how to build the AWS Lambda sink connector. You can get the AWS Lambda sink connector using one of the following methods if you use [Pulsar Function Worker](https://pulsar.apache.org/docs/en/functions-worker/) to run connectors in a cluster. -- Download the NAR package from [the download page](https://github.com/streamnative/pulsar-io-aws-lambda/releases/download/v3.0.3.1/pulsar-io-google-pubsub-3.0.3.1.nar). +- Download the NAR package from [the download page](https://github.com/streamnative/pulsar-io-aws-lambda/releases/download/v3.0.3.4/pulsar-io-google-pubsub-3.0.3.4.nar). - Build it from the source code. @@ -57,7 +57,7 @@ To build the AWS Lambda sink connector from the source code, follow these steps. ```bash ls target - pulsar-io-aws-lambda-3.0.3.1.nar + pulsar-io-aws-lambda-3.0.3.4.nar ``` ## Work with Function Mesh @@ -93,7 +93,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you "inputs": [ "test-aws-lambda-topic" ], - "archive": "connectors/pulsar-io-aws-lambda-3.0.3.1.nar", + "archive": "connectors/pulsar-io-aws-lambda-3.0.3.4.nar", "parallelism": 1, "configs": { @@ -115,7 +115,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you name: "aws-lambda-sink" inputs: - "test-aws-lambda-topic" - archive: "connectors/pulsar-io-aws-lambda-3.0.3.1.nar" + archive: "connectors/pulsar-io-aws-lambda-3.0.3.4.nar" parallelism: 1 configs: @@ -139,7 +139,7 @@ kind: Sink metadata: name: aws-lambda-sink-sample spec: - image: streamnative/pulsar-io-aws-lambda:3.0.3.1 + image: streamnative/pulsar-io-aws-lambda:3.0.3.4 className: org.apache.pulsar.ecosystem.io.aws.lambda.AWSLambdaBytesSink replicas: 1 input: @@ -163,7 +163,7 @@ spec: cpu: "0.1" memory: 1G java: - jar: connectors/pulsar-io-aws-lambda-3.0.3.1.nar + jar: connectors/pulsar-io-aws-lambda-3.0.3.4.nar clusterName: test-pulsar autoAck: true ``` @@ -186,7 +186,7 @@ This example shows how to create an AWS Lambda sink connector on a Pulsar cluste ```bash PULSAR_HOME/bin/pulsar-admin sinks create \ ---archive pulsar-io-aws-lambda-3.0.3.1.nar \ +--archive pulsar-io-aws-lambda-3.0.3.4.nar \ --sink-config-file aws-lambda-sink-config.yaml \ --classname org.apache.pulsar.ecosystem.io.aws.lambda.AWSLambdaBytesSink \ --name aws-lambda-sink @@ -209,8 +209,8 @@ This example describes how to use the AWS Lambda sink connector to pull messages 2. Copy the NAR package of the AWS Lambda connector to the Pulsar connectors directory. ``` - cp pulsar-io-aws-lambda-3.0.3.1.nar - PULSAR_HOME/connectors/pulsar-io-aws-lambda-3.0.3.1.nar + cp pulsar-io-aws-lambda-3.0.3.4.nar + PULSAR_HOME/connectors/pulsar-io-aws-lambda-3.0.3.4.nar ``` 3. Start Pulsar in standalone mode. @@ -244,8 +244,8 @@ This example explains how to create an AWS Lambda sink connector in an on-premis 1. Copy the NAR package of the AWS Lambda connector to the Pulsar connectors directory. ``` - cp pulsar-io-aws-lambda-3.0.3.1.nar - PULSAR_HOME/connectors/pulsar-io-aws-lambda-3.0.3.1.nar + cp pulsar-io-aws-lambda-3.0.3.4.nar + PULSAR_HOME/connectors/pulsar-io-aws-lambda-3.0.3.4.nar ``` 2. Reload all [built-in connectors](https://pulsar.apache.org/docs/en/next/io-connectors/). @@ -297,7 +297,7 @@ This example describes how to create an AWS Lambda sink connector for a Kuberbet metadata: name: aws-lambda-sink-sample spec: - image: streamnative/pulsar-io-aws-lambda:3.0.3.1 + image: streamnative/pulsar-io-aws-lambda:3.0.3.4 className: org.apache.pulsar.ecosystem.io.aws.lambda.AWSLambdaBytesSink replicas: 1 input: @@ -321,7 +321,7 @@ This example describes how to create an AWS Lambda sink connector for a Kuberbet cpu: "0.1" memory: 1G java: - jar: connectors/pulsar-io-aws-lambda-3.0.3.1.nar + jar: connectors/pulsar-io-aws-lambda-3.0.3.4.nar clusterName: test-pulsar autoAck: true ``` diff --git a/connectors/aws-lambda-sink/v3.2.1.2/aws-lambda-sink.md b/connectors/aws-lambda-sink/v3.2.1.3/aws-lambda-sink.md similarity index 99% rename from connectors/aws-lambda-sink/v3.2.1.2/aws-lambda-sink.md rename to connectors/aws-lambda-sink/v3.2.1.3/aws-lambda-sink.md index 55c9bda49..b0f4f8a26 100644 --- a/connectors/aws-lambda-sink/v3.2.1.2/aws-lambda-sink.md +++ b/connectors/aws-lambda-sink/v3.2.1.3/aws-lambda-sink.md @@ -27,7 +27,7 @@ The [AWS Lambda](https://aws.amazon.com/lambda/) sink connector is a [Pulsar IO connector](http://pulsar.apache.org/docs/en/next/io-overview/) for pulling messages from Pulsar topics to AWS Lambda to invoke Lambda functions. -![](https://raw.githubusercontent.com/streamnative/pulsar-io-aws-lambda/v3.2.1.2/docs/lambda-sink.png) +![](https://raw.githubusercontent.com/streamnative/pulsar-io-aws-lambda/v3.2.1.3/docs/lambda-sink.png) ## Quick start diff --git a/connectors/aws-s3-sink/v3.0.3.1/aws-s3-sink.md b/connectors/aws-s3-sink/v3.0.3.4/aws-s3-sink.md similarity index 99% rename from connectors/aws-s3-sink/v3.0.3.1/aws-s3-sink.md rename to connectors/aws-s3-sink/v3.0.3.4/aws-s3-sink.md index d5863910d..87d49f1c3 100644 --- a/connectors/aws-s3-sink/v3.0.3.1/aws-s3-sink.md +++ b/connectors/aws-s3-sink/v3.0.3.4/aws-s3-sink.md @@ -11,7 +11,7 @@ tags: alias: AWS S3 Sink Connector features: ["Cloud Storage Connector integrates Apache Pulsar with cloud storage."] icon: "/images/pulsar-hub.svg" -download: https://api.github.com/repos/streamnative/pulsar-io-cloud-storage/tarball/refs/tags/v3.0.3.1 +download: https://api.github.com/repos/streamnative/pulsar-io-cloud-storage/tarball/refs/tags/v3.0.3.4 support: streamnative support_link: https://github.com/streamnative/pulsar-io-cloud-storage support_img: "https://avatars.githubusercontent.com/u/44651383?v=4" @@ -25,7 +25,7 @@ id: "aws-s3-sink" The [AWS S3](https://docs.aws.amazon.com/AmazonS3/latest/userguide/Welcome.html) sink connector pulls data from Pulsar topics and persists data to AWS S3 buckets. -![](https://raw.githubusercontent.com/streamnative/pulsar-io-cloud-storage/v3.0.3.1/docs/aws-s3-sink.png) +![](https://raw.githubusercontent.com/streamnative/pulsar-io-cloud-storage/v3.0.3.4/docs/aws-s3-sink.png) ## Quick start diff --git a/connectors/aws-s3-sink/v3.2.1.2/aws-s3-sink.md b/connectors/aws-s3-sink/v3.2.1.3/aws-s3-sink.md similarity index 99% rename from connectors/aws-s3-sink/v3.2.1.2/aws-s3-sink.md rename to connectors/aws-s3-sink/v3.2.1.3/aws-s3-sink.md index c919815ab..20289a0cf 100644 --- a/connectors/aws-s3-sink/v3.2.1.2/aws-s3-sink.md +++ b/connectors/aws-s3-sink/v3.2.1.3/aws-s3-sink.md @@ -11,7 +11,7 @@ tags: alias: AWS S3 Sink Connector features: ["Cloud Storage Connector integrates Apache Pulsar with cloud storage."] icon: "/images/pulsar-hub.svg" -download: https://api.github.com/repos/streamnative/pulsar-io-cloud-storage/tarball/refs/tags/v3.2.1.2 +download: https://api.github.com/repos/streamnative/pulsar-io-cloud-storage/tarball/refs/tags/v3.2.1.3 support: streamnative support_link: https://github.com/streamnative/pulsar-io-cloud-storage support_img: "https://avatars.githubusercontent.com/u/44651383?v=4" @@ -25,7 +25,7 @@ id: "aws-s3-sink" The [AWS S3](https://docs.aws.amazon.com/AmazonS3/latest/userguide/Welcome.html) sink connector pulls data from Pulsar topics and persists data to AWS S3 buckets. -![](https://raw.githubusercontent.com/streamnative/pulsar-io-cloud-storage/v3.2.1.2/docs/aws-s3-sink.png) +![](https://raw.githubusercontent.com/streamnative/pulsar-io-cloud-storage/v3.2.1.3/docs/aws-s3-sink.png) ## Quick start diff --git a/connectors/azure-blob-storage-sink/v3.0.3.1/azure-blob-storage-sink.md b/connectors/azure-blob-storage-sink/v3.0.3.4/azure-blob-storage-sink.md similarity index 99% rename from connectors/azure-blob-storage-sink/v3.0.3.1/azure-blob-storage-sink.md rename to connectors/azure-blob-storage-sink/v3.0.3.4/azure-blob-storage-sink.md index bdf8744fd..69bfb61d0 100644 --- a/connectors/azure-blob-storage-sink/v3.0.3.1/azure-blob-storage-sink.md +++ b/connectors/azure-blob-storage-sink/v3.0.3.4/azure-blob-storage-sink.md @@ -11,7 +11,7 @@ tags: alias: Azure Blob Storage Sink Connector features: ["Cloud Storage Connector integrates Apache Pulsar with cloud storage."] icon: "/images/pulsar-hub.svg" -download: https://api.github.com/repos/streamnative/pulsar-io-cloud-storage/tarball/refs/tags/v3.0.3.1 +download: https://api.github.com/repos/streamnative/pulsar-io-cloud-storage/tarball/refs/tags/v3.0.3.4 support: streamnative support_link: https://github.com/streamnative/pulsar-io-cloud-storage support_img: "https://avatars.githubusercontent.com/u/44651383?v=4" @@ -25,7 +25,7 @@ id: "azure-blob-storage-sink" The [Azure Blob Storage](https://learn.microsoft.com/en-us/azure/storage/blobs/storage-blobs-overview) sink connector pulls data from Pulsar topics and persists data to Azure Blob Storage containers. -![](https://raw.githubusercontent.com/streamnative/pulsar-io-cloud-storage/v3.0.3.1/docs/azure-blob-storage-sink.png) +![](https://raw.githubusercontent.com/streamnative/pulsar-io-cloud-storage/v3.0.3.4/docs/azure-blob-storage-sink.png) ## Quick start diff --git a/connectors/azure-blob-storage-sink/v3.2.1.2/azure-blob-storage-sink.md b/connectors/azure-blob-storage-sink/v3.2.1.3/azure-blob-storage-sink.md similarity index 99% rename from connectors/azure-blob-storage-sink/v3.2.1.2/azure-blob-storage-sink.md rename to connectors/azure-blob-storage-sink/v3.2.1.3/azure-blob-storage-sink.md index 7e092f05e..a1ec2fb7a 100644 --- a/connectors/azure-blob-storage-sink/v3.2.1.2/azure-blob-storage-sink.md +++ b/connectors/azure-blob-storage-sink/v3.2.1.3/azure-blob-storage-sink.md @@ -11,7 +11,7 @@ tags: alias: Azure Blob Storage Sink Connector features: ["Cloud Storage Connector integrates Apache Pulsar with cloud storage."] icon: "/images/pulsar-hub.svg" -download: https://api.github.com/repos/streamnative/pulsar-io-cloud-storage/tarball/refs/tags/v3.2.1.2 +download: https://api.github.com/repos/streamnative/pulsar-io-cloud-storage/tarball/refs/tags/v3.2.1.3 support: streamnative support_link: https://github.com/streamnative/pulsar-io-cloud-storage support_img: "https://avatars.githubusercontent.com/u/44651383?v=4" @@ -25,7 +25,7 @@ id: "azure-blob-storage-sink" The [Azure Blob Storage](https://learn.microsoft.com/en-us/azure/storage/blobs/storage-blobs-overview) sink connector pulls data from Pulsar topics and persists data to Azure Blob Storage containers. -![](https://raw.githubusercontent.com/streamnative/pulsar-io-cloud-storage/v3.2.1.2/docs/azure-blob-storage-sink.png) +![](https://raw.githubusercontent.com/streamnative/pulsar-io-cloud-storage/v3.2.1.3/docs/azure-blob-storage-sink.png) ## Quick start diff --git a/connectors/google-bigquery-sink/v3.0.3.1/google-bigquery-sink.md b/connectors/google-bigquery-sink/v3.0.3.4/google-bigquery-sink.md similarity index 98% rename from connectors/google-bigquery-sink/v3.0.3.1/google-bigquery-sink.md rename to connectors/google-bigquery-sink/v3.0.3.4/google-bigquery-sink.md index 025564347..5730a62a5 100644 --- a/connectors/google-bigquery-sink/v3.0.3.1/google-bigquery-sink.md +++ b/connectors/google-bigquery-sink/v3.0.3.4/google-bigquery-sink.md @@ -25,7 +25,7 @@ id: "google-bigquery-sink" The [Google Cloud BigQuery](https://cloud.google.com/bigquery) sink connector pulls data from Pulsar topics and persists data to Google Cloud BigQuery tables. -![](https://raw.githubusercontent.com/streamnative/pulsar-io-bigquery/v3.0.3.1/docs/google-bigquery-sink.png) +![](https://raw.githubusercontent.com/streamnative/pulsar-io-bigquery/v3.0.3.4/docs/google-bigquery-sink.png) ## Quick start @@ -50,7 +50,7 @@ The prerequisites for connecting an Google BigQuery sink connector to external s ### 1. Create a connector The following command shows how to use [pulsarctl](https://github.com/streamnative/pulsarctl) to create a `builtin` connector. If you want to create a `non-builtin` connector, -you need to replace `--sink-type bigquery` with `--archive /path/to/pulsar-io-bigquery.jar`. You can find the button to download the `jar` package at the beginning of the document. +you need to replace `--sink-type bigquery` with `--archive /path/to/pulsar-io-bigquery.nar`. You can find the button to download the `nar` package at the beginning of the document. {% callout title="For StreamNative Cloud User" type="note" %} If you are a StreamNative Cloud user, you need [set up your environment](https://docs.streamnative.io/docs/connector-setup) first. @@ -198,10 +198,10 @@ This table lists the schema types that currently are supported to be converted. |-----------------|-----------| | AVRO | Yes | | PRIMITIVE | Yes | +| PROTOBUF_NATIVE | Yes | +| PROTOBUF | No | | JSON | No | | KEY_VALUE | No | -| PROTOBUF | No | -| PROTOBUF_NATIVE | No | ### Partitioned tables diff --git a/connectors/google-bigquery-sink/v3.2.1.2/google-bigquery-sink.md b/connectors/google-bigquery-sink/v3.2.1.3/google-bigquery-sink.md similarity index 99% rename from connectors/google-bigquery-sink/v3.2.1.2/google-bigquery-sink.md rename to connectors/google-bigquery-sink/v3.2.1.3/google-bigquery-sink.md index 2ae6be224..90558864d 100644 --- a/connectors/google-bigquery-sink/v3.2.1.2/google-bigquery-sink.md +++ b/connectors/google-bigquery-sink/v3.2.1.3/google-bigquery-sink.md @@ -25,7 +25,7 @@ id: "google-bigquery-sink" The [Google Cloud BigQuery](https://cloud.google.com/bigquery) sink connector pulls data from Pulsar topics and persists data to Google Cloud BigQuery tables. -![](https://raw.githubusercontent.com/streamnative/pulsar-io-bigquery/v3.2.1.2/docs/google-bigquery-sink.png) +![](https://raw.githubusercontent.com/streamnative/pulsar-io-bigquery/v3.2.1.3/docs/google-bigquery-sink.png) ## Quick start diff --git a/connectors/google-bigquery-source/v3.0.3.1/google-bigquery-source.md b/connectors/google-bigquery-source/v3.0.3.4/google-bigquery-source.md similarity index 98% rename from connectors/google-bigquery-source/v3.0.3.1/google-bigquery-source.md rename to connectors/google-bigquery-source/v3.0.3.4/google-bigquery-source.md index 7ff8700d7..dd3359455 100644 --- a/connectors/google-bigquery-source/v3.0.3.1/google-bigquery-source.md +++ b/connectors/google-bigquery-source/v3.0.3.4/google-bigquery-source.md @@ -25,7 +25,7 @@ id: "google-bigquery-source" The [Google Cloud BigQuery](https://cloud.google.com/bigquery) Source Connector feeds data from Google Cloud BigQuery tables and writes data to Pulsar topics. -![](https://raw.githubusercontent.com/streamnative/pulsar-io-bigquery/v3.0.3.1/docs/google-bigquery-source.png) +![](https://raw.githubusercontent.com/streamnative/pulsar-io-bigquery/v3.0.3.4/docs/google-bigquery-source.png) ## Quick start @@ -78,7 +78,7 @@ In other words, it will only synchronize the data before the start-up, and once ### 2. Create a connector The following command shows how to use [pulsarctl](https://github.com/streamnative/pulsarctl) to create a `builtin` connector. If you want to create a `non-builtin` connector, -you need to replace `--source-type bigquery` with `--archive /path/to/pulsar-io-bigquery.jar`. You can find the button to download the `jar` package at the beginning of the document. +you need to replace `--source-type bigquery` with `--archive /path/to/pulsar-io-bigquery.nar`. You can find the button to download the `nar` package at the beginning of the document. {% callout title="For StreamNative Cloud User" type="note" %} If you are a StreamNative Cloud user, you need [set up your environment](https://docs.streamnative.io/docs/connector-setup) first. diff --git a/connectors/google-bigquery-source/v3.2.1.2/google-bigquery-source.md b/connectors/google-bigquery-source/v3.2.1.3/google-bigquery-source.md similarity index 99% rename from connectors/google-bigquery-source/v3.2.1.2/google-bigquery-source.md rename to connectors/google-bigquery-source/v3.2.1.3/google-bigquery-source.md index 055816bd8..747497453 100644 --- a/connectors/google-bigquery-source/v3.2.1.2/google-bigquery-source.md +++ b/connectors/google-bigquery-source/v3.2.1.3/google-bigquery-source.md @@ -25,7 +25,7 @@ id: "google-bigquery-source" The [Google Cloud BigQuery](https://cloud.google.com/bigquery) Source Connector feeds data from Google Cloud BigQuery tables and writes data to Pulsar topics. -![](https://raw.githubusercontent.com/streamnative/pulsar-io-bigquery/v3.2.1.2/docs/google-bigquery-source.png) +![](https://raw.githubusercontent.com/streamnative/pulsar-io-bigquery/v3.2.1.3/docs/google-bigquery-source.png) ## Quick start diff --git a/connectors/google-cloud-storage-sink/v3.0.3.1/google-cloud-storage-sink.md b/connectors/google-cloud-storage-sink/v3.0.3.4/google-cloud-storage-sink.md similarity index 99% rename from connectors/google-cloud-storage-sink/v3.0.3.1/google-cloud-storage-sink.md rename to connectors/google-cloud-storage-sink/v3.0.3.4/google-cloud-storage-sink.md index 5fd28ec46..0e15a224e 100644 --- a/connectors/google-cloud-storage-sink/v3.0.3.1/google-cloud-storage-sink.md +++ b/connectors/google-cloud-storage-sink/v3.0.3.4/google-cloud-storage-sink.md @@ -11,7 +11,7 @@ tags: alias: Google Cloud Storage Sink Connector features: ["Cloud Storage Connector integrates Apache Pulsar with cloud storage."] icon: "/images/pulsar-hub.svg" -download: https://api.github.com/repos/streamnative/pulsar-io-cloud-storage/tarball/refs/tags/v3.0.3.1 +download: https://api.github.com/repos/streamnative/pulsar-io-cloud-storage/tarball/refs/tags/v3.0.3.4 support: streamnative support_link: https://github.com/streamnative/pulsar-io-cloud-storage support_img: "https://avatars.githubusercontent.com/u/44651383?v=4" @@ -25,7 +25,7 @@ id: "google-cloud-storage-sink" The [Google Cloud Storage](https://cloud.google.com/storage/docs) sink connector pulls data from Pulsar topics and persists data to Google Cloud Storage buckets. -![](https://raw.githubusercontent.com/streamnative/pulsar-io-cloud-storage/v3.0.3.1/docs/google-cloud-storage-sink.png) +![](https://raw.githubusercontent.com/streamnative/pulsar-io-cloud-storage/v3.0.3.4/docs/google-cloud-storage-sink.png) ## Quick start diff --git a/connectors/google-cloud-storage-sink/v3.2.1.2/google-cloud-storage-sink.md b/connectors/google-cloud-storage-sink/v3.2.1.3/google-cloud-storage-sink.md similarity index 99% rename from connectors/google-cloud-storage-sink/v3.2.1.2/google-cloud-storage-sink.md rename to connectors/google-cloud-storage-sink/v3.2.1.3/google-cloud-storage-sink.md index a8064ccf7..2c5501e6f 100644 --- a/connectors/google-cloud-storage-sink/v3.2.1.2/google-cloud-storage-sink.md +++ b/connectors/google-cloud-storage-sink/v3.2.1.3/google-cloud-storage-sink.md @@ -11,7 +11,7 @@ tags: alias: Google Cloud Storage Sink Connector features: ["Cloud Storage Connector integrates Apache Pulsar with cloud storage."] icon: "/images/pulsar-hub.svg" -download: https://api.github.com/repos/streamnative/pulsar-io-cloud-storage/tarball/refs/tags/v3.2.1.2 +download: https://api.github.com/repos/streamnative/pulsar-io-cloud-storage/tarball/refs/tags/v3.2.1.3 support: streamnative support_link: https://github.com/streamnative/pulsar-io-cloud-storage support_img: "https://avatars.githubusercontent.com/u/44651383?v=4" @@ -25,7 +25,7 @@ id: "google-cloud-storage-sink" The [Google Cloud Storage](https://cloud.google.com/storage/docs) sink connector pulls data from Pulsar topics and persists data to Google Cloud Storage buckets. -![](https://raw.githubusercontent.com/streamnative/pulsar-io-cloud-storage/v3.2.1.2/docs/google-cloud-storage-sink.png) +![](https://raw.githubusercontent.com/streamnative/pulsar-io-cloud-storage/v3.2.1.3/docs/google-cloud-storage-sink.png) ## Quick start diff --git a/connectors/google-pubsub-sink/v3.2.1.2/google-pubsub-sink.md b/connectors/google-pubsub-sink/v3.0.3.4/google-pubsub-sink.md similarity index 99% rename from connectors/google-pubsub-sink/v3.2.1.2/google-pubsub-sink.md rename to connectors/google-pubsub-sink/v3.0.3.4/google-pubsub-sink.md index ef128e4c8..26fa781c0 100644 --- a/connectors/google-pubsub-sink/v3.2.1.2/google-pubsub-sink.md +++ b/connectors/google-pubsub-sink/v3.0.3.4/google-pubsub-sink.md @@ -25,7 +25,7 @@ id: "google-pubsub-sink" The [Google Cloud PubSub](https://cloud.google.com/pubsub) sink connector pulls data from Pulsar topics and persists data to Google Cloud PubSub tables. -![](https://raw.githubusercontent.com/streamnative/pulsar-io-google-pubsub/v3.2.1.2/docs/google-pubsub-sink.png) +![](https://raw.githubusercontent.com/streamnative/pulsar-io-google-pubsub/v3.0.3.4/docs/google-pubsub-sink.png) ## Quick start diff --git a/connectors/google-pubsub-sink/v3.0.3.1/google-pubsub-sink.md b/connectors/google-pubsub-sink/v3.2.1.3/google-pubsub-sink.md similarity index 99% rename from connectors/google-pubsub-sink/v3.0.3.1/google-pubsub-sink.md rename to connectors/google-pubsub-sink/v3.2.1.3/google-pubsub-sink.md index b6e73a83b..840e45a51 100644 --- a/connectors/google-pubsub-sink/v3.0.3.1/google-pubsub-sink.md +++ b/connectors/google-pubsub-sink/v3.2.1.3/google-pubsub-sink.md @@ -25,7 +25,7 @@ id: "google-pubsub-sink" The [Google Cloud PubSub](https://cloud.google.com/pubsub) sink connector pulls data from Pulsar topics and persists data to Google Cloud PubSub tables. -![](https://raw.githubusercontent.com/streamnative/pulsar-io-google-pubsub/v3.0.3.1/docs/google-pubsub-sink.png) +![](https://raw.githubusercontent.com/streamnative/pulsar-io-google-pubsub/v3.2.1.3/docs/google-pubsub-sink.png) ## Quick start diff --git a/connectors/google-pubsub-source/v3.0.3.1/google-pubsub-source.md b/connectors/google-pubsub-source/v3.0.3.4/google-pubsub-source.md similarity index 99% rename from connectors/google-pubsub-source/v3.0.3.1/google-pubsub-source.md rename to connectors/google-pubsub-source/v3.0.3.4/google-pubsub-source.md index 9df2c1b73..7af47711a 100644 --- a/connectors/google-pubsub-source/v3.0.3.1/google-pubsub-source.md +++ b/connectors/google-pubsub-source/v3.0.3.4/google-pubsub-source.md @@ -25,7 +25,7 @@ id: "google-pubsub-source" The [Google Cloud Pub/Sub](https://cloud.google.com/pubsub) source connector feeds data from Google Cloud Pub/Sub topics and writes data to Pulsar topics. -![](https://raw.githubusercontent.com/streamnative/pulsar-io-google-pubsub/v3.0.3.1/docs/google-pubsub-source.png) +![](https://raw.githubusercontent.com/streamnative/pulsar-io-google-pubsub/v3.0.3.4/docs/google-pubsub-source.png) ## Quick start diff --git a/connectors/google-pubsub-source/v3.2.1.2/google-pubsub-source.md b/connectors/google-pubsub-source/v3.2.1.3/google-pubsub-source.md similarity index 99% rename from connectors/google-pubsub-source/v3.2.1.2/google-pubsub-source.md rename to connectors/google-pubsub-source/v3.2.1.3/google-pubsub-source.md index 864f52e3f..9b409d679 100644 --- a/connectors/google-pubsub-source/v3.2.1.2/google-pubsub-source.md +++ b/connectors/google-pubsub-source/v3.2.1.3/google-pubsub-source.md @@ -25,7 +25,7 @@ id: "google-pubsub-source" The [Google Cloud Pub/Sub](https://cloud.google.com/pubsub) source connector feeds data from Google Cloud Pub/Sub topics and writes data to Pulsar topics. -![](https://raw.githubusercontent.com/streamnative/pulsar-io-google-pubsub/v3.2.1.2/docs/google-pubsub-source.png) +![](https://raw.githubusercontent.com/streamnative/pulsar-io-google-pubsub/v3.2.1.3/docs/google-pubsub-source.png) ## Quick start diff --git a/connectors/lakehouse-sink/v3.2.1.2/lakehouse-sink.md b/connectors/lakehouse-sink/v3.0.3.4/lakehouse-sink.md similarity index 96% rename from connectors/lakehouse-sink/v3.2.1.2/lakehouse-sink.md rename to connectors/lakehouse-sink/v3.0.3.4/lakehouse-sink.md index 95d0c793a..eb6698a83 100644 --- a/connectors/lakehouse-sink/v3.2.1.2/lakehouse-sink.md +++ b/connectors/lakehouse-sink/v3.0.3.4/lakehouse-sink.md @@ -11,7 +11,7 @@ tags: alias: Lakehouse Sink Connector features: ["pulsar lakehouse connector"] icon: "/images/pulsar-hub.svg" -download: https://api.github.com/repos/streamnative/pulsar-io-lakehouse/tarball/refs/tags/v3.2.1.2 +download: https://api.github.com/repos/streamnative/pulsar-io-lakehouse/tarball/refs/tags/v3.0.3.4 support: streamnative support_link: https://github.com/streamnative/pulsar-io-lakehouse support_img: "https://avatars.githubusercontent.com/u/44651383?v=4" @@ -25,7 +25,7 @@ id: "lakehouse-sink" The Lakehouse sink connector (including the [Hudi](https://hudi.apache.org), [Iceberg](https://iceberg.apache.org/), and [Delta Lake](https://delta.io/) sink connectors) fetches data from a Pulsar topic and saves data to the Lakehouse tables. -![](https://raw.githubusercontent.com/streamnative/pulsar-io-lakehouse/v3.2.1.2/docs/lakehouse-sink.png) +![](https://raw.githubusercontent.com/streamnative/pulsar-io-lakehouse/v3.0.3.4/docs/lakehouse-sink.png) # How to get @@ -62,7 +62,7 @@ To build the Lakehouse sink connector from the source code, follow these steps. ```bash ls target - pulsar-io-lakehouse-3.2.1.2.nar + pulsar-io-lakehouse-3.0.3.4.nar ``` # How to configure @@ -147,7 +147,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you "inputs": [ "test-hudi-pulsar" ], - "archive": "connectors/pulsar-io-hudi-3.2.1.2.nar", + "archive": "connectors/pulsar-io-hudi-3.0.3.4.nar", "processingGuarantees": "EFFECTIVELY_ONCE", "parallelism": 1, "configs": { @@ -171,7 +171,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you "inputs": [ "test-hudi-pulsar" ], - "archive": "connectors/pulsar-io-hudi-3.2.1.2-cloud.nar", + "archive": "connectors/pulsar-io-hudi-3.0.3.4-cloud.nar", "parallelism": 1, "processingGuarantees": "EFFECTIVELY_ONCE", "configs": { @@ -199,7 +199,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you "inputs": [ "test-iceberg-pulsar" ], - "archive": "connectors/pulsar-io-lakehouse-3.2.1.2.nar", + "archive": "connectors/pulsar-io-lakehouse-3.0.3.4.nar", "processingGuarantees":"EFFECTIVELY_ONCE", "configs":{ "type":"iceberg", @@ -227,7 +227,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you "inputs": [ "test-iceberg-pulsar" ], - "archive": "connectors/pulsar-io-lakehouse-3.2.1.2-cloud.nar", + "archive": "connectors/pulsar-io-lakehouse-3.0.3.4-cloud.nar", "processingGuarantees":"EFFECTIVELY_ONCE", "configs":{ "type":"iceberg", @@ -258,7 +258,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you "inputs": [ "test-delta-pulsar" ], - "archive": "connectors/pulsar-io-lakehouse-3.2.1.2.nar", + "archive": "connectors/pulsar-io-lakehouse-3.0.3.4.nar", "processingGuarantees":"EFFECTIVELY_ONCE", "configs":{ "type":"delta", @@ -280,7 +280,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you "inputs": [ "test-delta-pulsar" ], - "archive": "connectors/pulsar-io-lakehouse-3.2.1.2-cloud.nar", + "archive": "connectors/pulsar-io-lakehouse-3.0.3.4-cloud.nar", "processingGuarantees":"EFFECTIVELY_ONCE", "configs":{ "type":"delta", @@ -350,7 +350,7 @@ This example describes how to use the Lakehouse sink connector to fetch data fro 1. Copy the NAR package to the Pulsar connectors directory. ``` - cp pulsar-io-lakehouse-3.2.1.2.nar PULSAR_HOME/connectors/pulsar-io-lakehouse-3.2.1.2.nar + cp pulsar-io-lakehouse-3.0.3.4.nar PULSAR_HOME/connectors/pulsar-io-lakehouse-3.0.3.4.nar ``` 2. Start Pulsar in standalone mode. @@ -383,7 +383,7 @@ This example explains how to create a Lakehouse sink connector in an on-premises 1. Copy the NAR package of the Lakehouse sink connector to the Pulsar connectors directory. ```bash - cp pulsar-io-lakehouse-3.2.1.2.nar $PULSAR_HOME/connectors/pulsar-io-lakehouse-3.2.1.2.nar + cp pulsar-io-lakehouse-3.0.3.4.nar $PULSAR_HOME/connectors/pulsar-io-lakehouse-3.0.3.4.nar ``` 2. Reload all [built-in connectors](https://pulsar.apache.org/docs/en/next/io-connectors/). diff --git a/connectors/lakehouse-sink/v3.0.3.1/lakehouse-sink.md b/connectors/lakehouse-sink/v3.2.1.3/lakehouse-sink.md similarity index 96% rename from connectors/lakehouse-sink/v3.0.3.1/lakehouse-sink.md rename to connectors/lakehouse-sink/v3.2.1.3/lakehouse-sink.md index 879d95690..d39f5edf4 100644 --- a/connectors/lakehouse-sink/v3.0.3.1/lakehouse-sink.md +++ b/connectors/lakehouse-sink/v3.2.1.3/lakehouse-sink.md @@ -11,7 +11,7 @@ tags: alias: Lakehouse Sink Connector features: ["pulsar lakehouse connector"] icon: "/images/pulsar-hub.svg" -download: https://api.github.com/repos/streamnative/pulsar-io-lakehouse/tarball/refs/tags/v3.0.3.1 +download: https://api.github.com/repos/streamnative/pulsar-io-lakehouse/tarball/refs/tags/v3.2.1.3 support: streamnative support_link: https://github.com/streamnative/pulsar-io-lakehouse support_img: "https://avatars.githubusercontent.com/u/44651383?v=4" @@ -25,7 +25,7 @@ id: "lakehouse-sink" The Lakehouse sink connector (including the [Hudi](https://hudi.apache.org), [Iceberg](https://iceberg.apache.org/), and [Delta Lake](https://delta.io/) sink connectors) fetches data from a Pulsar topic and saves data to the Lakehouse tables. -![](https://raw.githubusercontent.com/streamnative/pulsar-io-lakehouse/v3.0.3.1/docs/lakehouse-sink.png) +![](https://raw.githubusercontent.com/streamnative/pulsar-io-lakehouse/v3.2.1.3/docs/lakehouse-sink.png) # How to get @@ -62,7 +62,7 @@ To build the Lakehouse sink connector from the source code, follow these steps. ```bash ls target - pulsar-io-lakehouse-3.0.3.1.nar + pulsar-io-lakehouse-3.2.1.3.nar ``` # How to configure @@ -147,7 +147,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you "inputs": [ "test-hudi-pulsar" ], - "archive": "connectors/pulsar-io-hudi-3.0.3.1.nar", + "archive": "connectors/pulsar-io-hudi-3.2.1.3.nar", "processingGuarantees": "EFFECTIVELY_ONCE", "parallelism": 1, "configs": { @@ -171,7 +171,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you "inputs": [ "test-hudi-pulsar" ], - "archive": "connectors/pulsar-io-hudi-3.0.3.1-cloud.nar", + "archive": "connectors/pulsar-io-hudi-3.2.1.3-cloud.nar", "parallelism": 1, "processingGuarantees": "EFFECTIVELY_ONCE", "configs": { @@ -199,7 +199,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you "inputs": [ "test-iceberg-pulsar" ], - "archive": "connectors/pulsar-io-lakehouse-3.0.3.1.nar", + "archive": "connectors/pulsar-io-lakehouse-3.2.1.3.nar", "processingGuarantees":"EFFECTIVELY_ONCE", "configs":{ "type":"iceberg", @@ -227,7 +227,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you "inputs": [ "test-iceberg-pulsar" ], - "archive": "connectors/pulsar-io-lakehouse-3.0.3.1-cloud.nar", + "archive": "connectors/pulsar-io-lakehouse-3.2.1.3-cloud.nar", "processingGuarantees":"EFFECTIVELY_ONCE", "configs":{ "type":"iceberg", @@ -258,7 +258,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you "inputs": [ "test-delta-pulsar" ], - "archive": "connectors/pulsar-io-lakehouse-3.0.3.1.nar", + "archive": "connectors/pulsar-io-lakehouse-3.2.1.3.nar", "processingGuarantees":"EFFECTIVELY_ONCE", "configs":{ "type":"delta", @@ -280,7 +280,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you "inputs": [ "test-delta-pulsar" ], - "archive": "connectors/pulsar-io-lakehouse-3.0.3.1-cloud.nar", + "archive": "connectors/pulsar-io-lakehouse-3.2.1.3-cloud.nar", "processingGuarantees":"EFFECTIVELY_ONCE", "configs":{ "type":"delta", @@ -350,7 +350,7 @@ This example describes how to use the Lakehouse sink connector to fetch data fro 1. Copy the NAR package to the Pulsar connectors directory. ``` - cp pulsar-io-lakehouse-3.0.3.1.nar PULSAR_HOME/connectors/pulsar-io-lakehouse-3.0.3.1.nar + cp pulsar-io-lakehouse-3.2.1.3.nar PULSAR_HOME/connectors/pulsar-io-lakehouse-3.2.1.3.nar ``` 2. Start Pulsar in standalone mode. @@ -383,7 +383,7 @@ This example explains how to create a Lakehouse sink connector in an on-premises 1. Copy the NAR package of the Lakehouse sink connector to the Pulsar connectors directory. ```bash - cp pulsar-io-lakehouse-3.0.3.1.nar $PULSAR_HOME/connectors/pulsar-io-lakehouse-3.0.3.1.nar + cp pulsar-io-lakehouse-3.2.1.3.nar $PULSAR_HOME/connectors/pulsar-io-lakehouse-3.2.1.3.nar ``` 2. Reload all [built-in connectors](https://pulsar.apache.org/docs/en/next/io-connectors/). diff --git a/connectors/lakehouse-source/v3.2.1.2/lakehouse-source.md b/connectors/lakehouse-source/v3.0.3.4/lakehouse-source.md similarity index 95% rename from connectors/lakehouse-source/v3.2.1.2/lakehouse-source.md rename to connectors/lakehouse-source/v3.0.3.4/lakehouse-source.md index 1fb23e0e3..697fcb0c2 100644 --- a/connectors/lakehouse-source/v3.2.1.2/lakehouse-source.md +++ b/connectors/lakehouse-source/v3.0.3.4/lakehouse-source.md @@ -11,7 +11,7 @@ tags: alias: Lakehouse Source Connector features: ["pulsar lakehouse connector"] icon: "/images/pulsar-hub.svg" -download: https://api.github.com/repos/streamnative/pulsar-io-lakehouse/tarball/refs/tags/v3.2.1.2 +download: https://api.github.com/repos/streamnative/pulsar-io-lakehouse/tarball/refs/tags/v3.0.3.4 support: streamnative support_link: https://github.com/streamnative/pulsar-io-lakehouse support_img: "https://avatars.githubusercontent.com/u/44651383?v=4" @@ -25,7 +25,7 @@ id: "lakehouse-source" The Lakehouse source connector (currently only including the [Delta Lake](https://delta.io/) source connector) fetches the Lakehouse table's changelog and saves changelogs into a Pulsar topic. -![](https://raw.githubusercontent.com/streamnative/pulsar-io-lakehouse/v3.2.1.2/docs/lakehouse-source.png) +![](https://raw.githubusercontent.com/streamnative/pulsar-io-lakehouse/v3.0.3.4/docs/lakehouse-source.png) # How to get @@ -62,7 +62,7 @@ To build the Lakehouse source connector from the source code, follow these steps ```bash ls target - pulsar-io-lakehouse-3.2.1.2.nar + pulsar-io-lakehouse-3.0.3.4.nar ``` # How to configure @@ -110,7 +110,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you "parallelism":1, "topicName": "delta_source", "processingGuarantees":"ATLEAST_ONCE", - "archive": "connectors/pulsar-io-lakehouse-3.2.1.2.nar", + "archive": "connectors/pulsar-io-lakehouse-3.0.3.4.nar", "configs":{ "type":"delta", "checkpointInterval": 180, @@ -135,7 +135,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you "parallelism":1, "topicName": "delta_source", "processingGuarantees":"ATLEAST_ONCE", - "archive": "connectors/pulsar-io-lakehouse-3.2.1.2-cloud.nar", + "archive": "connectors/pulsar-io-lakehouse-3.0.3.4-cloud.nar", "configs":{ "type":"delta", "checkpointInterval": 180, @@ -195,7 +195,7 @@ This example describes how to use the Lakehouse source connector to fetch data f 1. Copy the NAR package to the Pulsar connectors directory. ``` - cp pulsar-io-lakehouse-3.2.1.2.nar PULSAR_HOME/connectors/pulsar-io-lakehouse-3.2.1.2.nar + cp pulsar-io-lakehouse-3.0.3.4.nar PULSAR_HOME/connectors/pulsar-io-lakehouse-3.0.3.4.nar ``` 2. Start Pulsar in standalone mode. @@ -226,7 +226,7 @@ This example explains how to create a Lakehouse source connector in an on-premis 1. Copy the NAR package of the Lakehouse source connector to the Pulsar connectors directory. ``` - cp pulsar-io-lakehouse-3.2.1.2.nar $PULSAR_HOME/connectors/pulsar-io-lakehouse-3.2.1.2.nar + cp pulsar-io-lakehouse-3.0.3.4.nar $PULSAR_HOME/connectors/pulsar-io-lakehouse-3.0.3.4.nar ``` 2. Reload all [built-in connectors](https://pulsar.apache.org/docs/en/next/io-connectors/). diff --git a/connectors/lakehouse-source/v3.0.3.1/lakehouse-source.md b/connectors/lakehouse-source/v3.2.1.3/lakehouse-source.md similarity index 95% rename from connectors/lakehouse-source/v3.0.3.1/lakehouse-source.md rename to connectors/lakehouse-source/v3.2.1.3/lakehouse-source.md index 8e881ef2e..e7f7f0019 100644 --- a/connectors/lakehouse-source/v3.0.3.1/lakehouse-source.md +++ b/connectors/lakehouse-source/v3.2.1.3/lakehouse-source.md @@ -11,7 +11,7 @@ tags: alias: Lakehouse Source Connector features: ["pulsar lakehouse connector"] icon: "/images/pulsar-hub.svg" -download: https://api.github.com/repos/streamnative/pulsar-io-lakehouse/tarball/refs/tags/v3.0.3.1 +download: https://api.github.com/repos/streamnative/pulsar-io-lakehouse/tarball/refs/tags/v3.2.1.3 support: streamnative support_link: https://github.com/streamnative/pulsar-io-lakehouse support_img: "https://avatars.githubusercontent.com/u/44651383?v=4" @@ -25,7 +25,7 @@ id: "lakehouse-source" The Lakehouse source connector (currently only including the [Delta Lake](https://delta.io/) source connector) fetches the Lakehouse table's changelog and saves changelogs into a Pulsar topic. -![](https://raw.githubusercontent.com/streamnative/pulsar-io-lakehouse/v3.0.3.1/docs/lakehouse-source.png) +![](https://raw.githubusercontent.com/streamnative/pulsar-io-lakehouse/v3.2.1.3/docs/lakehouse-source.png) # How to get @@ -62,7 +62,7 @@ To build the Lakehouse source connector from the source code, follow these steps ```bash ls target - pulsar-io-lakehouse-3.0.3.1.nar + pulsar-io-lakehouse-3.2.1.3.nar ``` # How to configure @@ -110,7 +110,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you "parallelism":1, "topicName": "delta_source", "processingGuarantees":"ATLEAST_ONCE", - "archive": "connectors/pulsar-io-lakehouse-3.0.3.1.nar", + "archive": "connectors/pulsar-io-lakehouse-3.2.1.3.nar", "configs":{ "type":"delta", "checkpointInterval": 180, @@ -135,7 +135,7 @@ You can create a configuration file (JSON or YAML) to set the properties if you "parallelism":1, "topicName": "delta_source", "processingGuarantees":"ATLEAST_ONCE", - "archive": "connectors/pulsar-io-lakehouse-3.0.3.1-cloud.nar", + "archive": "connectors/pulsar-io-lakehouse-3.2.1.3-cloud.nar", "configs":{ "type":"delta", "checkpointInterval": 180, @@ -195,7 +195,7 @@ This example describes how to use the Lakehouse source connector to fetch data f 1. Copy the NAR package to the Pulsar connectors directory. ``` - cp pulsar-io-lakehouse-3.0.3.1.nar PULSAR_HOME/connectors/pulsar-io-lakehouse-3.0.3.1.nar + cp pulsar-io-lakehouse-3.2.1.3.nar PULSAR_HOME/connectors/pulsar-io-lakehouse-3.2.1.3.nar ``` 2. Start Pulsar in standalone mode. @@ -226,7 +226,7 @@ This example explains how to create a Lakehouse source connector in an on-premis 1. Copy the NAR package of the Lakehouse source connector to the Pulsar connectors directory. ``` - cp pulsar-io-lakehouse-3.0.3.1.nar $PULSAR_HOME/connectors/pulsar-io-lakehouse-3.0.3.1.nar + cp pulsar-io-lakehouse-3.2.1.3.nar $PULSAR_HOME/connectors/pulsar-io-lakehouse-3.2.1.3.nar ``` 2. Reload all [built-in connectors](https://pulsar.apache.org/docs/en/next/io-connectors/). diff --git a/connectors/snowflake-sink/v3.0.3.1/snowflake-sink.md b/connectors/snowflake-sink/v3.0.3.4/snowflake-sink.md similarity index 100% rename from connectors/snowflake-sink/v3.0.3.1/snowflake-sink.md rename to connectors/snowflake-sink/v3.0.3.4/snowflake-sink.md diff --git a/connectors/snowflake-sink/v3.2.1.2/snowflake-sink.md b/connectors/snowflake-sink/v3.2.1.3/snowflake-sink.md similarity index 100% rename from connectors/snowflake-sink/v3.2.1.2/snowflake-sink.md rename to connectors/snowflake-sink/v3.2.1.3/snowflake-sink.md diff --git a/connectors/sqs-sink/v3.0.3.1/sqs-sink.md b/connectors/sqs-sink/v3.0.3.4/sqs-sink.md similarity index 99% rename from connectors/sqs-sink/v3.0.3.1/sqs-sink.md rename to connectors/sqs-sink/v3.0.3.4/sqs-sink.md index 0297b7a61..de7e60bbb 100644 --- a/connectors/sqs-sink/v3.0.3.1/sqs-sink.md +++ b/connectors/sqs-sink/v3.0.3.4/sqs-sink.md @@ -25,7 +25,7 @@ id: "sqs-sink" The [AWS Simple Queue Service (SQS)](https://aws.amazon.com/sqs/?nc1=h_ls) sink connector pulls data from Pulsar topics and persists data to AWS SQS. -![](https://raw.githubusercontent.com/streamnative/pulsar-io-sqs/v3.0.3.1/docs/sqs-sink.png) +![](https://raw.githubusercontent.com/streamnative/pulsar-io-sqs/v3.0.3.4/docs/sqs-sink.png) ## Quick start diff --git a/connectors/sqs-sink/v3.2.1.2/sqs-sink.md b/connectors/sqs-sink/v3.2.1.3/sqs-sink.md similarity index 99% rename from connectors/sqs-sink/v3.2.1.2/sqs-sink.md rename to connectors/sqs-sink/v3.2.1.3/sqs-sink.md index 664340098..e6faa3397 100644 --- a/connectors/sqs-sink/v3.2.1.2/sqs-sink.md +++ b/connectors/sqs-sink/v3.2.1.3/sqs-sink.md @@ -25,7 +25,7 @@ id: "sqs-sink" The [AWS Simple Queue Service (SQS)](https://aws.amazon.com/sqs/?nc1=h_ls) sink connector pulls data from Pulsar topics and persists data to AWS SQS. -![](https://raw.githubusercontent.com/streamnative/pulsar-io-sqs/v3.2.1.2/docs/sqs-sink.png) +![](https://raw.githubusercontent.com/streamnative/pulsar-io-sqs/v3.2.1.3/docs/sqs-sink.png) ## Quick start diff --git a/connectors/sqs-source/v3.0.3.1/sqs-source.md b/connectors/sqs-source/v3.0.3.4/sqs-source.md similarity index 99% rename from connectors/sqs-source/v3.0.3.1/sqs-source.md rename to connectors/sqs-source/v3.0.3.4/sqs-source.md index f57da6c50..3fa35e3a4 100644 --- a/connectors/sqs-source/v3.0.3.1/sqs-source.md +++ b/connectors/sqs-source/v3.0.3.4/sqs-source.md @@ -25,7 +25,7 @@ id: "sqs-source" The [AWS Simple Queue Service (SQS)](https://aws.amazon.com/sqs/?nc1=h_ls) source connector feeds data from Amazon AWS SQS and writes data to Pulsar topics. -![](https://raw.githubusercontent.com/streamnative/pulsar-io-sqs/v3.0.3.1/docs/sqs-source.png) +![](https://raw.githubusercontent.com/streamnative/pulsar-io-sqs/v3.0.3.4/docs/sqs-source.png) ## Quick start diff --git a/connectors/sqs-source/v3.2.1.2/sqs-source.md b/connectors/sqs-source/v3.2.1.3/sqs-source.md similarity index 99% rename from connectors/sqs-source/v3.2.1.2/sqs-source.md rename to connectors/sqs-source/v3.2.1.3/sqs-source.md index 261749db2..732f7cf99 100644 --- a/connectors/sqs-source/v3.2.1.2/sqs-source.md +++ b/connectors/sqs-source/v3.2.1.3/sqs-source.md @@ -25,7 +25,7 @@ id: "sqs-source" The [AWS Simple Queue Service (SQS)](https://aws.amazon.com/sqs/?nc1=h_ls) source connector feeds data from Amazon AWS SQS and writes data to Pulsar topics. -![](https://raw.githubusercontent.com/streamnative/pulsar-io-sqs/v3.2.1.2/docs/sqs-source.png) +![](https://raw.githubusercontent.com/streamnative/pulsar-io-sqs/v3.2.1.3/docs/sqs-source.png) ## Quick start