-
Notifications
You must be signed in to change notification settings - Fork 4
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
66 changed files
with
613 additions
and
347 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,5 @@ | ||
trying connection to fluvio router.infinyon.cloud:9003 | ||
downloading infinyon/[email protected] to infinyon-jolt-0.4.1.ipkg | ||
... downloading complete | ||
... checking package | ||
... cluster smartmodule install complete |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1 +1,2 @@ | ||
cdk hub download infinyon/[email protected] | ||
downloading infinyon/[email protected] to infinyon-http-source-0.3.8.ipkg | ||
... downloading complete |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,5 @@ | ||
trying connection to fluvio router.infinyon.cloud:9003 | ||
downloading infinyon/[email protected] to infinyon-jolt-0.4.1.ipkg | ||
... downloading complete | ||
... checking package | ||
... cluster smartmodule install complete |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,2 +1 @@ | ||
fluvio hub smartmodule download infinyon/[email protected] | ||
... cluster smartmodule install complete |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,5 @@ | ||
trying connection to fluvio router.infinyon.cloud:9003 | ||
downloading infinyon/[email protected] to infinyon-json-sql-0.2.1.ipkg | ||
... downloading complete | ||
... checking package | ||
... cluster smartmodule install complete |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -137,27 +137,20 @@ $ fluvio cloud connector create --config sql.yml | |
|
||
Download the [Jolt] and [Json-Sql] SmartModules used by this example connector | ||
|
||
Example output | ||
|
||
import CodeBlock from '@theme/CodeBlock'; | ||
import SmDownloadJolt from '!!raw-loader!../../_embeds/cmds/hub-sm-download-jolt.bash'; | ||
import SmDownloadJoltOutput from '!!raw-loader!../../_embeds/cmds/hub-sm-download-jolt-output.bash'; | ||
import SmDownloadJsonSql from '!!raw-loader!../../_embeds/cmds/hub-sm-download-json-sql.bash'; | ||
import SmDownloadJsonSqlOutput from '!!raw-loader!../../_embeds/cmds/hub-sm-download-json-sql-output.bash'; | ||
|
||
```bash | ||
$ fluvio hub sm download infinyon/[email protected] | ||
downloading infinyon/[email protected] to infinyon-json-sql-x.y.z.ipkg | ||
... downloading complete | ||
... checking package | ||
trying connection to fluvio router.infinyon.cloud:9003 | ||
... cluster smartmodule install complete | ||
``` | ||
<CodeBlock language="bash" copyBehavior="fl">$ {SmDownloadJsonSql} $ {SmDownloadJolt}</CodeBlock> | ||
|
||
Expect the following output: | ||
|
||
```bash | ||
$ fluvio hub sm download infinyon/[email protected] | ||
downloading infinyon/[email protected] to infinyon-jolt-x.y.z.ipkg | ||
... downloading complete | ||
... checking package | ||
trying connection to fluvio router.infinyon.cloud:9003 | ||
... cluster smartmodule install complete | ||
``` | ||
<CodeBlock language="bash"> | ||
{SmDownloadJsonSqlOutput} | ||
{SmDownloadJoltOutput} | ||
</CodeBlock> | ||
|
||
##### Connector with JSON to JSON transformation config | ||
|
||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -18,7 +18,7 @@ Listing Hub SmartModule from the CLI is straight forward: | |
$ fluvio hub list | ||
|
||
SMARTMODULE Visibility | ||
infinyon/jolt@0.1.0 public | ||
infinyon/jolt@0.4.1 public | ||
infinyon/[email protected] public | ||
infinyon/[email protected] public | ||
... | ||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -52,22 +52,23 @@ The Jolt SmartModule applies the operations in sequence: `remove` followed by `s | |
To demonstrate how **Jolt** SmartModule works we will use [SMDK] tool. | ||
|
||
:::info | ||
All smartmodule versions are marked with `x.y.z`. To find the latest version, run: | ||
All smartmodule versions are marked with `0.4.1`. To find the latest version, run: | ||
* `fluvio hub smartmodule list` | ||
::: | ||
|
||
First, we need to download it to our cluster: | ||
|
||
```bash copy="fl" | ||
$ fluvio hub smartmodule download infinyon/[email protected] | ||
``` | ||
import CodeBlock from '@theme/CodeBlock'; | ||
import SmDownloadJolt from '!!raw-loader!../../_embeds/cmds/hub-sm-download-jolt.bash'; | ||
|
||
<CodeBlock language="bash" copyBehavior="fl">$ {SmDownloadJolt}</CodeBlock> | ||
|
||
Second, we create a file `transform.yaml` with transformation specification defined above: | ||
|
||
```yaml | ||
# transform.yaml | ||
transforms: | ||
- uses: infinyon/jolt@x.y.z | ||
- uses: infinyon/jolt@0.4.1 | ||
spec: | ||
- operation: remove | ||
spec: | ||
|
@@ -113,4 +114,4 @@ For additional examples checkout the tutorials: | |
|
||
[Fluvio Jolt]: https://github.com/infinyon/fluvio-jolt | ||
[map-type]:smartmodules/features/operators/map.mdx | ||
[SMDK]: smartmodules/smdk.mdx | ||
[SMDK]: smartmodules/smdk.mdx |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
1 change: 1 addition & 0 deletions
1
versioned_docs/version-0.11.11/_embeds/cmds/cdk-deploy-start-http-sink-generic.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
cdk deploy start --ipkg infinyon-http-sink-0.2.11.ipkg --config <CONFIG> |
1 change: 1 addition & 0 deletions
1
versioned_docs/version-0.11.11/_embeds/cmds/cdk-hub-download-http-sink.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
cdk hub download infinyon/[email protected] |
5 changes: 5 additions & 0 deletions
5
versioned_docs/version-0.11.11/_embeds/cmds/cdk-hub-download-http-source-output.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,5 @@ | ||
trying connection to fluvio router.infinyon.cloud:9003 | ||
downloading infinyon/[email protected] to infinyon-jolt-0.4.1.ipkg | ||
... downloading complete | ||
... checking package | ||
... cluster smartmodule install complete |
3 changes: 2 additions & 1 deletion
3
versioned_docs/version-0.11.11/_embeds/cmds/cdk-hub-download-http-source.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1 +1,2 @@ | ||
cdk hub download infinyon/[email protected] | ||
downloading infinyon/[email protected] to infinyon-http-source-0.3.8.ipkg | ||
... downloading complete |
13 changes: 13 additions & 0 deletions
13
versioned_docs/version-0.11.11/_embeds/cmds/hub-conn-list.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,13 @@ | ||
fluvio hub connector list | ||
CONNECTOR Visibility | ||
infinyon-labs/[email protected] public | ||
infinyon/[email protected] public | ||
infinyon/[email protected] public | ||
infinyon/[email protected] public | ||
infinyon/[email protected] public | ||
infinyon/[email protected] public | ||
infinyon/[email protected] public | ||
infinyon/[email protected] public | ||
infinyon/[email protected] public | ||
infinyon/[email protected] public | ||
qdrant/[email protected] public |
5 changes: 5 additions & 0 deletions
5
versioned_docs/version-0.11.11/_embeds/cmds/hub-sm-download-jolt-output.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,5 @@ | ||
trying connection to fluvio router.infinyon.cloud:9003 | ||
downloading infinyon/[email protected] to infinyon-jolt-0.4.1.ipkg | ||
... downloading complete | ||
... checking package | ||
... cluster smartmodule install complete |
1 change: 0 additions & 1 deletion
1
versioned_docs/version-0.11.11/_embeds/cmds/hub-sm-download-jolt.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,2 +1 @@ | ||
fluvio hub smartmodule download infinyon/[email protected] | ||
... cluster smartmodule install complete |
5 changes: 5 additions & 0 deletions
5
versioned_docs/version-0.11.11/_embeds/cmds/hub-sm-download-json-sql-output.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,5 @@ | ||
trying connection to fluvio router.infinyon.cloud:9003 | ||
downloading infinyon/[email protected] to infinyon-json-sql-0.2.1.ipkg | ||
... downloading complete | ||
... checking package | ||
... cluster smartmodule install complete |
15 changes: 15 additions & 0 deletions
15
versioned_docs/version-0.11.11/_embeds/cmds/hub-sm-list.bash
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,15 @@ | ||
fluvio hub smartmodule list | ||
SMARTMODULE Visibility | ||
infinyon-labs/[email protected] public | ||
infinyon-labs/[email protected] public | ||
infinyon-labs/[email protected] public | ||
infinyon-labs/[email protected] public | ||
infinyon-labs/[email protected] public | ||
infinyon-labs/[email protected] public | ||
infinyon-labs/[email protected] public | ||
infinyon-labs/[email protected] public | ||
infinyon-labs/[email protected] public | ||
infinyon/[email protected] public | ||
infinyon/[email protected] public | ||
infinyon/[email protected] public | ||
infinyon/[email protected] public |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -117,7 +117,7 @@ transforms: | |
json-key: "payload.device.device_id" | ||
value: | ||
type: "int" | ||
default: "0" | ||
defau1t: "0" | ||
required: true | ||
"record": | ||
json-key: "$" | ||
|
@@ -137,27 +137,20 @@ $ fluvio cloud connector create --config sql.yml | |
|
||
Download the [Jolt] and [Json-Sql] SmartModules used by this example connector | ||
|
||
Example output | ||
import CodeBlock from '@theme/CodeBlock'; | ||
import SmDownloadJolt from '!!raw-loader!../../_embeds/cmds/hub-sm-download-jolt.bash'; | ||
import SmDownloadJoltOutput from '!!raw-loader!../../_embeds/cmds/hub-sm-download-jolt-output.bash'; | ||
import SmDownloadJsonSql from '!!raw-loader!../../_embeds/cmds/hub-sm-download-json-sql.bash'; | ||
import SmDownloadJsonSqlOutput from '!!raw-loader!../../_embeds/cmds/hub-sm-download-json-sql-output.bash'; | ||
|
||
<CodeBlock language="bash" copyBehavior="fl">$ {SmDownloadJsonSql} $ {SmDownloadJolt}</CodeBlock> | ||
|
||
```bash | ||
$ fluvio hub sm download infinyon/[email protected] | ||
downloading infinyon/[email protected] to infinyon-json-sql-x.y.z.ipkg | ||
... downloading complete | ||
... checking package | ||
trying connection to fluvio router.infinyon.cloud:9003 | ||
... cluster smartmodule install complete | ||
``` | ||
|
||
Expect the following output: | ||
|
||
```bash | ||
$ fluvio hub sm download infinyon/[email protected] | ||
downloading infinyon/[email protected] to infinyon-jolt-x.y.z.ipkg | ||
... downloading complete | ||
... checking package | ||
trying connection to fluvio router.infinyon.cloud:9003 | ||
... cluster smartmodule install complete | ||
``` | ||
<CodeBlock language="bash"> | ||
{SmDownloadJsonSqlOutput} | ||
{SmDownloadJoltOutput} | ||
</CodeBlock> | ||
|
||
##### Connector with JSON to JSON transformation config | ||
|
||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -18,7 +18,7 @@ Listing Hub SmartModule from the CLI is straight forward: | |
$ fluvio hub list | ||
|
||
SMARTMODULE Visibility | ||
infinyon/jolt@0.1.0 public | ||
infinyon/jolt@0.4.1 public | ||
infinyon/[email protected] public | ||
infinyon/[email protected] public | ||
... | ||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -52,22 +52,23 @@ The Jolt SmartModule applies the operations in sequence: `remove` followed by `s | |
To demonstrate how **Jolt** SmartModule works we will use [SMDK] tool. | ||
|
||
:::info | ||
All smartmodule versions are marked with `x.y.z`. To find the latest version, run: | ||
All smartmodule versions are marked with `0.4.1`. To find the latest version, run: | ||
* `fluvio hub smartmodule list` | ||
::: | ||
|
||
First, we need to download it to our cluster: | ||
|
||
```bash copy="fl" | ||
$ fluvio hub smartmodule download infinyon/[email protected] | ||
``` | ||
import CodeBlock from '@theme/CodeBlock'; | ||
import SmDownloadJolt from '!!raw-loader!../../_embeds/cmds/hub-sm-download-jolt.bash'; | ||
|
||
<CodeBlock language="bash" copyBehavior="fl">$ {SmDownloadJolt}</CodeBlock> | ||
|
||
Second, we create a file `transform.yaml` with transformation specification defined above: | ||
|
||
```yaml | ||
# transform.yaml | ||
transforms: | ||
- uses: infinyon/jolt@x.y.z | ||
- uses: infinyon/jolt@0.4.1 | ||
spec: | ||
- operation: remove | ||
spec: | ||
|
@@ -86,7 +87,7 @@ Let's use `smdk test` to see it in action: | |
|
||
```bash copy="fl" | ||
$ smdk test --text '{}' --transforms-file ./transform.yaml | ||
1 records outputed | ||
1 records outputted | ||
{"data":{"source":"http-connector"}} | ||
``` | ||
|
||
|
@@ -113,4 +114,4 @@ For additional examples checkout the tutorials: | |
|
||
[Fluvio Jolt]: https://github.com/infinyon/fluvio-jolt | ||
[map-type]:smartmodules/features/operators/map.mdx | ||
[SMDK]: smartmodules/smdk.mdx | ||
[SMDK]: smartmodules/smdk.mdx |
Oops, something went wrong.