feat(enrichment_tables): add json file support for enrichment tables

[altanozlu]

A note for the community

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• If you are interested in working on this issue or have submitted a pull request, please leave a comment

Use Cases

• I would like to enrich my inputs with consul metadata and I would like to use json directly rather than converting json into csv then try to work around.

Attempted Solutions

• using csv and encoding/decoding some json values, which I don't want to do for each input.

Proposal

• Support json file directly, as long as json input compatible with Value object it should be fine.
• json file itself must be as list of object.
• There should be no need for further schema definitions since json file is converted to Value directly.

[enrichment_tables.metadata]
type = "file"

[enrichment_tables.metadata.file]
path = "/etc/vector/consul_metadata.json"
encoding = { type = "json" }

json file:

[
{"ip": "0.0.0.0", "version": 0.1}, 
{"ip": "0.0.0.x", "version": 0.5}
]

References

No response

Version

vector 0.41.1 (x86_64-apple-darwin 745babd 2024-09-11 14:55:36.802851761)

[jszwedko]

Thanks @altanozlu ! I agree that this would be useful.

[altanozlu]

For now I have lost my interest for this feature, @jszwedko please feel free to close it