Hi, when using the Kafka destination plugin, is it possible to add additional metadata to each record, say like a tenantId which is set in the environment?
Hi @dash-feather,
CloudQuery doesn’t perform any transformations on the data extracted from sources at the moment.
Do you mind sharing your configuration, how to extract the tenantId, and the expected structure of the data in Kafka?
It is not coming from the src data; this is more like an extra config field for the plugin to add an extra column with a fixed key-value pair to each dest record.
OK, thanks for clarifying. I think this is a scoped use case for data transformation.
Do you mind opening a feature request via GitHub?
If you could give a couple of examples of how the configuration would look like and the expected data, that would be great.