# Adding cluster name metadata to k8s source data for gcs bigquery queries

**URL:** <https://community.cloudquery.io/t/adding-cluster-name-metadata-to-k8s-source-data-for-gcs-bigquery-queries/433>\
**Category:** CloudQuery Plugins\
**Created:** [January 26, 2024, 1:01am UTC](https://community.cloudquery.io/t/adding-cluster-name-metadata-to-k8s-source-data-for-gcs-bigquery-queries/433 "2024-01-26T01:01:16Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![pretty-wolf](https://avatars.discourse-cdn.com/v4/letter/p/7feea3/32.png) [@pretty-wolf](https://community.cloudquery.io/u/pretty-wolf)\
**Post date:** [January 26, 2024, 1:01am UTC](https://community.cloudquery.io/t/adding-cluster-name-metadata-to-k8s-source-data-for-gcs-bigquery-queries/433/1 "2024-01-26T01:01:16Z")

</div>

I’m testing out the `k8s` source. I’ve run it against ~4 different clusters (we have about 25 clusters). Is there a way to hydrate metadata like the cluster name into it? I send it to GCS, which uses transfer jobs to BigQuery, but I can’t distinguish the data from different clusters in my queries.

My config is:

```auto
---
kind: source
spec:
  name: k8s
  path: cloudquery/k8s
  registry: cloudquery
  version: "v5.2.6"
  tables: ["*"]
  destinations: ["gcs_k8s"]
---
kind: destination
spec:
  name: "gcs_k8s"
  path: "cloudquery/gcs"
  registry: "cloudquery"
  version: "v3.4.12"
  spec:
    bucket: "cloudquery"
    path: "k8s/${cluster_shortname}"
    format: "parquet"
    no_rotate: true

```

---

<div class="post-metadata">

**Author:** ![yevgenyp](https://avatars.discourse-cdn.com/v4/letter/y/3be4f8/32.png) [@yevgenyp](https://community.cloudquery.io/u/yevgenyp)\
**Post date:** [January 26, 2024, 1:03am UTC](https://community.cloudquery.io/t/adding-cluster-name-metadata-to-k8s-source-data-for-gcs-bigquery-queries/433/2 "2024-01-26T01:03:22Z")

</div>

Hey 👋.  
One thing you could do is use the `name` as the cluster name and it will be available in a column called `_cq_source_name`.

---

<div class="post-metadata">

**Author:** ![pretty-wolf](https://avatars.discourse-cdn.com/v4/letter/p/7feea3/32.png) [@pretty-wolf](https://community.cloudquery.io/u/pretty-wolf)\
**Post date:** [January 26, 2024, 1:04am UTC](https://community.cloudquery.io/t/adding-cluster-name-metadata-to-k8s-source-data-for-gcs-bigquery-queries/433/3 "2024-01-26T01:04:07Z")

</div>

Got a snippet I can steal?  
I see what you mean, just not sure how to change it to your suggestion.

---

<div class="post-metadata">

**Author:** ![yevgenyp](https://avatars.discourse-cdn.com/v4/letter/y/3be4f8/32.png) [@yevgenyp](https://community.cloudquery.io/u/yevgenyp)\
**Post date:** [January 26, 2024, 1:04am UTC](https://community.cloudquery.io/t/adding-cluster-name-metadata-to-k8s-source-data-for-gcs-bigquery-queries/433/4 "2024-01-26T01:04:40Z")

</div>

```auto
---
kind: source
spec:
  name: your_cluster_name
  path: cloudquery/k8s
  registry: cloudquery
  version: "v5.2.6"
  tables: ["*"]
  destinations: ["gcs_k8s"]
---
kind: destination
spec:
  name: "gcs_k8s"
  path: "cloudquery/gcs"
  registry: "cloudquery"
  version: "v3.4.12"
  spec:
    bucket: "cloudquery"
    path: "k8s/${cluster_shortname}"
    format: "parquet"
    no_rotate: true

```

---

<div class="post-metadata">

**Author:** ![pretty-wolf](https://avatars.discourse-cdn.com/v4/letter/p/7feea3/32.png) [@pretty-wolf](https://community.cloudquery.io/u/pretty-wolf)\
**Post date:** [January 26, 2024, 1:04am UTC](https://community.cloudquery.io/t/adding-cluster-name-metadata-to-k8s-source-data-for-gcs-bigquery-queries/433/5 "2024-01-26T01:04:49Z")

</div>

ah. that’s easy!  
one sec  
nvm lol

---

<div class="post-metadata">

**Author:** ![pretty-wolf](https://avatars.discourse-cdn.com/v4/letter/p/7feea3/32.png) [@pretty-wolf](https://community.cloudquery.io/u/pretty-wolf)\
**Post date:** [January 26, 2024, 1:12am UTC](https://community.cloudquery.io/t/adding-cluster-name-metadata-to-k8s-source-data-for-gcs-bigquery-queries/433/6 "2024-01-26T01:12:27Z")

</div>

Thanks! That was super quick. Now that this is generally working, I’ll be able to write the design review next week and hopefully get it up and running for all 25 clusters. 🎉

---

<div class="post-metadata">

**Author:** ![yevgenyp](https://avatars.discourse-cdn.com/v4/letter/y/3be4f8/32.png) [@yevgenyp](https://community.cloudquery.io/u/yevgenyp)\
**Post date:** [January 26, 2024, 1:17am UTC](https://community.cloudquery.io/t/adding-cluster-name-metadata-to-k8s-source-data-for-gcs-bigquery-queries/433/7 "2024-01-26T01:17:37Z")

</div>

Nice 🥳 Keep us posted, curious to learn how it goes!