Question about adding related target tables in CloudQuery

CloudQuery Plugins
1

A question on how to add the target tables.

Seems the tables have relationship and layer level.

* aws_config_config_rules
  * aws_config_config_rule_compliance_details
  * aws_config_config_rule_compliances
  * aws_config_remediation_configurations

Do I need to add the above four tables when updating the source configuration, or is it fine to add the top one aws_config_config_rules only, which will cover all of its sub-tables as well?

2

Hi @calm-walrus :wave:

The behavior here depends on the value of the skip_dependent_tables setting CloudQuery Documentation.

If false, you can specify aws_config_config_rules and it will sync all the child tables as well. This is the default.

If skip_dependent_tables: true, you have to explicitly specify the child tables you want to sync.

We generally recommend setting it to true and then specifying the child tables you wish to sync. The default value is false for backwards-compatibility with older versions that didn’t support this setting.

If you choose skip_dependent_tables: false: although convenient, the downside is that you may automatically sync new child tables when we add them, which can cause the syncs to take longer and longer over time, and sync more data than you may want.

3

Thanks, that makes sense.