Hello,
What’s the recommendation for keeping data from multiple AWS accounts (using the AWS source plugin) stored with the Postgres destination plugin?
Whenever I switch credentials, the data in the database is replaced entirely by the new account’s data.
What are my options if I want to maintain an up-to-date state of multiple databases on Postgres?
Have you seen this page in the documentation? Running CloudQuery in Parallel
In short, the answer is to use a different value in the source name field every time you sync a different account using different credentials. Users often use something like name: "account-<account_ID>".
Either that, or run a single sync that fetches data for all the accounts using one set of credentials. This can be a bit more complicated, but more on this latter option here: Multi Account
omg I read it a week ago and already forgot about it. Going to implement. Thanks!
