Need help with syncing credentials in AWS source and S3 destination plugins

Hello Team,

I’m working with the AWS source plugin and the S3 destination plugin. I’m trying to sync from a source AWS account to another AWS destination account. Both are unrelated, not in the same organisation.

I did not find a way to pass specific credentials to the source and others to the destination. Did I miss something or is this not supported?

Hi @evolving-raven,

For the AWS source plugin, you could use local_profile in the plugin spec to point to a dedicated profile in your credentials file.

For the S3 destination, I don’t think you can do the same in the spec, but you should be able to do it via environment variables without conflicting with the AWS credentials.

More information can be found here:

This allows for different credentials for the AWS source and the S3 destination.

Awesome, thanks for the quick reply! I will try that!