Question about the max_backoff parameter unit in CloudQuery source plugin

Hi Team,

I have a question regarding the source plugin parameter max_backoff. Could you confirm if the unit is in seconds?

Assuming you are referring to the AWS source plugin, yes, the unit is in seconds. Exponential backoff is still used, but max_backoff is the maximum number of time that will elapse between retries. We should clarify this in the docs :slightly_smiling_face:

Hi @herman,

Thank you for your feedback. I am referring to the AWS plugin. The default value is 30, and as per the docs, it is “Defines the duration between retry attempts.” My understanding is that it will wait for 30 seconds before the first retry; am I right?

Not quite, it follows an exponential backoff curve defined by the AWS SDK. See Exponential Backoff. If my reading there is correct, the first retry will happen after about 1 second, then 2, 4, 8, 16, … until max_backoff is reached. Then it will keep retrying every max_backoff seconds until max_attempts has been reached.