Preinstalling CloudQuery plugins without running a sync first

CloudQuery Plugins
1

Hi folks, is there a way to preinstall a plugin without running a sync first? For example,

cloudquery plugin install cloudquery/file@v3.4.5

(just like what Steampipe does). I just read the documentation, and seemingly there’s no way to do it for now. Otherwise, will this be implemented in the future?

2

Hi @fluffy-cloud,

A workaround is to run

cloudquery migrate

that will download plugins and create tables, but won’t run a sync.

Or also

cloudquery tables

that will download plugins and create tables docs.

3

I see, thanks, I’ll try that.

4

@fluffy-cloud Just out of interest, what were you trying to achieve by preinstalling the plugins?

5

I was trying to build a Docker image with the CloudQuery plugin preinstalled in it. I know I could use a volume to cache it, but the requirement was to run this on an ephemeral machine like ECS (where it costs to have network traffic from outside AWS), and I couldn’t use volumes due to the requirement as well.

cloudquery migrate

works as a workaround. However, cloudquery tables somehow only downloaded the source plugins and not the destination ones.

6

Thank you!
@fluffy-cloud We now have this as a feature request: #13937 so you can upvote this :slightly_smiling_face:

7

This would also be extremely useful where I work. Our cloud environments are heavily locked down, so downloading the plugins at runtime won’t work.

Looking at the GitHub, it looks like it’s already done :slightly_smiling_face:

8 
@nicks0053 Yes, it's implemented. Try running `cloudquery install <spec.yml>`.