CloudQuery telemetry integration issues with AWS X-Ray and OpenTelemetry

CloudQuery Plugins
1

Heyo!

Don’t suppose anyone has any experience getting CloudQuery telemetry to play nicely with AWS X-Ray? Trying to collect CloudQuery telemetry using “AWS Distro for OpenTelemetry” on ECS but not having much luck.

Got a PR here: https://github.com/guardian/service-catalogue/pull/530

Essentially running public.ecr.aws/aws-observability/aws-otel-collector in a sidecar container to CloudQuery, which exposes an OTLP collector on localhost:4318. This should, in theory, collect the OpenTelemetry data from CloudQuery and send it off to AWS X-Ray… but I’m seeing diddly squat come through on the X-Ray end of things, and I don’t seem to see any logs from CloudQuery or the sidecar about anything bad happening.

2

Hey! I don’t have experience with AWS X-Ray, but were you able to run it locally? BTW, will you be open to doing a case study with us? Looks like you did some cool stuff from the repo! I can assign an engineer from our team to jump on a call and figure out the tracing support if yes :slightly_smiling_face:. In any case, we will try to here asynchronously as much as we can.

3

Managed to get it running locally with Jaeger, yea! To be honest, it’s probably an issue with how I’m setting up X-Ray and not CloudQuery!

Would love to hop on a call at some point and showcase what we’ve been doing!