Need help with CloudQuery data migration from MySQL to Neptune

Can you connect to it via curl? See docs in Amazon Neptune - Getting Started with Connecting.

I am sorry, but I don’t quite know the commands to run to do so. The documentation doesn’t show what commands to run.

OK, so I think we might need more information regarding how you’ve set up Neptune so we can reproduce this. Can you open an issue via GitHub?

Please share your full configuration and how you have AWS Neptune set up.

The instance you’re running CloudQuery should be in the same VPC as your Neptune cluster. If using IAM auth, you need to set

auth_mode: aws
aws_region: your-region

in the Gremlin spec.

VPC is default… it allows all ports.
No IAM user.
But my program is running on localhost and connecting to Neptune DB.

Since Neptune servers can’t have a public (real world) IP, you need to run it in an instance in the same VPC or forward the port (e.g., via SSH port forwarding).

For debugging purposes, you can also try telnetting to the Neptune IP on port 8182 to see if it’s reachable.

Ok, I will try creating an instance in the same VPC and accessing the Neptune servers via it.
I will keep you posted on any developments.

UPDATE: The cloudquery sync command seems to be working now, thanks a lot!
Also, I am just checking if there is a way to change the format in which MySQL to Neptune (Gremlin) data is displayed. For example, I noticed the output always has a MySQL and date property value; can I remove it?

@kemal

Do you mean the _cq_source_name and _cq_sync_time properties? You’re syncing from MySQL to Neptune. The _cq_source_name would have the value of whatever is set in the source spec (name field), which is probably “mysql” in your case.

Yes, that’s true.

Is there a way to remove these properties from the Gremlin property graph since these values are added as standard properties for all vertices?

@kemal @erez

@valued-garfish Currently we don’t support removing ‘columns’ (“internal” _cq_* or otherwise) from a resource during the sync. If you need this functionality, can you please check CloudQuery Issues and open an issue or upvote/comment if it’s already there?