Hey there folks!
Need some help with using CQ to migrate data from MySQL to Neptune. I am not sure what I am doing wrong and would appreciate your help.
Hi @valued-garfish, do you mind sharing the issue you’re experiencing first here? We use public channels for community-based support and private channels for paid support. See CloudQuery Pricing.
Sure
So essentially I am trying to migrate my data from MySQL to Neptune on AWS. I am on a Windows PC. I will send a screenshot of the code and the error messages.
This is the MySQL config file for the plugin:
[MySQL config content here]
This is the Gremlin config file:
[Gremlin config content here]
@erez Any idea what’s happening?
From the logs, it seems the machine running CloudQuery can’t connect to the MySQL database. I recommend trying to connect using MySQL Workbench first to test the connection string.
Why is that so? I am using the database in Workbench.
@erez
On what port is the MySQL server running?
In the configuration spec, the connection string should be in the format
username:password@protocol(address)/dbname?param=value
See https://github.com/go-sql-driver/mysql#dsn-data-source-name
Ok, I shall try and let you know ASAP.
Is the MySQL server running on the same machine as the CloudQuery CLI?
Yes, this was the documentation I was referring to.
OK, so I think I misread the error.
Looks like it fails to connect to the Gremlin destination.
Hmm, so what do I do then?
The Gremlin destination in this case is the AWS Neptune DB.
I am not sure how to enter the access and secret keys, and if they are required in the first place.
We have some docs on how to connect to AWS Neptune here: CloudQuery Documentation.
There are no IAM groups.
I have looked through that.
The endpoint should be wss://your-endpoint.cluster-id.your-region.neptune.amazonaws.com
I tried that too. It throws another error.
Since using localhost won’t work regardless.
Based on the error, the machine you’re running CloudQuery CLI from can’t connect to that address. It’s a private address, so I’m not sure how you would set up that connection. Can you verify you can connect from the machine to the Neptune instance?
I run the instance on a web browser, and it is visible. I also use the Neptune notebooks as well.