We have not been successful in setting up a web connection for our GCP environment.
Therefore, we use JSON key files.
Has worked just fine via a PythonCaller to read the file and fill in GOOGLE_APPLICATION_CREDENTIALS. If we had a need to write to a different GCP project we would change the project_id in the JSON file.
However, we were contacted by billing recently saying that since we use the project in our JSON file that another area was getting billed instead of our ETL project.
We tried to fully qualify using the project id and then the schema in the writer, but that did not work. It always assumes that you are writing to the project in the JSON file.
Is there a way around this issue?
Question
Google BigQuery Connector and Auth
Reply
Rich Text Editor, editor1
Editor toolbars
Press ALT 0 for help
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.