Hi All,
I was following through te exercise when my data flow job failed in this exercise. It gave me the following error
2020-10-09T20:51:40.941228759ZWorkflow failed. Causes: There was a problem refreshing your credentials. Please check: 1. Dataflow API is enabled for your project. 2. Make sure both the Dataflow service account and the controller service account have sufficient permissions. If you are not specifying a controller service account, ensure the default Compute Engine service account [PROJECT_NUMBER]-compute@developer.gserviceaccount.com exists and has sufficient permissions. If you have deleted the default Compute Engine service account, you must specify a controller service account. For more information, see: https://cloud.google.com/dataflow/docs/concepts/security-and-permissions#security_and_permissions_for_pipelines_on_google_cloud_platform.
I checked the data flow API, it seems to be enabled also the compute@developer.gserviceaccount.com exists. Any ideas what I am doing wrong here?
1 Answers
I had the same issue.
To resolve it I added the Dataflow Worker Role to the [PROJECTNUMBER]-compute@developer.gserviceaccount.com member in the IAM console.
I then had to create a new run of the Dataflow job by using the clone option in the job page.
Hope this helps.
Fortunately, it did solve the issue. Thank You