Hello,
The BQ loader step might not be loading data into the GBQ table due to access permission issues, incorrect configuration, network problems, or service limitations. Check IAM permissions, BQ loader settings, network kyconnect gov connectivity, and service quotas. Enable detailed logging and try loading a smaller dataset for troubleshooting. By addressing these potential causes, you should be able to resolve the issue.
------------------------------
michele stokes
stokes
------------------------------
Original Message:
Sent: 08-02-2024 17:43
From: Ramya Nadig
Subject: Version 9.3 - PDI - Google BQ loader step runs successfully but data not loaded.
BQ loader step runs successfully but data not loaded. No errors in logs. Job loads data into avro file first and then calls bq loader step to load into the GBQ table. All the steps are run successfully.
Some background -
The job is being run in a new VM server on GCP (created using lift and shift method). We are able to run the job successfully on our old server and load the BQ table just fine. We checked GOOGLE_APPLICATION_CREDENTIALS variables and json file and everything else mentioned in the bq loader step documentation and everything checks out.
Is there anything we might be missing? What might be causing this issue? (load to avro file is working fine - file is found in google storage but table load is not working as expected)
------------------------------
Ramya Nadig
Account Representative
Randstad USA
------------------------------