Troubleshooting Dust BigQuery Table Query Issues: Help Needed
Hello ! I'm struggling to have Dust query a particular BigQuery table with the Query Tables feature. My agent keeps on failing with this message: Query uses tables that are not allowed: MY_GCP_PROJECT_ID.MY_DATASET.MY_TABLE Some facts:
the Service Account i'm using for the BigQuery connection has the sufficient roles (bq viewer, bq user and bq job user)
I am applying those roles at the project level (so no IAM conditions here)
A table from the same project (but a different dataset) is queried fine
Although the agent fails to query the table, it seems able to analyze the data and compute a SQL query to execute
So it seems that the Table is read, accessed, but BigQuery jobs are not running for some reason 🤔 What I did so far:
refresh the BigQuery connection using new SA key
removed the table from the space data then moving it back again
created fresh agents that use that table
None of the above worked for me... I also looked for traces of a bigquery job started by my SA on the bq job history or logs in GCP, but I found nothing So right now I'm not able to understand what is happening here. Is this a known issue ? Maybe some kind of IAM propagation involved here ? Any help is appreciated ^^ NB: the only difference I can see between the two tables (one working and the other not) and all the setups that i've made so far; is that the working table name is lowercase, and the non-working table name is uppercase 😅