DUST Dataset Load and Refresh Times with BigQuery Insights

·

Hi everyone, I'm currently working with a dataset stored in Big Query(GCP) and using it within a DUST workspace. I’d like to ask:

How long does it usually take for DUST to load a dataset from BigQuery (initial load) ?
And what's the average refresh time when tables in BigQuery are updated ?

Any insights based on your experience would be greatly appreciated! Thank you

· Sorted by Oldest

Remi
·
·
Hey Otman Manad, thanks for the question! Dust doesn't store the data but the metadata on the tables in Bigquery. It will write and run a sql queries when pugged to an agent with "query table" tool. 30 min is usually enough for the first sync. 😊
👍1

Remi
·
·
Hey Otman Manad, thanks for the question! Dust doesn't store the data but the metadata on the tables in Bigquery. It will write and run a sql queries when pugged to an agent with "query table" tool. 30 min is usually enough for the first sync. 😊
👍1