google cloud platform - How to merge billing export tables in GCP BigQuery - Stack Overflow

admin管理员组

文章数量:1122816

I'm trying to merge two billing export tables in GCP BigQuery into a single table. Each table is partitioned by _PARTITIONTIME.

I attempted to perform a bulk data load from one table into the other using an LOAD query, but after a few minutes, the data disappears without any error or log indication.

Is there a reliable way to transfer data from the old table to the new one without the risk of it being deleted or overwritten? Ideally, I want to preserve both the existing data in the new table and the partitions from the old table.

I don't want to use 'UNION ALL'.

Any advice or best practices would be greatly appreciated!

I attempted to perform a bulk data load from one table into the other using an LOAD query, but after a few minutes, the data disappears without any error or log indication.

I expect to see the data inside the new table, and not be deleted after several min.

I'm trying to merge two billing export tables in GCP BigQuery into a single table. Each table is partitioned by _PARTITIONTIME.

I attempted to perform a bulk data load from one table into the other using an LOAD query, but after a few minutes, the data disappears without any error or log indication.

Is there a reliable way to transfer data from the old table to the new one without the risk of it being deleted or overwritten? Ideally, I want to preserve both the existing data in the new table and the partitions from the old table.

I don't want to use 'UNION ALL'.

Any advice or best practices would be greatly appreciated!

I attempted to perform a bulk data load from one table into the other using an LOAD query, but after a few minutes, the data disappears without any error or log indication.

I expect to see the data inside the new table, and not be deleted after several min.

• google-cloud-platform
• google-bigquery
• google-cloud-billing

Share Improve this question Follow asked Nov 21, 2024 at 8:40 Ori Av-sapirOri Av-sapir 111 bronze badge 2

• Why do you want to duplicate the data? Which advantage? – guillaume blaquiere Commented Nov 21, 2024 at 9:45
• Hey, yes. I want to duplicate the data. The company created one more billing account. I have many Looker Studio dashboards, and the old large table is connected to several third-party services. So yes, I need to copy all the data to the third-party services and set up a scheduled query to transfer the data from each day. – Ori Av-sapir Commented Nov 21, 2024 at 10:07

Add a comment  | 

1 Answer 1

Sorted by: Reset to default 0

Unfortunately, based on the official documentation, this is not possible. Thank you, everyone, for your input!

enter image description here

本文标签： google cloud platformHow to merge billing export tables in GCP BigQueryStack Overflow