Questions tagged [google-bigquery]

0 votes
0 replies
Mongo to Big Query Import Issues
When importing from mongo to big-query the following errors occurs. We have a script that prepares the data from a mongo dump on s3 (around 2.8GB...
asked 4 months ago
-1 votes
2 replies
How to only select the SQL row with the MAX id in this join?
I need to get the record with the MAX id from this joined table, but I only need the top row to be joined with the main query on this subquery. H...
asked 4 months ago
-1 votes
0 replies
Is there a way to see how the size of a bq_helper query before running it?
I am working with a big data set (~180GB) and I am wondering if I can see the size (in GB) of a query before I run it? I am using bq_helper pack...
asked 4 months ago
0 votes
1 replies
Computational Efficiency - I/O
If I have two queries, why does it seem the second query is more computationally efficient (just in terms of I/O) as the first: The first query...
asked 4 months ago
0 votes
1 replies
Finding Bigquery table size across all projects
We are maintaining a table in Bigquery that captures all the activity logs from the Stack driver logs. This table helps me list all the tables pr...
asked 4 months ago
1 votes
1 replies
How do I do a LIKE function referencing another Column?
So my problem is, I three tables that I'm working with, Table A/Table B/Table C, Table A & Table B both have number mechanisms within them. S...
asked 4 months ago
0 votes
1 replies
bq query with a destination table vrs insert statement
I have some data in a BigQuery table(src_table) and I want to insert the data into another BigQuery table(tgt_table). I have two options of inse...
asked 4 months ago
1 votes
2 replies
How to replace null values based on other column match in the same table
Apologies if this is a basic question, but I'm just getting started using SQL and BigQuery. I have a table with 2 specific unique identifiers us...
1 votes
3 replies
How to schedule a google-bigQuery so its results would import to spreadsheet on a daily basis?
I wrote a bigQuery query that returns the number of customers in the system, updated to the time I run the query. I want to schedule the query so...
asked 4 months ago
-1 votes
2 replies
How To Extract Distinct ID's Present In One Table But Not Another
I have two tables, one with the sales entries (multiple of the same salesman id number), and another that is a master file of sales people (only...
asked 4 months ago
0 votes
1 replies
Aggregations of aggregations are not allowed Bigquery
I'm trying to query my google bigquery analytics table. The fields I'm interested in are nested. The structure I want to retrieve fits : Category...
asked 4 months ago
1 votes
0 replies
Can window functions navigate through and conditionally select specific rows in an ordered BigQuery rowset?
I have a BigQuery result set, containing website events, which can be grouped and sorted along several columns including timestamp and event type...
asked 4 months ago
4 votes
0 replies
BigQuery replaced most of my Spark jobs, am I missing something?
I've been developing Spark jobs for some years using on-premise clusters and our team recently moved to the Google Cloud Platform allowing us to...
0 votes
1 replies
Data dumping from Apache Alooma to Bigquery
We have a pipeline set to receive data from Apache Alooma to Bigquery (partitioned tables based on _PARTITIONTIME). Observation so far is data i...
asked 4 months ago
0 votes
1 replies
How to run this BigQuery SQL?
I want to parse the bitcoin private keys from github on bigquery and i cant run this code SELECT f.repo_name, f.path, c.pkey FROM `bigque...
asked 4 months ago
0 votes
3 replies
How do I add arrays in BigQuery SQL?
I have a UDF which returns a floating point array of the same size for each row of a table. How do I sum values of these arrays ? In other words...
asked 4 months ago
0 votes
0 replies
What criteria is used to transfer daily data from Firebase Crashlytics to Big-Query
When Firebase Crashlytics is linked to Bigquery, daily Firebase Crashlytics data is pushed to Biquery, I want to know how to only select this da...
asked 4 months ago
-2 votes
0 replies
How can i implement Google-big-query with mailjet
Hello i tried to establish a connection with mailjet and google bigquery through a pipeline.Then i use a Google cloud account created by my boss....
asked 4 months ago
0 votes
1 replies
How do I continuously merge two datasets with the same schema together without duplicating rows?
On Google Cloud Platform, I have multiple billing accounts. For each billing account, I created a scheduled export to BigQuery that executes mult...
asked 4 months ago
0 votes
0 replies
How come Firebase Analytics data does not show up in BigQuery?
I'm trying to get Firebase Analytics data to show up in BigQuery for an iOS app, however the BigQuery dataset is not created, the Firebase BigQue...
0 votes
0 replies
BigQuery: Google Ads report transformation: Geo Performance Report: GeoStats tables are empty
Transfer google ads data into bigquery https://cloud.google.com/bigquery/docs/adwords-transformation But tables GeoConversionStats_[CUSTOMER_I...
0 votes
1 replies
How to remove fields from big query table?
I updated schema of one production bq table and added record type of field with few repeated fields inside another record type field. Now I have...
-1 votes
2 replies
Move an entire bucket from google cloud storage to BigQuery?
From Google Cloud Storage to BigQuery transfers documentation which I have been reading, I can see how I can load data files one-by-one. Is the...
1 votes
0 replies
Grouping by quantiles with large data in BiqQuery
I have a large dataset of millions of rows with values x and y, and want to get the avg(y) in different quantiles of x. One way I could do that i...
-4 votes
0 replies
To know which is the best tool for bigquery data modeling
I have many tables. I tried my bigquery data modeling diagram in draw.io but it is very slow and heavily loading. -4 This question is extr...
asked 4 months ago