Recently I thought I’d look at BigQuery’s new row-level security feature: https://cloud.google.com/bigquery/docs/row-level-security-intro For a moment I was excited because I thought I could remove the view scenario I’m using to manage row-level access at the moment. Briefly, the fact table is joined to another table on the relevant key and each user’s email address is …
Google Cloud recently changed their authorized views functionality in the console. And they broke it! You can no longer authorize views across projects using the console! It seems some of their documentation hasn’t been able to keep up either! https://cloud.google.com/bigquery/docs/authorized-views#console Fortunately some of their other documentation is up to date (but there’s a catch): https://cloud.google.com/bigquery/docs/share-access-views#authorize_the_view_to_access_the_source_dataset …
How to authorize BigQuery views across projects using the Java Client Library Read More »
In Amazon Athena: First we need to get the schema of our source table or query. I’m doing a select * from my source table so I can use: show create table headeraltpartitions4; We need the schema to create the table in Google BigQuery (if it doesn’t exist already) In Google BigQuery, we’ll modify the …
How to stream into Google BigQuery from an Amazon Athena query Read More »
BigQuery supports User Defined Functions written in SQL or Javascript. This is such a nice feature since you are effectively freed from SQL limitations. Or if a built in function doesn’t exist or isn’t serving your purposes, you can simply create your own using Javascript and use it inside of your SQL queries or views! …
BigQuery is the goal. The promised land. It is a marvel of engineering and features. Performance and usability are truly impressive. Just think, being able to run cloud data warehousing, ad hoc exploratory analysis AND machine learning! All this from one platform! Incredible. And then Google goes and throws in TensorFlow as well! Mind = blown! 🙂 …