Fritz LarcoforSling Data Blogsling.hashnode.net·Nov 11, 2022Exporting Data from BigQuery to Snowflake, the Easy WayCloud Data Warehouses In the past few years, we've seen a rapid growth in the usage of cloud data warehouses (as well as the "warehouse-first" paradigm). Two popular cloud DWH platforms are BigQuery and Snowflake. Check out the chart below to see the...Discuss·1 like·221 readssnowflake
Fritz LarcoforSling Data Blogsling.hashnode.net·Nov 23, 2022Exporting data from BigTable and Loading it into your Data WarehouseBigTable You may not have heard about Google’s BigTable but it is a thriving NoSQL database offering from the juggernaut, allowing exceptional read/write performance when properly tuned. According to Google Cloud’s own blog post, BigTable manages ove...Discuss·1 like·48 readsbigtable
Fritz LarcoforSling Data Blogsling.hashnode.net·Dec 12, 2022How to Import JSON files From AWS S3 into BigQueryBigQuery & Your S3 Files BigQuery is a cloud-based, fully managed, serverless data warehouse that enables you to analyze large and complex datasets using SQL queries. It is a scalable, highly-performant, and cost-effective solution that can handle pe...Discuss·1 like·54 readsLoading JSON Files Into your Databasebigquery
Alexandra Skidansashaxenoss.hashnode.net·Apr 25, 2023BigQuery/Redshift/ClickHouse: How to choose the best database management system for AdTech projectsAdTech products’ success rates are predicated on the efficient collection and use of big data — but more importantly, on how it is stored, processed, and analyzed. Advertising platforms must deliver multi-dimensional insights on real-time and histori...DiscussAd Tech Market
Anil VaitlaforNOCD Tech Blognocd.hashnode.net·Apr 13, 2023Get your bigquery data into rillYou need a CSV or Parquet file to load into Rill (https://docs.rilldata.com/using-rill/import-data). Here are steps and caveats you can follow to get a dataset in Bigquery into that format and processed with Rill. Much of the guidance here is from th...Discuss·76 readsbigquery
Constantin Lungucnstlungu.hashnode.net·Apr 10, 2023Recursive CTEs in BigQueryIn this practical BigQuery exercise, we’re going to look at what are recursive CTEs and how can they be useful in our tool set. What is a CTE? First of all, what is a CTE? Well, it stands for Common Table Expression and is essentially a named query t...Discuss·73 readsPractical BigQuerySQL
Constantin Lungucnstlungu.hashnode.net·Apr 2, 2023Using BigQuery Time TravelIn this practical BigQuery exercise, we’re going to look at BigQuery Time Travel and see how it can help us when working with data. It’s not as powerful as Marty McFly’s DeLorean in Back to the Future (nobody knows what your future data will look lik...Discuss·34 readsPractical BigQuerybigquery
Philips Rhogunsrhoguns.hashnode.net·Apr 1, 2023Using BigQuery Omni with AWSIntroduction As businesses increasingly adopt multi-cloud strategies, it's becoming more important for cloud providers to work together seamlessly. In this context, BigQuery Omni, a multi-cloud analytics solution from Google Cloud, offers an interest...DiscussGoogle Cloud Platform
Constantin Lungucnstlungu.hashnode.net·Mar 26, 2023Rounding Timestamps in BigQueryHave you ever encountered a situation where you would need to round a timestamp to the nearest second, 5 seconds or minute? While rounding a number is trivial, it's a little bit less straightforward when dealing with timestamps. Let's consider the fo...DiscussPractical BigQuerybigquery
Constantin Lungucnstlungu.hashnode.net·Mar 20, 2023Generating a compact temporal table in BigQueryIn one of my previous posts, we discussed what temporal tables are and how to join multiple such tables into a single one. In this short practical exercise, we’re going to look at how we can generate a compact temporary table given possible redundant...DiscussPractical BigQuerySQL
Smit Thakkarthefellowcoder.hashnode.net·Mar 17, 2023Regex Operations in BigQueryBigQuery is taking the analytics industry by storm. One of the most important use cases is to extract and transform parts of a string. Below are some of the powerful constructs provided by BigQuery. BigQuery provides the following constructs for rege...Discuss·48 readsbigquery
Jenna's Runbooksjennasrunbooks.hashnode.net·Mar 14, 2023GCP BigQuery Expression | Monthly Invoice Based on LabelsIn this GCP BigQuery expression, I show how you can retrieve the monthly invoice data on all resources in a specified project based on assigned label values. This method of capturing cloud spend can be applied after you've enabled the Cloud Billing d...Discuss·29 readsGCPgoogle cloud
Bella Ekebellaeke.hashnode.net·Mar 14, 2023Introduction to BigQuery MLIntroduction BigQuery ML is a powerful tool that helps you create and execute machine learning models directly within Google BigQuery. This means you can train and deploy machine learning models on massive datasets without having to move the data to ...Discussbigquery
