TechBrothersIT
TechBrothersIT
  • Видео 1 913
  • Просмотров 29 466 063
How to read Multiple CSV files from GCS Bucket in BigQuery by using External Table
In this video, we will learn how to read multiple CSV files from a Google Cloud Storage (GCS) bucket in BigQuery by using an external table. BigQuery is a powerful tool that allows you to access, analyze, visualize, and share billions of rows of data from your spreadsheet with Connected Sheets, the new BigQuery data connector.
To get started, you need to meet all of the following requirements: Access to the Google Cloud platform, BigQuery access, and a project with billing setup in BigQuery. Once you have met these requirements, you can create an external table in BigQuery that references the CSV files in your GCS bucket. You can then query the external table as if it were a native BigQuer...
Просмотров: 1 035

Видео

How to read Multiple Google Sheets from Google Spreadsheet in BigQuery | BigQuery External Table
Просмотров 5659 месяцев назад
In this video, we will learn how to read multiple Google Sheets from a Google Spreadsheet in BigQuery. BigQuery is a powerful tool that allows you to access, analyze, visualize, and share billions of rows of data from your spreadsheet with Connected Sheets, the new BigQuery data connector. To get started, you need to meet all of the following requirements: Access to the Google Cloud Platform, B...
How to read data from Google Sheet Using Big Query | Big Query External Table
Просмотров 84210 месяцев назад
In this video, we will learn how to read data from Google Sheets using Big Query. Big Query is a powerful tool that allows you to access, analyze, visualize, and share billions of rows of data from your spreadsheet with Connected Sheets, the new BigQuery data connector. To get started, you need to meet all of the following requirements: Access to the Google Cloud Platform, BigQuery access, and ...
How to upgrade GCP Postgresql from old version to new version by using Database Migration DMS in GCP
Просмотров 44111 месяцев назад
In this tutorial, we will learn how to upgrade Google Cloud Platform (GCP) PostgreSQL from an old version to a new version by using Database Migration Service (DMS) in GCP. We will start by discussing the importance of upgrading your database and the benefits of using DMS. Then, we will walk through the steps required to upgrade your PostgreSQL instance in-place using DMS. We will cover how to ...
How to Get the List of all Files with Size,Modified and Path from GCS Bucket and Load into BigQuery
Просмотров 52411 месяцев назад
In this video, you will learn how to get the list of all files with their size, modified date, and path from a Google Cloud Storage (GCS) bucket and load them into BigQuery. We will guide you through the process step by step, starting with setting up the necessary permissions and credentials for accessing GCS and BigQuery. By the end of this video, you will have a clear understanding of how to ...
How to use Bing AI to write SQL Server Queries as SQL Server Developer or SQL Server DBA
Просмотров 1,5 тыс.11 месяцев назад
In this video, you will learn how to use Bing AI to write SQL Server queries as a SQL Server Developer or SQL Server DBA. We will introduce you to some of the most popular AI-powered SQL query builders, including AI2sql and AirOps. You will learn how to use these tools to write efficient, error-free SQL queries without knowing SQL. You will learn how to optimize your queries by selecting the ri...
How to Read Data from GCS Google Cloud Storage Bucket to Azure Blob Storage | Azure Data Factory
Просмотров 85611 месяцев назад
In this video, we will explore how to read data from a Google Cloud Storage (GCS) bucket and transfer it to Azure Blob Storage using Azure Data Factory. In this video tutorial, we'll walk you through the step-by-step process of setting up the necessary authorization credentials and copy data from GCS to Azure Blob Storage. We'll also cover any differences in bucket and object naming rules betwe...
How to Read the Data from BiqQuery Table and Write to CSV File in Blob Storage | Azure Data Factory
Просмотров 1,7 тыс.11 месяцев назад
In this tutorial, you will learn how to extract data from a BigQuery table and save it as a CSV file in Azure Blob Storage using Azure Data Factory. The video will guide you through the process step-by-step, covering the necessary configurations and settings. The tutorial will cover the following topics: Setting up Azure Data Factory and connecting it to your BigQuery project. Creating a pipeli...
How to Activate and Deactivate Activities in Azure Data Factory Step-by-Step Tutorial-ADF Tutorial
Просмотров 1 тыс.11 месяцев назад
How to Activate and Deactivate Activities in Azure Data Factory | Azure Data Factory Tutorial 2023, in this video we are going to learn How to Activate and Deactivate Activities in Azure Data Factory, Azure Data Factory Step by Step - ADF Tutorial 2023 - ADF Tutorial 2023 Step by Step ADF Tutorial - Azure Data Factory Tutorial 2023. Azure Data Factory Tutorial for Beginners Azure Data Factory T...
How to find out Who has created the GCP project in Google Cloud Platform
Просмотров 2,8 тыс.Год назад
In this video, I will show you how to find out who has created a GCP project in Google Cloud Platform. A GCP project is a logical collection of your resources in GCP, like a subscription in Azurelearn.microsoft.com/en-us/azure/active-directory/cloud-infrastructure-entitlement-management/onboard-gcp. You can use the Google Cloud console, the gcloud command-line tool, or the Cloud Resource Manage...
Unroll Multiple Arrays from JSON File in a Single Flatten Step in Azure Data Factory | ADF Tutorial
Просмотров 5 тыс.Год назад
Unroll Multiple Arrays in a Single Flatten Step in Azure Data Factory | ADF Tutorial 2023, in this video we are going to learn How to Unroll Multiple Arrays in a Single Flatten Step in Azure Data Factory | ADF Tutorial 2023, Azure Data Factory Step by Step - ADF Tutorial 2023 - ADF Tutorial 2023 Step by Step ADF Tutorial - Azure Data Factory Tutorial 2023. Video Link: ruclips.net/video/zosj9UTx...
SQL Queries and Google BARD AI -Testing Bard for SQL Queries, ADF and Python Artificial Intelligence
Просмотров 1,4 тыс.Год назад
In this video, I will be experimenting with Bard, a large language model from Google AI. Bard is trained on a massive dataset of text and code, and can generate text, translate languages, write different kinds of creative content, and answer your questions in an informative way. In this video, I will be using Bard to experiment with SQL queries, Python, and Azure Data Factory. I will be using B...
How to perform CDC from PostgreSQL to Big Query by using DataStream in Google Cloud Platform
Просмотров 3,7 тыс.Год назад
How to perform CDC from PostgreSQL to Big Query by using DataStream in Google Cloud Platform | Google Cloud Platform Tutorial 2023, in this video we are going to learn How to perform CDC from PostgreSQL to Big Query by using DataStream in Google Cloud Platform| Google Cloud Platform SQL Tutorial 2023, Google Cloud Platform Step by Step - GCP Tutorial 2023 - GCP Tutorial 2023 Step by Step - Goog...
Set Pipeline Return Value in Azure Data Factory-How to Pass Values between Two ADF Pipelines
Просмотров 4,7 тыс.Год назад
Set Pipeline Return Value in Azure Data Factory How to Pass Values between Two ADF Pipelines | Azure Data Factory Tutorial 2023, in this video we are going to learnSet Pipeline Return Value in Azure Data Factory How to Pass Values between Two ADF Pipelines | Azure Data Factory Tutorial | ADF New Features 2023 Azure Data Factory Tutorial | ADF Tutorial 2023, Azure Data Factory Step by Step - ADF...
How to Use White or Dark Theme in Azure Data Factory Studio | Azure Data Factory Tutorial 2023
Просмотров 372Год назад
How to Use White Azure or Dark Theme in Azure Data Factory Studio | Azure Data Factory Tutorial 2023, in this video we are going to learn How to Use White Azure or Dark Theme in Azure Data Factory Studio | Azure Data Factory Tutorial | ADF New Features 2023 Azure Data Factory Tutorial | ADF Tutorial 2023, Azure Data Factory Step by Step - ADF Tutorial 2022 - ADF Tutorial 2023 Step by Step ADF T...
How to use List or Container Monitoring View in Azure Data Factory Studio ADF Tutorial 2023
Просмотров 543Год назад
How to use List or Container Monitoring View in Azure Data Factory Studio ADF Tutorial 2023
How to upgrade GCP MySQL Instance by using Database Migration Service-Reduce GCP MySQL Instance Disk
Просмотров 1,1 тыс.Год назад
How to upgrade GCP MySQL Instance by using Database Migration Service-Reduce GCP MySQL Instance Disk
How to Connect MySQL Workbench or Heidi SQL to Google Cloud SQL Locally Using Cloud SQL Proxy
Просмотров 2,4 тыс.Год назад
How to Connect MySQL Workbench or Heidi SQL to Google Cloud SQL Locally Using Cloud SQL Proxy
How to Connect to BigQuery from Tableau by using GCP Service Account GCP Tutorial 2022
Просмотров 3,8 тыс.Год назад
How to Connect to BigQuery from Tableau by using GCP Service Account GCP Tutorial 2022
How to perform CDC from GCP MySQL Instance to BigQuery by using DataStream in Google Cloud Platform
Просмотров 3,4 тыс.Год назад
How to perform CDC from GCP MySQL Instance to BigQuery by using DataStream in Google Cloud Platform
How to Perform Cross Database Queries in PostgreSQL in GCP Cloud | GCP Cloud SQL Tutorial 2022
Просмотров 2,4 тыс.Год назад
How to Perform Cross Database Queries in PostgreSQL in GCP Cloud | GCP Cloud SQL Tutorial 2022
Cross database query between Google SQL instances PostgreSQL | GCP SQL Tutorial 2022
Просмотров 475Год назад
Cross database query between Google SQL instances PostgreSQL | GCP SQL Tutorial 2022
How to Stop GCP PostgreSQL from Logging Passwords in Clear Text in Logs GCP Cloud SQL Tutorial
Просмотров 361Год назад
How to Stop GCP PostgreSQL from Logging Passwords in Clear Text in Logs GCP Cloud SQL Tutorial
How to Perform In place Upgrade to GCP SQL Instance | Inplace Upgrade PostgreSQL 12 to PostgreSQL 14
Просмотров 1,1 тыс.Год назад
How to Perform In place Upgrade to GCP SQL Instance | Inplace Upgrade PostgreSQL 12 to PostgreSQL 14
How to use Cast Transformation in Data Flow Task | Azure Data Factory Tutorial 2022
Просмотров 1,2 тыс.Год назад
How to use Cast Transformation in Data Flow Task | Azure Data Factory Tutorial 2022
How to Drop User or Role in PostgreSQL Instance on Google Cloud Platform | GCP Tutorials 2022
Просмотров 676Год назад
How to Drop User or Role in PostgreSQL Instance on Google Cloud Platform | GCP Tutorials 2022
How to Check if Value Exists in Input Column | Contains Function & InStr Function in Data Flow | ADF
Просмотров 2,6 тыс.Год назад
How to Check if Value Exists in Input Column | Contains Function & InStr Function in Data Flow | ADF
How to Stop and Start SQL Instances on Schedule by using Cloud Schedule in GCP | GCP SQL Tutorial
Просмотров 1,6 тыс.Год назад
How to Stop and Start SQL Instances on Schedule by using Cloud Schedule in GCP | GCP SQL Tutorial
How to Schedule Maintenance with PostgreSQL pg cron Extension | Google Cloud Platform SQL Tutorial
Просмотров 2 тыс.Год назад
How to Schedule Maintenance with PostgreSQL pg cron Extension | Google Cloud Platform SQL Tutorial
How to Connect to GCP SQL Server Instance by using Private IP Configuration | GCP SQL Tutorial 2022
Просмотров 1,9 тыс.Год назад
How to Connect to GCP SQL Server Instance by using Private IP Configuration | GCP SQL Tutorial 2022

Комментарии

  • @faheemsatti8734
    @faheemsatti8734 Минуту назад

    great learning how to connect to azure sql server DB.Thanks much appreciated.

  • @diogopinheiro6530
    @diogopinheiro6530 4 часа назад

    Fucking goat!

  • @faheemsatti8734
    @faheemsatti8734 День назад

    sir great job explaining in simple ways and making so understandable.

  • @sathiyamoorthi9224
    @sathiyamoorthi9224 3 дня назад

    Hi , Nice explanation. Can you please share video by using merge statement for incremental load Thanks in Advance!

  • @sathiyamoorthi9224
    @sathiyamoorthi9224 3 дня назад

    Amazing

  • @shubhammanjalkar8591
    @shubhammanjalkar8591 7 дней назад

    Will it work if I have a csv file and one of the column has json value

  • @MuhammadUmar-y9b
    @MuhammadUmar-y9b 8 дней назад

    If I create a sql server in the Azure, does it not have a private IP by default ?

  • @yeseniay9333
    @yeseniay9333 9 дней назад

    Me funciono perfecto, muchas gracias.

  • @pawarsatish1525
    @pawarsatish1525 14 дней назад

    Hello sir Where I get confirmation it's my dump is completed or not Firstly I get confirmation last to the backup file ( Dump is Completed ) If you know other way plz reply

  • @RaviAvula-f7m
    @RaviAvula-f7m 15 дней назад

    What you explained???

  • @MOOLA7893
    @MOOLA7893 16 дней назад

    How to roll back from UAT to DEV in adf

  • @arvindvishwakarma7261
    @arvindvishwakarma7261 17 дней назад

    I have a logic in Synapse pipeline which has Output script parameter. I replicated exact same thing in ADF and it failed. Came to your video, set the option to 'Treat as NULL' and it started working. The Synapse pipeline didn't needed this change. I guess ADF does a check of Int32 data type to be not null while Synapse pipeline doesn't!

  • @shyamkumardhamode4475
    @shyamkumardhamode4475 17 дней назад

    How to pass parameters in api url using adf and fetch records for those parameters only

  • @marcolivierlacoste1364
    @marcolivierlacoste1364 19 дней назад

    thx man you are the best

  • @senseisawk
    @senseisawk 20 дней назад

    Hello your computer have virus please give 700 in robux yes?

  • @srinidhims4422
    @srinidhims4422 20 дней назад

    Good and Perfect! All these bookmarks actually work well when report is exported in Excel. Thanks!

  • @rodrigogamer-f9m
    @rodrigogamer-f9m 22 дня назад

    el mejor bideo de mierda me gsu t5ael pnje

  • @CloudSupport-o2p
    @CloudSupport-o2p 22 дня назад

    where can i find the url? receiving error. Video is awesome and saves time

  • @CloudSupport-o2p
    @CloudSupport-o2p 22 дня назад

    where can i find the url?

  • @shaijodavis4280
    @shaijodavis4280 24 дня назад

    Thanks

  • @willydonkeng339
    @willydonkeng339 24 дня назад

    i enjoyed every videos, its so useful, thanks TechBrothers

  • @katrinakc
    @katrinakc 27 дней назад

    Thanks for the tutorial. I have report date in the header which contain date today minus 1 day. Instead of @TimeStamp which is date today, is it possible to convert it minus 1 day?

  • @CloudSupport-o2p
    @CloudSupport-o2p 27 дней назад

    Video is awesome. Where can i find the url? Thanks in advance

  • @subhadeepdebroy
    @subhadeepdebroy 28 дней назад

    Kindly share the trigger one video link please, just got addicted by your videos

  • @Satheesh9491
    @Satheesh9491 28 дней назад

    super ..helpful,,

  • @alwinm5179
    @alwinm5179 29 дней назад

    Thanks for this video..I'm late here but good stuff😍

  • @el_apostata_sud
    @el_apostata_sud 29 дней назад

    man, thank you for including your live troubleshooting, is a great video keep it up!

  • @sharonvoosa8160
    @sharonvoosa8160 29 дней назад

    Thank you its working now!!

  • @zb470
    @zb470 Месяц назад

    This video was incredibly simple and solved a problem I've been struggling with in moments. Thank you for making it!

  • @joongninetrash
    @joongninetrash Месяц назад

    Thank you very much! You’re my hero

  • @nazariyivasyuk8028
    @nazariyivasyuk8028 Месяц назад

    holy crap you saved my friday evening! Billion of thanks to you man!!!

  • @vivekpanchal8403
    @vivekpanchal8403 Месяц назад

    i have given some tasks in company and i learned a lot from this playlist thank you for posting this. need to learn azure data factory please make a video on it.

  • @kiruthigavasu
    @kiruthigavasu Месяц назад

    Very well explained ty so much

  • @HelmanNgu
    @HelmanNgu Месяц назад

    This is very informative. Thanks for sharing.

  • @ramjeeyadav9728
    @ramjeeyadav9728 Месяц назад

    not able to lookup large Json and ADF fails, is there any alternative?

  • @AboveTheLost
    @AboveTheLost Месяц назад

    If only we could have more videos on RUclips like this that get straight to the point Thank you, 10/10 👍

  • @CherkanRiuom
    @CherkanRiuom Месяц назад

    Fast. Thank you.

  • @dannyokec
    @dannyokec Месяц назад

    Most practical course 😊

  • @JineshJain-x5j
    @JineshJain-x5j Месяц назад

    Bhai accents acha hai

  • @pradeepkgp899
    @pradeepkgp899 Месяц назад

    Hi bro can you make video how to encrypted the pgp file from blob to sftp

  • @Sathishkumar-zd9co
    @Sathishkumar-zd9co Месяц назад

    I do not have permission to use the bulk load Statement. Any alternate for this.. please help

  • @user-mo4vu5sw5u
    @user-mo4vu5sw5u Месяц назад

    Thanks bro

  • @vanditaggarwal2011
    @vanditaggarwal2011 Месяц назад

    In my case in the drop down (in destination) list of table or view is not appearing.

  • @ernestogarcia9489
    @ernestogarcia9489 Месяц назад

    do you know if setup SHIR as a proxy option only appears on creation? or we can get it somehow when editing??

  • @narensnaren
    @narensnaren Месяц назад

    can we connect with Cloud SQL Studio directly instead of using MS SQL server. am getting this error (Invalid database: the selected user may not have access to this database)

  • @nadunsamarasinghe5592
    @nadunsamarasinghe5592 Месяц назад

    Thanks a lot for all the tutorials you have shared hereby. I have implemented most of the case studies during our Data Migration process by leveraging these approaches in different activities which very much useful to fulfill most of the tasks smoothly. Just to have a scenario like how can populate data from SQL or Oracle table into specific Word Template which has 1 or multiple columns with tables which has predesigned and able to send the corresponding word file vie email to certain parities. If any possibility to build such scenario, please publish video tutorial regarding to the request. Thanks a lot. Keep it up. Great indeed..! 👍👍👍👍

  • @swapnilsonwane7871
    @swapnilsonwane7871 Месяц назад

    thanks

  • @ganavigowda1
    @ganavigowda1 Месяц назад

    Wow it's up straightforward explanation! Tysm for sharing your knowledge:)

  • @justvenkyy...3423
    @justvenkyy...3423 Месяц назад

    can you create videos on pyspark,databricks please

  • @mohamedmagdy6956
    @mohamedmagdy6956 Месяц назад

    Barak Allah Fek