리뷰 Batch Load Data Into BigQuery개 | Google Cloud Skills Boost

Craig H. · 6년 초과 전에 리뷰됨

There was an issue using qwiklabs for Big query as it was not enabled.

Kanchana P. · 6년 초과 전에 리뷰됨

Too simple :/

Alexis K. · 6년 초과 전에 리뷰됨

Sunil B. · 6년 초과 전에 리뷰됨

okay. it would be great to review the initial dataset from Wikipedia

Laurent B. · 6년 초과 전에 리뷰됨

Daniel S. · 6년 초과 전에 리뷰됨

Daniel H. · 6년 초과 전에 리뷰됨

Hugo A. · 6년 초과 전에 리뷰됨

Thanks

Yandi S. · 6년 초과 전에 리뷰됨

Iain K. · 6년 초과 전에 리뷰됨

Samuel T. · 6년 초과 전에 리뷰됨

Simplistic

Christopher T. · 6년 초과 전에 리뷰됨

Mihail I. · 6년 초과 전에 리뷰됨

Alex H. · 6년 초과 전에 리뷰됨

John B. · 6년 초과 전에 리뷰됨

Welcome to Cloud Shell! Type "help" to get started. google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ wget https://dumps.wikimedia.org/other/pagecounts-raw/2016/2016-01/pagecounts-20160101-070000.gz --2017-12-02 17:30:16-- https://dumps.wikimedia.org/other/pagecounts-raw/2016/2016-01/pagecounts-20160101-070000.gz Resolving dumps.wikimedia.org (dumps.wikimedia.org)... 208.80.154.11, 2620:0:861:1:208:80:154:11 Connecting to dumps.wikimedia.org (dumps.wikimedia.org)|208.80.154.11|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 73747078 (70M) [application/octet-stream] Saving to: ‘pagecounts-20160101-070000.gz’ pagecounts-20160101-070000.gz 100%[==============================================================================================================================================================>] 70.33M 1.99MB/s in 37s 2017-12-02 17:30:53 (1.92 MB/s) - ‘pagecounts-20160101-070000.gz’ saved [73747078/73747078] google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " " \ --quote "" \ qwiklabs-gcp-27cb66854bc10d96:lab.pagecounts_20160108_11 \ pagecounts_20160101-070000.gz \ language,title,requests:integer,content_size:integer Welcome to BigQuery! This script will walk you through the process of initializing your .bigqueryrc configuration file. First, we need to set up your credentials if they do not already exist. Credential creation complete. Now we will select a default project. List of projects: # projectId friendlyName --- ------------------------------- ------------------------------- 1 qwiklabs-resources Qwiklabs Resources 2 qwiklabs-gcp-27cb66854bc10d96 qwiklabs-gcp-27cb66854bc10d96 Found multiple projects. Please enter a selection for which should be the default, or leave blank to not set a default. Enter a selection (1 - 2): 2 BigQuery configuration complete! Type "bq" to get started. Too many positional args, still have [' pagecounts_20160101-070000.gz', ' language,title,requests:integer,content_size:integer'] google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " " \ > --quote "" \ > YourProjectID:lab.pagecounts_20160108_11 \ > pagecounts-20160108-110000.gz \ > BigQuery error in load operation: Source file not found: pagecounts-20160108-110000.gz google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " "\ --quote ""\ qwiklabs-gcp-27cb66854bc10d96:lab.pagecounts_20160108_07 \ pagecounts-20160101-070000.gz \ language,title,requests:integer,content_size:integer BigQuery error in load operation: Field delimiter must be a single character, found:" --quote". google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " " \ --quote "" \ qwiklabs-gcp-27cb66854bc10d96:lab.pagecounts_20160108_07 \ pagecounts-20160101-070000.gz \ language,title,requests:integer,content_size:integer Too many positional args, still have [' pagecounts-20160101-070000.gz', ' language,title,requests:integer,content_size:integer'] google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " " \ --quote "" \ qwiklabs-gcp-27cb66854bc10d96:lab.pagecounts_20160108_07 \pagecounts-20160101-070000.gz \ language,title,requests:integer,content_size:integer Too many positional args, still have ['pagecounts-20160101-070000.gz', ' language,title,requests:integer,content_size:integer'] google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " " \ --quote "" \ qwiklabs-gcp-27cb66854bc10d96:lab.pagecounts_20160108_07 \pagecounts-20160101-070000.gz \language,title,requests:integer,content_size:integer Too many positional args, still have ['pagecounts-20160101-070000.gz', 'language,title,requests:integer,content_size:integer'] google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ wget https://dumps.wikimedia.org/other/pagecounts-raw/2016/2016-01/pagecounts-20160103-040000.gz --2017-12-02 17:48:03-- https://dumps.wikimedia.org/other/pagecounts-raw/2016/2016-01/pagecounts-20160103-040000.gz Resolving dumps.wikimedia.org (dumps.wikimedia.org)... 208.80.154.11, 2620:0:861:1:208:80:154:11

John C. · 6년 초과 전에 리뷰됨

Welcome to Cloud Shell! Type "help" to get started. google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ wget https://dumps.wikimedia.org/other/pagecounts-raw/2016/2016-01/pagecounts-20160101-070000.gz --2017-12-02 17:30:16-- https://dumps.wikimedia.org/other/pagecounts-raw/2016/2016-01/pagecounts-20160101-070000.gz Resolving dumps.wikimedia.org (dumps.wikimedia.org)... 208.80.154.11, 2620:0:861:1:208:80:154:11 Connecting to dumps.wikimedia.org (dumps.wikimedia.org)|208.80.154.11|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 73747078 (70M) [application/octet-stream] Saving to: ‘pagecounts-20160101-070000.gz’ pagecounts-20160101-070000.gz 100%[==============================================================================================================================================================>] 70.33M 1.99MB/s in 37s 2017-12-02 17:30:53 (1.92 MB/s) - ‘pagecounts-20160101-070000.gz’ saved [73747078/73747078] google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " " \ --quote "" \ qwiklabs-gcp-27cb66854bc10d96:lab.pagecounts_20160108_11 \ pagecounts_20160101-070000.gz \ language,title,requests:integer,content_size:integer Welcome to BigQuery! This script will walk you through the process of initializing your .bigqueryrc configuration file. First, we need to set up your credentials if they do not already exist. Credential creation complete. Now we will select a default project. List of projects: # projectId friendlyName --- ------------------------------- ------------------------------- 1 qwiklabs-resources Qwiklabs Resources 2 qwiklabs-gcp-27cb66854bc10d96 qwiklabs-gcp-27cb66854bc10d96 Found multiple projects. Please enter a selection for which should be the default, or leave blank to not set a default. Enter a selection (1 - 2): 2 BigQuery configuration complete! Type "bq" to get started. Too many positional args, still have [' pagecounts_20160101-070000.gz', ' language,title,requests:integer,content_size:integer'] google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " " \ > --quote "" \ > YourProjectID:lab.pagecounts_20160108_11 \ > pagecounts-20160108-110000.gz \ > BigQuery error in load operation: Source file not found: pagecounts-20160108-110000.gz google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " "\ --quote ""\ qwiklabs-gcp-27cb66854bc10d96:lab.pagecounts_20160108_07 \ pagecounts-20160101-070000.gz \ language,title,requests:integer,content_size:integer BigQuery error in load operation: Field delimiter must be a single character, found:" --quote". google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " " \ --quote "" \ qwiklabs-gcp-27cb66854bc10d96:lab.pagecounts_20160108_07 \ pagecounts-20160101-070000.gz \ language,title,requests:integer,content_size:integer Too many positional args, still have [' pagecounts-20160101-070000.gz', ' language,title,requests:integer,content_size:integer'] google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " " \ --quote "" \ qwiklabs-gcp-27cb66854bc10d96:lab.pagecounts_20160108_07 \pagecounts-20160101-070000.gz \ language,title,requests:integer,content_size:integer Too many positional args, still have ['pagecounts-20160101-070000.gz', ' language,title,requests:integer,content_size:integer'] google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ bq load -F " " \ --quote "" \ qwiklabs-gcp-27cb66854bc10d96:lab.pagecounts_20160108_07 \pagecounts-20160101-070000.gz \language,title,requests:integer,content_size:integer Too many positional args, still have ['pagecounts-20160101-070000.gz', 'language,title,requests:integer,content_size:integer'] google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ google151245_student@qwiklabs-gcp-27cb66854bc10d96:~$ wget https://dumps.wikimedia.org/other/pagecounts-raw/2016/2016-01/pagecounts-20160103-040000.gz --2017-12-02 17:48:03-- https://dumps.wikimedia.org/other/pagecounts-raw/2016/2016-01/pagecounts-20160103-040000.gz Resolving dumps.wikimedia.org (dumps.wikimedia.org)... 208.80.154.11, 2620:0:861:1:208:80:154:11

John C. · 6년 초과 전에 리뷰됨

Brian B. · 6년 초과 전에 리뷰됨

Cyrille H. · 6년 초과 전에 리뷰됨

Ricquan W. · 6년 초과 전에 리뷰됨

Takes 10 minutes to upload the file.

Ben A. · 6년 초과 전에 리뷰됨

Ricquan W. · 6년 초과 전에 리뷰됨

Christian M. · 6년 초과 전에 리뷰됨

This lab doesn't teach much more then where the buttons are. An explanation of the command of loading the data into BQ would have been a good start.

Jonathan Y. · 6년 초과 전에 리뷰됨

Greg F. · 6년 초과 전에 리뷰됨