AWS Certified Data Analytics Specialty 2021 – Hands-On - Glue, Hive, and ETL

The video tutorial covers the integration of Hive with AWS Glue, focusing on the Glue Data Catalog and its role as a metadata store. It explains Glue ETL's capabilities, including automatic code generation for data transformation using Apache Spark, and discusses dynamic frames and various data transformations. The tutorial also highlights the Resolve Choice method for handling ambiguities in dynamic frames.

What is the primary purpose of HiveQL in the context of AWS Glue?

• To schedule ETL jobs

• To encrypt data at rest

• To issue SQL-like queries on data in EMR

• To manage server configurations

How does Glue ETL enhance data transformation processes?

• By automatically generating transformation code

• By providing a command-line interface

• By offering manual data entry options

• By disabling encryption

How does Glue ETL handle encryption?

• Both at rest and in transit

• Only in transit

• It does not support encryption

• Only at rest

What is a dynamic frame in Glue ETL?

• A static data structure

• A collection of dynamic records with schema

• A type of database

• A manual data entry form

Which transformation is used to remove empty data in Glue ETL?

• Drop fields

• Join

• Filter

• Map

What is the purpose of the Find Matches ML transformation?

• To convert data formats

• To identify duplicate records

• To encrypt data

• To schedule jobs

Which formats can Glue ETL automatically convert between?

• HTML, PDF, DOCX

• CSV, JSON, Avro, Parquet, ORC, XML

• MP3, WAV, FLAC

• JPEG, PNG, GIF

What does the Resolve Choice method in Glue ETL address?

• Data encryption

• Ambiguities in dynamic frames

• Job scheduling

• Data format conversion

Which option in Resolve Choice creates a new column for each unique type?

• Cast

• Make_struct

• Make_calls

• Project

What is the function of the 'cast' option in Resolve Choice?

• To create a new column for each type

• To force instances to a specific type

• To project every type to a given type

• To create a structure within records