Azure Databricks - Kantar Day 3

Which among the following Databricks platform tools helps in learning how to orchestrate data processing, machine learning, and data analysis flows?

• Libraries

• Structured streaming

• Workflows

In which phase of ETL operation is Azure Databricks used?

• Store

• Prep and Train

• Model and serve

A job cluster is a shared cluster that is manually started and terminated and can be shared by multiple users and jobs. True or False?

• True

• False

Fill the missing step in the sequence of Azure Databricks Workflow: Clickstream Data ->_____ -> sessionized data

• Delta live table pipeline

• Extract features

• Train Model

Which among the following is a definition of 'Delta Live Table'?

• Cloud object storage and block storage volumes for persistent and ephemeral data storage.

• Data pipelines for ingestion and transformation with Databricks Delta Live Tables.

• Distributed file system mounted into a Databricks workspace and available on Databricks clusters

Which among the following does a DLT pipeline update NOT perform?

• It starts a cluster with the correct configuration.

• It creates or updates tables and views with the most recent data available.

• It creates data visualization using Dashboard feature.

VACUUM command removes all files from the table directory that are managed by Delta. True or False?

• False

• True

Fill in the missing command.

streamingInputDF = (

spark.

readStream .schema(jsonSchema) # Set the schema of the JSON data

.___________('maxFilesPerTrigger', 1) # Treat a sequence of files as a stream by picking one file at a time

.json(inputPath)

)

• option

• with

• versionAs

What streaming sources and sinks does Azure Databricks support?

• Delta lake

• Auto Loader

• Apache Kafka connector

What is Databricks runtime?

• A dedicated cluster for individual job tasks.

• A set of software artifacts that run on the clusters of machines managed by Databricks.

• A table with extra support for streaming or incremental data processing.