CGI: Databricks

What is the Spark API to read in a parquet?

• spark.read.parquet('path')

• read.parquet('path')

• spark.read.csv('path')

• spark.read.json('path')

What do you call parameters in Databricks?

• parameters

• variables

• widgets

• set-parameters

How would you read Azure Key Vault/Secrets in Databricks?

• dbutils.secrets.get("<KeyvaultSecretScope>", "<SecretName>")

• fetch.secrets.get("<KeyvaultSecretScope>", "<SecretName>")

• retreive.secrets.get("<KeyvaultSecretScope>", "<SecretName>")

• dbutils.vault.get("<KeyvaultSecretScope>", "<SecretName>")

How can you switch a notebook cell from python to SQL dialect in Databricks?

• sql

• %sql

• *sql

• set-to-sql

Can you perform DML operations, such as update, deletes, and merge statement in Standard Spark without Delta Lake?

• True

• False

What Spark api would you use to create partitions in a Dataframe?

• partion

• partitionBy

• createPartion

• PartionBy

What option should you use to allow for schema drift when using overwrite mode?

• .option("overwriteSchema","true")

• .option("mergeSchema","true")

• .option("allowDrift","true")

• .option("overwriteSchemaDrift","true")

How can you show/display the schema of a Dataframe?

• df.printSchema()

• df.PrintSchema

• df.printSchema

• df.displaySchema()

How can you add a column to a Dataframe?

• withColumn

• addColumn

• appendColumn

• WithColumn

How can you drop a column in a Dataframe?

• df.remove('?')

• df.drop('?')

• df.Remove('?')

• df.Drop('?')