Apache Hadoop and Spark Quiz

Which of the following components is NOT a part of the Apache Hadoop ecosystem?

• Hive

• Pig

• ZooKeeper

• HBase

What is the default block size for HDFS in Apache Hadoop?

• 128 MB

• 64 MB

• 256 MB

• 512 MB

Which of the following is a benefit of using Apache Spark over Hadoop MapReduce?

• Lower cost

• In-memory processing

• More languages supported

• Easier to install

What is the maximum item size in Amazon DynamoDB?

• 400 KB

• 1 MB

• 200 KB

• 2 MB

Point out the correct statement.

• Spark enables Apache Hive users to run their unmodified queries much faster.

• Spark interoperates only with Hadoop.

• Spark is a popular data warehouse solution running on top of Hadoop.

• All of the above

Match the correct description of Apache Spark components and features:

• A feature where transformations in Spark are not evaluated until you trigger an action - Lazy execution

• A program that declares the transformation and action on the data RDDs - Driver

• An optimization framework allows Spark to automatically transform SQL queries by adding new optimizations to build a faster processing system - Catalyst framework

• An operation used to re-distribute data across multiple partitions. It runs an operation on all elements of all partitions - Shuffle

• Any node that runs the application code in the Spark cluster - Worker

When you increase the number of files stored in HDFS, the memory required by NameNode:

• Increases

• Decreases

• Remains unchanged

• May increase or decrease

Most NoSQL databases support automatic ________, meaning that you get high availability and disaster recovery.

• Processing

• Scalability

• Replication

• All of the above

Which of the following statements is TRUE of NoSQL databases?

• They don't support any Structured Query Language (SQL).

• They are useful for managing large sets of distributed data.

• They are the most commonly used databases today.

• They cannot be used in conjunction with relational databases.

In Amazon EMR, what is the function of an EMR Cluster?

• Data storage

• Data coordination

• Data processing

• Data encryption