Parallel and Distributed Computing Quiz

Understanding parallelism involves:

• Reducing computational tasks

• Executing tasks sequentially

• Simultaneously processing tasks

• Minimizing task complexity

In shared memory vs. distributed memory architectures, shared memory systems:

• Have separate memory spaces for each processor

• Allow multiple processors to access a common memory space

• Execute different instructions on various data

• Distribute tasks across processors

Data parallelism involves:

• Executing different instructions on various data

• Distributing data across multiple processors

• Simultaneously processing tasks

• Sequential execution of tasks

Development of parallel supercomputers is essential for:

• Minimizing energy consumption

• Efficiently handling big data

• Sequential execution of tasks

• Simultaneously solving complex problems

Vector processing is characterized by:

• A single instruction stream for multiple data streams

• Multiple instruction streams for single data streams

• Independent execution of tasks

• Sequential processing

MPI (Message Passing Interface) is commonly used for:

• Task parallelism

• Data parallelism

• Shared memory systems

• Distributed memory systems

Parallel programming languages like OpenMP are primarily designed for:

• Shared memory systems

• Distributed memory systems

• Vector processing

• Flynn's Taxonomy

The transition from SIMD to MIMD architectures allows:

• Sequential execution of instructions

• Different processors to execute the same instruction

• Multiple processors to execute different instructions

• Parallel execution of tasks without coordination

Massively parallel processing (MPP) systems involve:

• A single processing unit

• Multiple processors working independently

• Shared memory architecture

• Sequential execution

Energy considerations in modern computing involve:

• Reducing computational power

• Evaluating the environmental impact

• Maximizing data distribution

• Minimizing energy consumption while maintaining performance