Searching for "MapReduce"

Q:

How does fault tolerance work in mapreduce?

Answer

In a mapreduce job the master pings each worker periodically. In case a worker does not respond to that system then the system is marked as failed. Even completed tasks are rescheduled because the output was stored in a in a local disk of a worker which failed. Hence mapreduce is able to handle large-scale failures easily by simply restarting a task. The master node always saves itself at checkpoints and in case of any failure it simply restarts from that checkpoint.

Report Error

View answer Workspace Report Error Discuss

Subject: Cloud Computing

Q:

How is mapreduce related to cloud computing?

Answer

The mapreduce framework contains most of the key architecture principles of cloud computing such as:


- Scale: The framework is able to expand itself in direct proportion to the number of machines available.


- Reliable: The framework is able to compensate for a lost node and restart the task on a different node.


- Affordable: A user can start small and over time can add more hardware.

Report Error

View answer Workspace Report Error Discuss

Subject: Cloud Computing

Q:

What do you understand by MapReduce?

Answer

MapReduce is a software framework that was created by Google. It`s prime focus was to aid in distributed computing, specifically large sets of data on a group of many computers. The frameworks took its inspiration from the map and reduce functions from functional programming.

Report Error

View answer Workspace Report Error Discuss

Subject: Cloud Computing