YARN ARCHITECTURE

Jeeva-AWSLabsJourney
1 min readOct 17, 2023

--

Explained in layman’s language,

Step 1: The resource manager will take the job from the client.

Step 2: The resource manager will ask the node manager to create a job.

Step 3: Then some of the node managers will try to return a unique ID.

Step 4: This unique ID would be termed as the app master as shown in the above figure.

Step 5: As the results are distributed the app master will try to create a container, which will contain the main task.

Step 6: Before Step 5 the app master will ask the resource manager for the resources.

Step 7: The container will be created after the app master occupies resources from the resource manager.

Step 8:The container is a virtual space to execute the jobs.

Conclusion: Container →App Master →Node Manager →Resource Manager

Below Hadoop YARN Architecture Image explain the Container, Node and client Difference:

--

--

Jeeva-AWSLabsJourney
Jeeva-AWSLabsJourney

Written by Jeeva-AWSLabsJourney

Exploring AWS, cloud, Linux & DevOps. Your guide to navigating the digital realm. Join me on the journey of discovery

No responses yet