๐ŸŒฑ Infra/Hadoop_HDFS

[Hadoop 3.3] YARN ์„œ๋น„์Šค ํฌํŠธ ๋ฐ ์„ค์ • ์ดํ•ดํ•˜๊ณ  ๋„˜์–ด๊ฐ€๊ธฐ!

mini_world 2021. 4. 29. 19:30
๋ชฉ์ฐจ ์ ‘๊ธฐ

 

 

YARN ํ”„๋กœ์„ธ์Šค ํ™•์ธํ•˜๊ธฐ

 

1) Master Node

Master ๋…ธ๋“œ์—๋Š” YARN์ด ์šด์˜๋˜๊ธฐ ์œ„ํ•œ ๋ฆฌ์†Œ์Šค ๋งค๋‹ˆ์ € ํ”„๋กœ์„ธ์Šค๊ฐ€ ์šด์˜๋˜๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค.

 

2) Worker01~03 Node

Worker 01~ 03 ๋…ธ๋“œ์—๋Š” ๋ชจ๋‘ ๋…ธ๋“œ ๋งค๋‹ˆ์ € ํ”„๋กœ์„ธ์Šค๊ฐ€ ์šด์˜๋˜๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค.

 


YARN Service Port 

YARN ์˜ ์„œ๋น„์Šค ํฌํŠธ์™€ ํŒŒ๋ผ๋ฉ”ํ„ฐ๋ฅผ ํ™•์ธํ•˜๊ฒ ์Šต๋‹ˆ๋‹ค.

์„œ๋ฒ„ ํฌํŠธ ํ”„๋กœํ† ์ฝœ ํŒŒ๋ผ๋ฉ”ํ„ฐ ์„ค๋ช…
Master 8088 http yarn.resourcemanager.webapp.address ๋ฆฌ์†Œ์Šค ๋งค๋‹ˆ์ € ์›น UI
8030 http yarn.resourcemanager.scheduler.address ์Šค์ผ€์ค„๋Ÿฌ ์ธํ„ฐํŽ˜์ด์Šค
8031 http yarn.resourcemanager.resource-tracker.address YARN API 
8032 IPC yarn.resourcemanager.address YARN API 
8033 http yarn.resourcemanager.admin.address ๊ด€๋ฆฌ์ž ์ธํ„ฐํŽ˜์ด์Šค
Worker01~03 8040 IPC yarn.nodemanager.localizer.address ๋…ธ๋“œ๋งค๋‹ˆ์ € ๋กœ์ปฌ๋ผ์ด์ €
8042 http yarn.nodemanager.webapp.address ๋…ธ๋“œ๋งค๋‹ˆ์ € ์›น UI