-
Notifications
You must be signed in to change notification settings - Fork 34
Description
I tried to find a reverse proxy for hadoop like spark reverse proxy to redirect the inner links of the nodemanager, but unfortunately there isn't an official one, here is a link to a discussion of a similar problem helm/charts#13671
I can change the nodeID of the node http address manually by changing the hostname of the container to trydev2.activeeon.com for example and I get trydev2.activeeon.com:8042 as address, but there is an issue with https proxy.
There is a Web Application Proxy for version 3.x, and we have 2.x https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/WebApplicationProxy.html but in the documentation they said it's for security reasons only, not a reverse proxy like spark.
I've built a docker version with hadoop 3.3.1, and I run it with the workflow yarn, but I didn't find the right configuration to run the Web Application Proxy yet.