Skip to content

Inner portal links (yarn nodemangers links) YARN UI Reverse Proxy #1005

@rachid-drago

Description

@rachid-drago

I tried to find a reverse proxy for hadoop like spark reverse proxy to redirect the inner links of the nodemanager, but unfortunately there isn't an official one, here is a link to a discussion of a similar problem helm/charts#13671

I can change the nodeID of the node http address manually by changing the hostname of the container to trydev2.activeeon.com for example and I get trydev2.activeeon.com:8042 as address, but there is an issue with https proxy.

There is a Web Application Proxy for version 3.x, and we have 2.x https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/WebApplicationProxy.html but in the documentation they said it's for security reasons only, not a reverse proxy like spark.
I've built a docker version with hadoop 3.3.1, and I run it with the workflow yarn, but I didn't find the right configuration to run the Web Application Proxy yet.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions