Skip to content

Conversation

@jackgene
Copy link
Contributor

The namenode RPC port (dfs.namenode.rpc-address....) is currently hardcoded to 9000, and the resourcemanager webapp port (yarn.resourcemanager.webapp.address...) hardcoded to 9032, which isn't typical, and requires users to update the port numbers in the Python scripts.

This update allows the ports to be defined in settings.py.

@jackgene
Copy link
Contributor Author

As suggested here:
#3 (comment)

@vaxvms
Copy link
Contributor

vaxvms commented Jan 17, 2017

+1 There is several patches flying around about this functionality, it would be nice to get it in the base repo.

For instance, there is also #13 which as more feature (you can configure elasticsearch, namenode and resourcemanager hosts)

@danielcweeks
Copy link
Contributor

Yes, this looks good.

The old ports were an artifact of EMR's port configurations, but even they have moved away from those and gone with the apache defaults.

Do you just want to change the defaults in the settings.py to be the apache defaults?

@jackgene
Copy link
Contributor Author

Done. namenode rpc port set to 8020, resourcemanager webapp port set to 8088 by default.

@danielcweeks danielcweeks merged commit a21928e into Netflix:master Jan 18, 2017
@danielcweeks
Copy link
Contributor

Thanks @jackgene !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants