Is there a way to get a list of Hadoop cluster machines from one of the data nodes?

Question

I have access to a data node in a Hadoop cluster, and I'd like to find out the identity of the name nodes for the same cluster. Is there a way to do this?

score 1 · Answer 1 · answered Mar 15 '11 at 09:49

1

You can read the configuration file of the datanode, specifically hdfs-site.xml. It will list the namenode that the datanode will try to connect to.

answered Mar 15 '11 at 09:49

score 1 · Answer 2 · edited Jun 08 '16 at 13:13

1

use below script

#!/bin/bash
date >> list_of_datanodes
bin/hadoop dfsadmin -report > dfsstat.txt
cat dfsstat.txt |grep 'Datanodes available' --color >> list_of_datanodes
cat dfsstat.txt |grep 'Name:' --color >> list_of_datanodes
rm -rf dfsstat.txt

edited Jun 08 '16 at 13:13

chicks

3,639
10
26
36

answered Jun 08 '16 at 10:39

Sujit Kadam

11
1

1

Recursively deleting the `dfsstat.txt` files seems like overkill. – chicks Jun 08 '16 at 13:14

Is there a way to get a list of Hadoop cluster machines from one of the data nodes?

2 Answers2