Skip to main content

Home

Roles in the Hadoop environment

The Hadoop environment has three core components (HDFS, MapReduce, and YARN) that fall into the following roles. The Unravel migration report lists each server in the cluster and the roles associated with it.

  • Worker role: Contains the virtual machines in a Hadoop cluster. It stores the data and runs computations.

    [DATANODE, NODEMANAGER, HBASE_REGIONSERVER]

  • Client role: Loads data into the cluster.

    [
ACCUMULO_CLIENT,
AMS_MONITOR,
ATLAS_CLIENT,
FALCON_CLIENT,
HBASE_CLIENT,
HDFS_CLIENT,
HIVE_CLIENT,
HIVE_GATEWAY,
KERBEROS_CLIENT,
MAHOUT_CLIENT,
MAPREDUCE2_CLIENT,
OOZIE_CLIENT,
PIG_CLIENT,
SLIDER_CLIENT,
SOLR_CLIENT,
SPARK2_CLIENT,
SQOOP_CLIENT,
TEZ_CLIENT,
YARN_CLIENT,
]

  • Server role: Stores data in HDFS and oversees key operations, such as running parallel computations on the data using MapReduce.

    [
ACCUMULO_MASTER,
ACCUMULO_TSERVER,
AIRFLOW_SERVER,
AIRFLOW_WEB_SERVER,
AMS_COLLECTOR,
ATLAS_SERVER,
DRUID_OVERLORD,
DRUID_COORDINATOR,
DRUID_BROKER,
FALCON_SERVER,
HAWQ_MASTER,
HAWQ_STANDBYSERVER,
HBASE_MASTER,
PHOENIX_QUERY_SERVER,
NAMENODE,
SECONDARY_NAMENODE,
HIVE_SERVER,
HIVE_METASTORE,
WEBHCAT_SERVER,
KUDU_MASTER,
LOGSEARCH_SERVER,
MYSQL_SERVER,
OOZIE_SERVER,
RANGER_ADMIN,
HST_SERVER,
SOLR,
SPARK_JOBHISTORYSERVER,
SPARK2_JOBHISTORYSERVER,
SPARK2_THRIFTSERVER,
LIVY_SERVER,
SENTRY_SERVER,
SUPERSET,
STORM_UI_SERVER,
STORM_NIMBUS,
DRPC_SERVER,
SQOOP_SERVER,
APP_TIMELINE_SERVER,
YARN_HISTORY_SERVER,
RESOURCEMANAGER,
ZEPPELIN_MASTER,
ZOOKEEPER_SERVER,
]
In this section: