Issue in starting node and resource manager in Apache Hadoop 3.2.0 with OpenJDK 11

Resolved ” Error occurred during initialization of boot layer java.lang.module.FindException: Module java.activation not found” while starting node and resource manager in Apache Hadoop 3.2.0 with OpenJDK 11.

It has been observed that after the successful installation and configuration of a single node cluster for Apache Hadoop 3.2.0 on Ubuntu 14.04 with OpenJDK 11 as a java runtime environment, ResourceManager daemon and NodeManager daemon always fails to start.

These daemons are belonged to YARN and holding the responsibilities to provide resource management and job scheduling/monitoring. These daemons have a dependency on activation-1.1.jar which is not included in the current release of OpenJDK 11. Also in the common lib directories of Apache Hadoop-3.2.0. The error can be resolved by manually copying or download the activation-1.1.jar from third party sources like http://www.java2s.com/Code/Jar/a/Downloadactivationjar.htm , older version of Hadoop or older version of JDK. This error will be wiped off when activation-1.1.jar accessible from hadoop-3.2.0/share/hadoop/common/lib/, hadoop-3.2.0/share/hadoop/yarn/lib/ and hadoop-3.2.0/share/hadoop/yarn/ by resourceManager daemon and nodeManager daemon while executing $ sbin/start-yarn.sh. Using web interface for the ResourceManager we can verify for successful start. By default it is available at http://localhost:8088/

Written by
Gautam Goswami    

Can be contacted for real time POC development and hands-on technical training. Also to develop/support any Hadoop related project. Email:- gautam@onlineguwahati.com. Gautam is a consultant as well as Educator. Prior to that, he worked as Sr. Technical Architect in multiple technologies and business domain. Currently, he is specializing in Big Data processing and analysis, Data lake creation, architecture etc. using HDFS. Besides, involved in HDFS maintenance and loading of multiple types of data from different sources, Design and development of real time use case development on client/customer demands to demonstrate how data can be leveraged for business transformation, profitability etc. He is passionate about sharing knowledge through blogs, seminars, presentations etc. on various Big Data related technologies, methodologies, real time projects with their architecture /design, multiple procedure of huge volume data ingestion, basic data lake creation etc.