Skip to main content

Apache Spark - Could not locate executable null\bin\winutils.exe in the Hadoop binaries

I am passionate about BigData technologies. I am exploring the Apache Spark these days. I found IBM's BigDataUniversity the best place to learn the trending BigData technologies. I wrote my first Apache Spark application but when I ran it, I encountered the following error

Could not locate executable null\bin\winutils.exe 

in the Hadoop binaries


I searched for it over the internet and found variously detailed solutions. In this post, I am listing down the steps in an easy way to explain how to fix this issue.

Step 1 
Download the winutils.exe from the following link

winutils 32-bit     (depends on your installed Windows version)
winutils 64-bit     (depends on your installed Windows version)

Step 2 
Create the following two directories in C or any other drive
  •  c:\hadoop\bin
  •  C:\tmp\hive
Step 3
Place the downloaded winutils.exe inside the c:\hadoop\bin folder

Step 4 
Set the following environmental variable

Name : HADOOP_HOME 
Value : C:\HADOOP
Step 5
Add the %HADOOP_HOME%\bin  to the PATH variable



Step 6  
Open the command prompt as administrator and run the following commands
 >winutils.exe chmod -R 777 c:\tmp\hive



Cheers, you are done.






Comments


  1. Resourceful content, highly beneficial. Click this link for further details: Digital Marketing Company in Chennai

    ReplyDelete

Post a Comment