Job Description:
We are looking for an experienced Hadoop Administrator with expertise in Spark, Hive, and managing largescale Hadoop ecosystems. The ideal candidate will ensure the performance, availability, and security of Hadoop clusters while supporting data-driven initiatives.
Responsibilities:
- Install, configure, and maintain Hadoop clusters (HDFS, YARN, Spark, Hive).
- Monitor cluster performance and ensure optimization.
- Troubleshoot and resolve issues, ensuring high availability.
- Automate tasks using shell scripts and manage data governance.
- Implement security, upgrades, backups, and disaster recovery processes.
Requirements:
- 4+ years of Hadoop administration experience.
- Proficiency in Spark, Hive, and Linux systems.
- Strong troubleshooting and performance tuning skills.
- Expertise in HDFS, YARN, MapReduce, ZooKeeper, Oozie, and HBase.
- Experience with Linux systems and shell scripting.
Educational Qualification:
- Bachelor’s/Master’s degree in computer science, Information Technology, or a related field.