Cloudera Data Platform Engineer

We are seeking a talented Cloudera Data Platform Engineer to become a vital part of our innovative team. The right candidate will possess practical experience with Cloudera Data Platform components including HDFS, YARN, HIVE, Spark, Impala, Ranger, as well as a solid understanding of operating systems, security, and networking. Your role will encompass monitoring, troubleshooting, and optimizing big data environments by utilizing advanced tools and automation scripts.

Key Responsibilities:

• Cloudera Data Platform Management: Oversee and troubleshoot various components of the Cloudera Data Platform, specifically at least three from the following: HDFS, YARN, HIVE, Spark, Impala, Ranger.
• Safeguard the security and integrity of data within the platform.
• Enhance performance and resource utilization throughout the data ecosystem.
• Monitoring and Troubleshooting: Employ monitoring tools such as Cloudera Manager, Zabbix, Grafana, Splunk, and SyslogNG for proactive system oversight and incident resolution.
• Conduct root cause analysis and implement corrective measures to guarantee high availability and reliability of data systems.
• Automation and Scripting: Create and maintain automation scripts using bash, Python, or shell scripting to optimize operational tasks.
• Deploy automated solutions for system provisioning, monitoring, and maintenance.
• Middleware and Integration: Work collaboratively with middleware applications like Informatica and Denodo to facilitate smooth data integration and processing.
• Ensure compatibility and integration with other enterprise systems.
• Cloud Technology Exposure (Optional): Engage with cloud technologies (AWS, Azure) for data storage, processing, and migration as required.
• Partner with cloud architects to enhance data solutions in hybrid cloud environments.

Requirements:

• Technical Skills: Demonstrated experience with a minimum of three components of the Cloudera Data Platform: HDFS, YARN, HIVE, Spark, Impala, Ranger.
• Proficiency with monitoring tools such as Cloudera Manager, Zabbix, Grafana, Splunk, and SyslogNG.
• Strong capabilities in scripting languages including bash, Python, or shell scripting for automation and process enhancement.
• Familiarity with middleware applications such as Informatica and Denodo.
• Basic knowledge of operating systems, security, and network configurations.
• Experience: 5+ years in managing and troubleshooting Cloudera Data Platform environments.
• Experience in monitoring and incident management utilizing advanced monitoring tools.
• Understanding of cloud technologies (AWS, Azure) is advantageous.
• Soft Skills: Strong problem-solving and analytical abilities.
• Excellent communication and collaboration skills, capable of working efficiently in a cross-functional team setting.
• Ability to juggle multiple tasks and prioritize effectively in a fast-paced setting.

Preferred Qualifications:

• Certification in Cloudera Data Platform or related big data technologies.
• Experience with cloud technologies (AWS, Azure) for data storage and processing.
• Familiarity with big data frameworks and ecosystems.