Data Engineer - Lead

Role Responsibilities:

1. Develop and optimize data pipelines using Hadoop, MapReduce, Hive, and Spark.
2. Write and debug programs in Java/Scala and manage multithreaded applications.
3. Work with BI tools like AWS QuickSight and build dashboards/metrics.
4. Optimize memory and performance, leveraging caching architectures like Redis.

Job Requirements:

1. Proficient in programming languages like Java/Scala and scripting languages (Python, Bash).
2. Experience with NoSQL databases like HBase, Cassandra.
3. Knowledge of cloud technologies, particularly AWS S3.
4. Bachelor's or Master's degree in relevant field.