Data Engineer using Python

Seeking a skilled Data Engineer to design, develop, and optimize data pipelines and systems using cutting-edge technologies.

Key Responsibilities:

• Build and maintain scalable data pipelines with tools like Airflow.
• Develop big data solutions using Spark, Hadoop, and ETL processes.
• Design data models and manage storage in Redshift, BigQuery, and cloud platforms (AWS, Azure).
• Write efficient Python, Java, and SQL code for data processing and automation.
• Collaborate with stakeholders to deliver robust data solutions.
• Ensure efficient data ingestion from various sources into SQL databases.
• Troubleshoot complex issues related to data quality, performance, and security.
• Design, develop, and maintain large-scale data pipelines using Python, Spark, and Pandas.

Qualifications:

• Bachelor's degree in a relevant field.
• 3+ years of experience in data engineering.
• Proficiency in Python, Java, ETL tools, and big data technologies.
• Expertise in SQL, NoSQL, and cloud-based data solutions.

Preferred:

• Knowledge of Docker, Kubernetes, CI/CD, and data security.