Data Engineer

Role Overview 1 We are looking for a Data Engineer with robust expertise in Python and PySpark to create, develop, and maintain scalable data-processing systems. This position necessitates a strong engineering background, an acute awareness of data quality, and experience handling distributed data workloads.

Key Responsibilities • Design and implement batch and, when necessary, streaming data pipelines utilizing Python and PySpark. • Transform, validate, and prepare data for analytics, reporting, and downstream usage. • Enhance Spark jobs for optimal performance, reliability, and resource efficiency. • Establish monitoring, logging, data-quality assessments, and operational support protocols. • Collaborate effectively with data architects, analysts, platform teams, and business stakeholders. • Create tests, maintain technical documentation, and contribute to CI/CD and release workflows.

Required Skills and Experience • Proficient hands-on experience with Python and PySpark. • Strong understanding of Spark execution, distributed processing, data partitioning, and performance enhancement. • Solid fundamentals in SQL and data modeling. • Experience with data lakes, warehouses, or large-scale data platforms. • Familiarity with Linux, Git, automated testing, and deployment methodologies. • Excellent analytical, debugging, and communication abilities.

Preferred Skills • Experience with Azure Databricks, Kafka, orchestration tools, and cloud-based data services. • Knowledge of data governance, lineage, security, and working within regulated environments.

Expected Outcomes • Deliver reliable, scalable data pipelines and high-quality datasets. • Enhance pipeline performance, observability, maintainability, and operational readiness.

Candidate Profile The ideal candidate is collaborative, responsible, quality-oriented, comfortable in a globally distributed environment, and adept at communicating effectively with both technical and business audiences.

Exp-6+ Years

NP- Immediate to 15 days

Location-Pune (Kharadi)

If interested, please send your resumes to

[HIDDEN TEXT]

[HIDDEN TEXT]