Cloud Engineer/ Support Engineer - Cloud

Role

Summary

This

position focuses on building data pipelines using a configurable framework

(developed with Databricks / PySpark) that load data from

multiple sources into Google Cloud. The role also requires close

collaboration with team members across India and the USA to follow a

defined plan, execute workflows, verify data load accuracy, and debug

issues as they arise.

Essential

Responsibilities

Design, develop, and implement robust, high-performance data pipelines using

Databricks/PySpark to support a variety of data integration needs. Understand

the data and its relationship/significance from a business perspective.

Apply advanced SQL expertise for complex data manipulation, analysis, and

query optimization.

Work with Google Cloud services such as Dataproc, BigQuery, Airflow, and others.

Develop custom scripts in Python / PySpark.

Perform minor development and enhancement activities as required to support new / custom

requirements.

Requirements

Validate data between source and target & identify issues and rerun jobs

as needed.

Lead other developers, review their code, and ensure quality and optimal

code delivery.

Provide regular updates to the project manager on task progress, status, and risks.

The

experience we are looking to add to our team

Required

Bachelor's degree from a reputed university.

7 to 12 years overall experience.

Strong SQL / data expertise (6+ years) building complex SQL queries,

Stored Procedures, etc.

Experience developing enterprise-grade ETL applications (any tool).

Experience with Google BigQuery or any cloud database.

Experience with Google Cloud services such as Managed service for Apache

Spark (Dataproc), Airflow, etc.

Working knowledge in PySpark / Python.

Good communication skills and a positive attitude.

Ability to take ownership and drive tasks without needing follow-ups.

Good

to have

Experience with big data technologies such as Hadoop, Hive, etc.

Knowledge of Iceberg, Starburst, DBT.

Knowledge in US Healthcare domain.

Knowledge in Agile.