IBIBM
Data Engineer-Data Platforms-Google
Bangalore Posted 17 Nov 2026
FULL TIME
Apache Beam
Spark
Apache Airflow
dbt
Python
+1 more
Job Description
Introduction
A career at IBM Consulting is grounded in long-term client partnerships and active collaboration with teams worldwide. You’ll work with leading organizations across industries, supporting their hybrid cloud and AI initiatives. Backed by strategic partners, IBM technology, and Red Hat, you’ll gain the capability to create meaningful change and help accelerate client outcomes. At IBM Consulting, curiosity is a key driver of success. You’ll be supported in questioning the status quo, testing new ideas, and building solutions that produce real, measurable results. Our culture emphasizes growth and empathy—supporting your long-term career development while recognizing and valuing your distinct skills and experiences.
Your Role And Responsibilities
As a Data Engineer focused on Google’s data platforms, you will design, build, and maintain data engineering solutions within the Google Cloud environment. The position calls for strong capability in applying multiple Google services to support both batch and real-time data pipelines, data migration, and data layer design.
Your Primary Responsibilities Will Include
Master's Degree
Required Technical And Professional Expertise
A career at IBM Consulting is grounded in long-term client partnerships and active collaboration with teams worldwide. You’ll work with leading organizations across industries, supporting their hybrid cloud and AI initiatives. Backed by strategic partners, IBM technology, and Red Hat, you’ll gain the capability to create meaningful change and help accelerate client outcomes. At IBM Consulting, curiosity is a key driver of success. You’ll be supported in questioning the status quo, testing new ideas, and building solutions that produce real, measurable results. Our culture emphasizes growth and empathy—supporting your long-term career development while recognizing and valuing your distinct skills and experiences.
Your Role And Responsibilities
As a Data Engineer focused on Google’s data platforms, you will design, build, and maintain data engineering solutions within the Google Cloud environment. The position calls for strong capability in applying multiple Google services to support both batch and real-time data pipelines, data migration, and data layer design.
Your Primary Responsibilities Will Include
- Design Data Pipelines: Design and develop batch and real-time data pipelines for Data Warehouse and Datalake using Google services such as DataProc, DataFlow, PubSub, BigQuery, and Big Table.
- Develop Data Engineering Solutions: Use Google Cloud Storage, BigTable, BigQuery DataProc with Spark and Hadoop, and Google DataFlow with Apache Beam or Python to create, deploy, and maintain data engineering solutions.
- Manage Data Platforms: Plan, schedule, and manage the data platform using Google Cloud Scheduler and Cloud Composer (Airflow), ensuring smooth and effective data pipeline execution.
- Implement Data Migration: Create and implement data migration solutions using Google services to support seamless transfers between systems.
- Optimize Data Layer: Design and optimize the data layer using Google services including BigQuery, Big Table, and Cloud Spanner, ensuring effective data storage and retrieval.
Master's Degree
Required Technical And Professional Expertise
- Google Cloud Ecosystem Expertise: Exposure to designing, building, and maintaining data engineering solutions on Google’s Cloud ecosystem, including services such as Google DataProc, DataFlow, PubSub, BigQuery, Big Table, Cloud Spanner, CloudSQL, and AlloyDB.
- Data Pipeline Development Experience: Exposure to developing and managing batch and real-time data pipelines for Data Warehouse and Datalake using Google services and open-source technologies such as Apache Airflow, dbt, Spark/Python, or Spark/Scala.
- Google Cloud Services Proficiency: Experience working with Google Cloud Storage, BigTable, BigQuery DataProc with Spark and Hadoop, and Google DataFlow with Apache Beam or Python to build and maintain data engineering solutions.
- Data Platform Management Knowledge: Exposure to scheduling and managing the data platform using Google Cloud Scheduler and Cloud Composer (Airflow) to support efficient data pipeline operations.
- Data Layer Design Understanding: Experience working with data layer design using Google services such as BigQuery, Big Table, and Cloud Spanner to enable efficient data storage and retrieval.
- Open Source Technologies: Exposure to leveraging open-source technologies such as Apache Airflow, dbt, Spark/Python, or Spark/Scala for developing and managing batch and real-time data pipelines.
- Data Migration Solutions: Experience working with Google services to develop and implement data migration solutions that support seamless data transfer between systems.
- Cloud Composer Expertise: Exposure to using Cloud Composer (Airflow) to schedule and manage the data platform, helping ensure efficient data pipeline operations.
