GCP Data Engineer
Job Description
A GCP BigQuery professional designs, develops, and optimizes large-scale data warehouses, ELT/ETL pipelines, and SQL scripts within Google Cloud.
Responsibilities include managing data ingestion using PubSub and Dataflow, optimizing performance and cost, and implementing security governance. Key skills include SQL, Python, Apache Airflow, and data modeling.
Key Responsibilities
Data Architecture Modeling Design and optimize BigQuery data models, schemas, and storage to ensure performance and cost efficiency
Pipeline Development ETL/ELT Build scalable data pipelines and workflows using tools like Cloud Composer (Airflow), Dataflow, and Dataproc
Query Optimization Develop complex SQL scripts and tune performance to minimize BigQuery slot usage
Data Integration Ingest, transform, and manage data from diverse sources into BigQuery
Governance Security Implement data security access controls and best practices
Required Skills Qualifications
Core Technical Proficiency in Google SQL, Python, and Google Cloud Platform (GCP) services including BigQuery, Cloud Storage, and Dataflow
Data Processing Experience with Apache Spark, Beam, or Hadoop
Database Knowledge Strong understanding of relational RDBMS and NoSQL databases
Skills
Mandatory Skills : GCP BigQuery, GCP Storage, Python for DATA
