GCP BigQuery Developer

Job Overview:

• We are on the lookout for a proficient GCP BigQuery Developer with 2 to 3 years of experience in crafting scalable data solutions utilizing Google Cloud Platform (GCP).
• The perfect candidate will possess substantial knowledge in BigQuery SQL and data pipeline creation, along with familiarity with contemporary data engineering tools and cloud-based infrastructures.

Primary Responsibilities:

• Design, develop, and enhance data warehouses and data marts based on BigQuery.
• Construct and uphold ETL/ELT pipelines leveraging GCP services.
• Create complex SQL queries for effective data transformation and analysis.
• Utilize Cloud Composer, Airflow, Dataflow, or Dataproc for managing pipeline orchestration.
• Execute data modeling using star and snowflake schemas for analytical applications.
• Enhance query performance and oversee cost efficiency in BigQuery.
• Integrate data from diverse sources including APIs, Cloud Storage, databases, and streaming sources.
• Establish data validation, quality checks, and monitoring systems.
• Collaborate with data analysts, data scientists, and business stakeholders.
• Uphold security and governance best practices within GCP.

Technical Qualifications:

• Extensive experience with Google BigQuery.
• Advanced skills in SQL.
• Hands-on experience utilizing GCP services such as BigQuery, Cloud Storage, Dataflow, and Dataproc.
• Experience with Cloud Composer and Airflow.
• Proficiency in developing ETL/ELT pipelines.
• Strong understanding of data warehousing principles.
• Familiarity with Python or PySpark for data processing.
• Experience in performance tuning and optimizing queries.
• Knowledge of data partitioning and clustering techniques in BigQuery.

Additional Qualifications:

• Experience with CI/CD tools like Cloud Build, Jenkins, or GitHub Actions.
• Familiarity with data visualization platforms such as Looker, Tableau, or Power BI.
• Understanding of streaming data pipelines, particularly with Pub/Sub.
• Experience with Infrastructure as Code (IaC) using Terraform.
• Comprehension of data governance and access control practices within GCP.
• Bachelor's degree in Computer Science, IT, or a related field.
• GCP certifications, such as Professional Data Engineer, are advantageous.

Preferred Expertise:

Technology->Cloud Platform->GCP Core Services, Technology->Cloud Platform->GCP Database