GCP BigQuery Developer

Job Overview:

• We are looking for an experienced GCP BigQuery Developer with 2 to 3 years of expertise in crafting scalable data solutions on the Google Cloud Platform (GCP).
• The successful candidate will possess strong knowledge of BigQuery SQL and data pipeline development, complemented by experience with contemporary data engineering tools and cloud-based architectures.

Primary Responsibilities:

• Architect, develop, and enhance data warehouses and data marts utilizing BigQuery.
• Create and sustain ETL/ELT pipelines leveraging GCP services.
• Write proficient and complex SQL queries for data transformation and analytical purposes.
• Utilize Cloud Composer, Airflow, Dataflow, or Dataproc for pipeline orchestration.
• Conduct data modeling using star and snowflake schemas for analytical applications.
• Enhance query performance while ensuring cost efficiency in BigQuery.
• Integrate data from diverse sources, including APIs, Cloud Storage, databases, and streaming inputs.
• Establish data validation, quality checks, and monitoring systems.
• Collaborate effectively with data analysts, data scientists, and business stakeholders.
• Uphold security and governance best practices within the GCP environment.

Technical Qualifications:

• Proven experience with Google BigQuery.
• Advanced SQL skills.
• Hands-on familiarity with GCP services such as BigQuery, Cloud Storage, Dataflow, and Dataproc.
• Experience with Cloud Composer and Airflow.
• Expertise in developing ETL/ELT pipelines.
• Solid understanding of data warehousing principles.
• Knowledge of Python or PySpark for data processing tasks.
• Experience in query optimization and performance tuning.
• Understanding of data partitioning and clustering techniques in BigQuery.

Additional Qualifications:

• Familiarity with CI/CD tools such as Cloud Build, Jenkins, and GitHub Actions.
• Experience with data visualization tools like Looker, Tableau, or Power BI.
• Knowledge of streaming data pipelines, particularly with Pub/Sub.
• Experience with Infrastructure as Code using Terraform.
• Comprehension of data governance and access control within GCP.
• Bachelor's degree in Computer Science, IT, or a related discipline.
• GCP certifications, such as Professional Data Engineer, are advantageous.

Desired Skills:

Technology -> Cloud Platform -> GCP Database