TETechnoGen
Data Engineer
Hyderabad ₹6-10 LPA Posted 15 May 2025
FULL TIME
Gcp
Sql
data engineering
Collibra
BigQuery
+3 more
Job Description
Key Responsibilities:
- Design, build, and maintain data pipelines (ETL/ELT) using BigQuery, Python, and SQL
- Optimize data flow, automate processes, and scale infrastructure
- Develop and manage workflows in Airflow/Cloud Composer and Ascend (or similar ETL tools)
- Implement data quality checks and testing strategies
- Support CI/CD (DevSecOps) processes, conduct code reviews, and mentor junior engineers
- Collaborate with QA/business teams and troubleshoot issues across environments
Core Skills:
- BigQuery, Python, SQL, Airflow/Cloud Composer, Ascend or similar ETL tools
- Data integration, warehousing, and pipeline orchestration
- Data quality frameworks and incremental load strategies
- Strong experience with GCP or AWS serverless data warehouse environments
Preferred Skills:
- DBT for transformation
- Collibra for data governance
- Working with unstructured datasets
Qualifications:
- 5+ years in data engineering
- Graduate degree in CS, Statistics, or related field
- Strong analytical and SQL expertise
