ETL Developer with Pyspark

Key Responsibilities

• Design, develop, and implement data integration and ETL solutions using ETL tools
• Collaborate with cross-functional teams to gather and prioritize data requirements
• Develop and maintain large-scale data pipelines using PySpark
• Ensure data quality and integrity through validation, testing, and monitoring processes
• Optimize data processing workflows for performance and efficiency improvements
• Troubleshoot and resolve issues related to data integration and ETL processes
• Maintain documentation for data pipelines, workflows, and integration processes