Software Engineer (Data Engineering, Data warehouse)

Key Responsibilities:

• Design, develop, troubleshoot, and debug data engineering solutions and software programs for databases and applications.
• Analyze, transform, and load data into Autonomous Data Warehouses or similar systems.
• Develop and maintain batch and real-time data pipelines using Spark, Spark-SQL, and related technologies.
• Perform performance tuning and optimization of data engineering pipelines.
• Utilize cloud platforms for data processing, storage (Object Store), and deployment of code.
• Apply SQL and programming skills (Java, Python, Scala) for data engineering tasks.
• Create visualizations and reports using reporting tools when required.
• Participate in Agile development processes and perform Continuous Integration (CI) and Continuous Deployment (CD) of developed code.
• Contribute to software architecture enhancements and suggest improvements as needed.