Big Data Software Engineer - Manufacturing Systems & Infrastructure

Job description

As a BigData Engineer, you will lead the development and implementation of our cloud-based data infrastructure. You will work closely with cross-functional teams to understand data requirements, design scalable solutions, and ensure the integrity and availability of our data. The ideal candidate will have a deep understanding of cloud technologies, data engineering best practices, and a proven track record of successfully delivering complex data projects.- Lead the design and implementation of cloud-based data architectures.- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements.- Implement data security and privacy best practices.- Optimize data storage, retrieval, and processing for performance and cost efficiency.- Lead efforts to ensure data quality, consistency, and accuracy.- Mentor and provide technical guidance to junior data engineers.- Stay current with industry trends and emerging technologies in cloud data engineering.

Minimum Qualifications

• Bachelor s or Masters degree in Computer Science or a related field
• Proven experience as a Big Data developer, with a focus on cloud platforms
• Strong proficiency in cloud services such as AWS, Azure, or Google Cloud
• Expertise in data modelling and data integration
• Experience with big data technologies (Hadoop, Spark, etc.)
• Proficient in programming languages such as Python, Java, Scala, GoLang
• Knowledge of data warehouse solutions (Redshift, BigQuery, Snowflake, Druid)
• Experience with streaming data technologies (Kafka, Kinesis)

Preferred Qualifications

• Certification in cloud platforms (AWS Certified Big Data - Specialty, Microsoft Certified: Azure Data Engineer, etc.)
• Experience building data streaming solutions using Apache Spark, Storm, Link, Flume
• Experience using ETL tools and technologies like Reltio, Stibo, Informatics, Apache Atlas
• Knowledge of machine learning and data science concepts
• Contributions to the open source community
• Familiarity with data governance and compliance
• Strong problem-solving and analytical skills
• Excellent communication and leadership skills