Senior Data Engineer

JOB SUMMARY

At Publicis Sapient, we go beyond just developing technology; we deliver transformative solutions. By seamlessly integrating Generative AI, sophisticated machine learning, and contemporary cloud data architectures into our framework, we are pioneering a new age of intelligent, data-centric digital experiences for clients worldwide. Whether it's engineering extensive automated data pipelines or implementing self-service analytics frameworks and operationalizing LLM architectures, we utilize state-of-the-art technologies to address intricate business challenges.

Become a part of our mission to drive innovation and provide genuine business value to our clients through the strategic use of advanced big data systems, modern DevOps methodologies, and next-generation AI.

About the Team

The Data and AI Team at Publicis Sapient stands at the cutting edge of enterprise innovation, developing scalable, comprehensive data and machine learning solutions across various global sectors. Our diverse team combines expertise in cloud data engineering, data science pipelines, DevOps, and intelligent search systems. By utilizing cohesive compute platforms and advanced AI architectures such as RAG and LLMs, we build strong data foundations that transform complex information landscapes into actionable insights for businesses.

About the Role

As a Senior Data Engineer with a focus on Azure Big Data and AI Solutions (SAL2), your responsibilities will include:

• Lead AI & Data Engineering Innovations: Take charge of the design, implementation, and deployment of large-scale big data architectures, analytical frameworks, and self-service ETL platforms within the Azure ecosystem.
• Strategic Cloud Data Migration: Oversee complex data migration initiatives from legacy systems and on-premises clusters to modern cloud-native solutions, ensuring minimal disruption and maximum architectural integrity.
• Advance Generative AI & ML Systems: Integrate machine learning models and essential Generative AI components—including RAG frameworks and Large Language Models (LLMs)—into production-grade data pipelines.
• Optimize Production Pipelines: Design, enhance, and maintain automated end-to-end data pipelines using Azure Data Factory (ADF) and Azure Databricks to efficiently process distributed datasets with low latency and high availability.
• Promote Data-Driven Decision-Making: Conduct in-depth source data analysis, profiling, and schema mapping across large-scale enterprise data warehouses to enhance data quality and business insights.
• Foster DevOps Excellence: Incorporate standard DevOps practices and CI/CD automated deployment paradigms into data processing solutions, ensuring reliable and maintainable code delivery.

Key Responsibilities

• Design, optimize, and scale automated data ingestion pipelines using Azure Data Factory (ADF) and Azure Databricks in batch mode.
• Create and maintain custom self-service analytics platforms and modular ETL frameworks utilizing Python and PySpark.
• Conduct comprehensive source data analysis, data mapping, and detailed profiling to impose structure on unorganized or multi-source datasets.
• Develop, integrate, and operationalize machine learning and GenAI applications using Azure Machine Learning, RAG strategies, and LLM orchestration tools.
• Deploy, monitor, and configure auxiliary cloud web services and infrastructure components such as Azure WebApps, Key Vaults, Function Apps, and Logic Apps.
• Proactively enhance the performance of complex SQL queries, Synapse Data Warehouses, and Spark computation engines to reduce compute expenses and execution durations.
• Collaborate with engineering and product teams to swiftly adapt to new data technologies and address complex platform bottlenecks.

Your Skills & Experience:

• BS/MS in Computer Science, Mathematics, Engineering, Statistics, or a related quantitative/computational field. Advanced degrees preferred.
• Expertise in programming with Python and distributed cluster computing using PySpark and Apache Spark.
• Extensive, hands-on architectural experience with Azure cloud services, particularly Azure Data Factory (ADF), Azure Databricks, and Azure Synapse / SQL Server.
• Proven track record in designing and maintaining large-scale enterprise Data Warehouses, encompassing data integration and schema mapping.
• Strong command of SQL scripting, window functions, query execution planning, and optimization of complex dataset manipulations.
• Familiarity with DevOps practices, including CI/CD automated release management pipelines tailored for data applications.
• Practical experience in building and deploying machine learning models or integrating GenAI capabilities (RAG, LLM tooling).
• Experience in configuring auxiliary microservices such as Azure Function Apps, Logic Apps, and credential management through Azure Key Vault.

Set Yourself Apart With:

• Microsoft Certified: Azure Data Engineer Associate, Azure AI Engineer Associate, or Databricks Certified Professional certifications.
• Documented success in migrating multi-terabyte on-premises clusters (Hadoop/legacy systems) into cloud infrastructure.
• Advanced experience in productionizing scalable vector indexing, specialized embeddings, or high-performance inference endpoints for RAG systems.
• Established leadership presence or mentorship experience promoting technical agility and modern coding practices within data-focused teams.

PERSONAL ATTRIBUTES

• Exceptional written, verbal, and interpersonal communication skills.
• Strong problem-solving abilities with a high degree of adaptability to learn new and emerging data technologies.
• Collaborative, self-motivated mentality that requires minimal supervision while managing complex tasks in a fast-paced environment.
• Ability to efficiently balance, prioritize, and oversee multiple projects without compromising quality of delivery.

EXPERIENCE

5.5 to 8 years of relevant experience with a specialization in cloud big data and analytical model engineering.

ABOUT US

Publicis Sapient is a digital transformation partner that assists established organizations in achieving their future, digitally-enabled state, both in their operations and in how they engage with customers. We unlock value through a start-up mindset and contemporary methods, merging strategy, consulting, and customer experience with agile engineering and creative problem-solving. As digital pioneers with 20,000 professionals and 53 offices worldwide, our expertise spans technology, data sciences, consulting, and customer-centricity—combined with our culture of curiosity and determination—enables us to accelerate our clients' businesses by designing the products and services their customers truly value. Publicis Sapient serves as the digital business transformation hub of Publicis Groupe. To learn more, visit publicissapient.com