JLJLL
Senior Data Engineer
Bangalore ₹6-8 LPA Posted 7 May 2025
FULL TIME
Spark Streaming
Data Management
data engineering
Crm
Cosmos DB
Job Description
Key Responsibilities:
- Design and Develop Data Solutions: Architect and implement cloud-based data systems using big data technologies to ingest, process, and analyze large and diverse datasets.
- Data Integration: Develop systems that integrate data from various internal and external sources, cleanse and normalize the data, and build pipelines to process both structured and unstructured data.
- Data Management and Persistence: Design and develop data management solutions using relational and non-relational databases to store and process data for various application use cases.
- Collaboration: Work closely with internal colleagues and external partners to understand business requirements, identify opportunities, and develop data solutions that meet those needs.
- Data Pipeline Development: Build and maintain data curation pipelines to integrate data from multiple sources (DBMS, file systems, APIs, and streaming systems) for KPI and metrics development, ensuring high data quality and integrity.
- Platform Health and Maintenance: Monitor, maintain, and troubleshoot data platforms, ensuring high availability, reliability, and scalability of the data solutions.
- Technical Leadership: Contribute to CI/CD processes and best practices in the Data Engineering Org, mentor team members, and help drive innovation within the organization.
- Proof of Concept (POC): Develop POCs to validate solution proposals and assist in the migration of colleagues to a modern technology platform.
- Continuous Improvement: Ensure the continued evolution of the data engineering capabilities, working on improving data quality, platform performance, and scalability.
Qualifications:
- Education: Bachelor's degree in Information Science, Computer Science, Mathematics, Statistics, or a related quantitative discipline.
- Experience: 6+ years of professional experience in data engineering and development.
- Technical Skills:
- Strong hands-on experience with Python, Spark, Spark Streaming, and cloud technologies (preferably Azure).
- Expertise in working with Azure SQL Server, Cosmos DB/MongoDB, Azure Data Lake Storage, Azure Event Hubs, Azure Search, etc.
- Proficient in designing data management and data persistence solutions leveraging relational and non-relational databases.
- Strong knowledge of Cloud Computing (AWS, Azure, etc.), Microservices, Streaming Technologies, Data Engineering, and Security.
- Development Practices: 3+ years of experience with CI/CD, version control systems, and modern data engineering practices.
- Problem-Solving: Ability to handle multiple projects and priorities in a fast-paced environment, while being self-motivated and disciplined.
- Teamwork: Ability to work collaboratively with diverse teams, demonstrate reliability, and take the initiative to solve complex problems.
Preferred Skills:
- Experience with Data Lakes and the integration of structured and unstructured data.
- Familiarity with industry-standard data processing frameworks and big data technologies.
- Strong communication skills and the ability to influence key stakeholders.
What You Can Expect From Us:
- Inclusive Culture: Join an entrepreneurial, inclusive culture where collaboration drives success across global teams.
- Professional Growth: We provide a strong Total Rewards program to support your career ambitions, recognition, well-being, and personal growth.
- Career Opportunities: At JLL, we offer varied experiences to help you develop your strengths and achieve your career goals.
