Artificial Intelligence Engineer

We are seeking a highly skilled AI Engineer with proven experience in developing, deploying, and optimizing AI models using the MosaicAI Databricks platform. The ideal candidate will have a strong background in machine learning, distributed data processing, and will be a champion of Databricks platform.

Responsibilities

• Design, build, and deploy large-scale AI/ML models using the MosaicAI Databricks environment.
• Leverage Databricks' data engineering workflows for feature engineering, model training, and evaluation.
• Optimize training pipelines for efficiency, scalability, and accuracy.
• Integrate AI models into production systems using APIs and microservices.
• Collaborate with data scientists, data engineers, and MLOps teams to ensure seamless AI lifecycle management.
• Implement robust testing, monitoring, and retraining protocols for deployed models.
• Ensure adherence to compliance, security, and performance standards.
• Stay updated on advancements in AI frameworks, distributed computing, and Databricks platform updates.

Required Skills and Qualifications

• Bachelor's or Master's degree in Computer Science, Data Science, or related field.
• Cerified Databricks Certified Generative AI Engineer
• Proven experience developing AI solutions using MosaicAI on Databricks.
• Strong knowledge of Python, PySpark, MLflow, and Spark.
• Strong understanding and knowlege of Databricks platform features such as Unity Catalog, DLT, MosaicAI, Data Assets Bundles, etc.
• Experience with Transformer-based models, generative AI, and Databricks pipelines.
• Proficiency in integrating AI models with cloud-native architectures (AWS, Azure, or GCP).
• Solid understanding of MLOps practices, Data Assets bundles (CI/CD), and containerization (Docker, Kubernetes) on Databricks Platform.
• Familiarity with vector databases, embeddings, and retrieval-augmented generation (RAG).
• Strong problem-solving, analytical thinking, and communication skills.