Lead Data Engineer

Role: Lead Data Engineer

Location: Bangalore, India

Full/ Part-time: Full time

About the Role:

Lead Data Engineer in the AI team will architect, build, and scale robust data platforms that power machine learning, GenAI, and advanced analytics use cases. This role bridges data engineering, MLOps, and AI product teams to ensure reliable, secure, and high-performance data pipelines that support model training, evaluation, deployment, and monitoring at scale.

Role Responsibilities:

• Design and implement scalable batch and real-time data pipelines

• Architect modern data platforms (lakehouse, warehouse, streaming) for AI workloads

• Lead data ingestion, transformation, and feature engineering pipelines

• Build and optimize data infrastructure for ML model training and inference

• Establish data quality, lineage, observability, and governance frameworks

• Collaborate with Data Scientists, ML Engineers, and Product teams to productionize AI solutions

• Drive MLOps best practices for dataset versioning, reproducibility, and pipeline automation

• Optimize data storage and compute costs across cloud platforms

• Ensure data security, privacy compliance, and regulatory alignment

• Mentor junior data engineers and define engineering standards

• Evaluate and introduce new tools and technologies for AI data ecosystems

• Support large-scale AI/LLM initiatives including RAG pipelines and vector databases

​ Minimum Requirements:

• Bachelor’s or Master’s degree in Computer Science, Engineering, or related field

• 7+ years of experience in data engineering, with at least 2+ years in AI/ML data platforms

• Strong programming skills in Python and SQL

• Hands-on experience with cloud platforms (AWS / GCP)

• Experience with distributed data processing (Spark etc.)

• Experience building data lakes / lakehouse architectures

• Familiarity with orchestration tools (Airflow, etc.)

• Experience with CI/CD pipelines and infrastructure-as-code

• Understanding of ML lifecycle, feature stores, and model deployment workflows

• Experience with data governance, security, and compliance standards

• Strong leadership, communication, and cross-functional collaboration skills

Benefits

We are committed to offering competitive benefits programs for all of our employees, and enhancing our programs when necessary.

• Make yourself a priority with flexible schedules, parental leave
• Drive forward your career through professional development opportunities
• Achieve your personal goals with our Employee Assistance Programme

Our commitment to you

Our greatest assets are the expertise, creativity and passion of our employees. We strive to provide a great place to work that attracts, develops and retains the best talent, promotes employee engagement, fosters teamwork and ultimately drives innovation for the benefit of our customers. We strive to create an environment where you feel that you belong, with diversity and inclusion as the engine to growth and innovation. We develop and deploy best-in-class programs and practices, providing enriching career opportunities, listening to employee feedback and always challenging ourselves to do better. This is The Carrier Way .

Join us and make a difference.

Apply Now!

Carrier is An Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or veteran status, age or any other federally protected class.

Job Applicant's Privacy Notice:

Click on this link to read the Job Applicant's Privacy Notice