AI Engineer

Welcome to Gallagher - a global community of people who bring bold ideas, deep expertise, and a shared commitment to doing what’s right. We help clients navigate complexity with confidence by empowering businesses, communities, and individuals to thrive. At Gallagher, you’ll find more than a job; you’ll find a culture built on trust, driven by collaboration, and sustained by the belief that we’re better together. Whether you join us in a client-facing role or as part of our brokerage division, our benefits and HR consulting division, or our corporate team, you’ll have the opportunity to grow your career, make an impact, and be part of something bigger. Experience a workplace where you’re encouraged to be yourself, supported to succeed, and inspired to keep learning. That’s what it means to live The Gallagher Way.

The AI LLM Engineer designs, builds, deploys, and optimizes large language model solutions for enterprise client use cases. This role combines machine learning, software engineering, and applied AI expertise to create production-ready systems such as copilots, document intelligence solutions, agentic workflows, and retrieval-augmented generation applications. The ideal candidate can translate business needs into scalable, secure, and reliable LLM-powered products while maintaining a strong focus on evaluation, safety, performance, and cost efficiency.

• Design and develop LLM-powered applications, including chat assistants, knowledge retrieval solutions, summarization tools, and agent-based workflows.
• Build and maintain retrieval-augmented generation pipelines using enterprise content sources, vector databases, embeddings, reranking, and prompt orchestration.
• Fine-tune, evaluate, and optimize open-source and hosted foundation models for domain-specific use cases.
• Create prompt engineering frameworks, reusable templates, and testing methods to improve answer quality, consistency, and reliability.
• Implement evaluation pipelines to measure accuracy, grounding, latency, safety, hallucination rates, and user experience.
• Develop APIs, microservices, and scalable backend services that integrate LLM capabilities into business applications.
• Partner with product managers, designers, data engineers, security, and compliance teams to deliver enterprise-ready AI solutions.
• Establish observability, monitoring, and incident response practices for production AI systems.
• Improve model and system efficiency through caching, batching, routing, quantization, and inference optimization.
• Support governance requirements including data privacy, model risk management, security controls, and responsible AI standards.

Required Qualifications

• Bachelor’s degree in Computer Science, Engineering, Data Science, or a related technical field; Master’s degree preferred.
• 3+ years of experience in software engineering, machine learning engineering, applied AI, or natural language processing.
• Hands-on experience building solutions with large language models, foundation models, or generative AI platforms.
• Strong proficiency in Python and experience with modern software engineering practices, including testing, version control, and CI/CD.
• Experience with LLM frameworks and tooling such as LangChain, LlamaIndex, Semantic Kernel, or equivalent orchestration frameworks.
• Knowledge of embeddings, vector databases, semantic search, retrieval systems, and prompt engineering techniques.
• Experience deploying AI services in cloud environments such as Azure, AWS, or Google Cloud.
• Understanding of model evaluation, experimentation, and performance optimization in production systems.
• Familiarity with responsible AI practices, including safety, privacy, bias mitigation, and governance controls.
• Strong communication skills with the ability to explain technical concepts to non-technical stakeholders.

Preferred Qualifications

• Experience fine-tuning models using techniques such as LoRA, QLoRA, or parameter-efficient tuning.
• Experience with open-source models and model serving frameworks.
• Knowledge of distributed inference, GPU optimization, and containerized deployment with Kubernetes or similar platforms.
• Experience building enterprise copilots, internal knowledge assistants, or AI automation tools.
• Familiarity with evaluation frameworks, human-in-the-loop review processes, and red teaming practices.
• Knowledge of secure enterprise architecture patterns for integrating AI with internal data sources and applications.
• Experience working in regulated industries such as insurance, healthcare, or financial services.

Core Skills
Large language models, generative AI, retrieval-augmented generation, prompt engineering, vector databases, model evaluation, API development, Python, cloud engineering, MLOps, data pipelines, observability, responsible AI, security, and cross-functional collaboration.

What Success Looks Like
Success in this role means delivering LLM-powered capabilities that are accurate, reliable, secure, scalable, and aligned to measurable business outcomes. A successful AI LLM Engineer continuously improves model quality, reduces operational risk, and partners effectively across product, engineering, and business teams to move from experimentation to enterprise adoption.

Reporting Structure
This role typically reports to a Director of AI Engineering, or similar technology leadership role, and works closely with product, platform, cybersecurity, legal, and compliance teams.

We offer a competitive and comprehensive compensation package. The base salary range represents the anticipated low end and high end of the range for this position. The actual compensation will be influenced by a wide range of factors including, but not limited to previous experience, education, pay market/geography, complexity or scope, specialized skill set, lines of business/practice area, supply/demand, and scheduled hours. On top of a competitive salary, great teams and exciting career opportunities, we also offer a wide range of benefits.

Below are the minimum core benefits you’ll get, depending on your job level these benefits may improve:

• Medical/dental/vision plans, which start from day one!
• Life and accident insurance
• 401(K) and Roth options
• Tax-advantaged accounts (HSA, FSA)
• Educational expense reimbursement
• Paid parental leave

Other benefits include:

• Digital mental health services (Talkspace)
• Flexible work hours (availability varies by office and job function)
• Training programs
• Gallagher Thrive program – elevating your health through challenges, workshops and digital fitness programs for your overall wellbeing
• Charitable matching gift program
• And more...

**The benefits summary above applies to fulltime positions. If you are not applying for a fulltime position, details about benefits will be provided during the selection process.

We value inclusion and diversity

Click Here to review our U.S. Eligibility Requirements

Inclusion and diversity (I&D) is a core part of our business, and it’s embedded into the fabric of our organization. For more than 95 years, Gallagher has led with a commitment to sustainability and to support the communities where we live and work.

Gallagher embraces our employees’ diverse identities, experiences and talents, allowing us to better serve our clients and communities. We see inclusion as a conscious commitment and diversity as a vital strength. By embracing diversity in all its forms, we live out The Gallagher Way to its fullest.

Gallagher believes that all persons are entitled to equal employment opportunity and prohibits any form of discrimination by its managers, employees, vendors or customers based on race, color, religion, creed, gender (including pregnancy status), sexual orientation, gender identity (which includes transgender and other gender non-conforming individuals), gender expression, hair expression, marital status, parental status, age, national origin, ancestry, disability, medical condition, genetic information, veteran or military status, citizenship status, or any other characteristic protected (herein referred to as “protected characteristics”) by applicable federal, state, or local laws.

Equal employment opportunity will be extended in all aspects of the employer-employee relationship, including, but not limited to, recruitment, hiring, training, promotion, transfer, demotion, compensation, benefits, layoff, and termination. In addition, Gallagher will make reasonable accommodations to known physical or mental limitations of an otherwise qualified person with a disability, unless the accommodation would impose an undue hardship on the operation of our business.