Senior applied ai engineer (genai & llm evaluation)

Please note that we are flexible on location, provided you are able to work within US time zones.

About Us

Ascent has recently been acquired by Acuity Analytics. This is both a significant milestone for us and a tremendous opportunity for you. Acuity Analytics is a business with a strong global reputation, an impressive client base and ambitious growth plans. We deliver deep insights and domain-led digital transformation to high-growth and heavily regulated organisations. To our customers, we bring a partnership that provides the talent, technology and capability to enhance performance and operational efficiency.

About the role

We're looking for a Senior AI & Data Engineer (GenAI & LLM Evaluation) to help build and improve AI-powered data products. Working alongside Data Scientists, Engineers, and Delivery teams, you'll develop scalable data pipelines, build GenAI evaluation frameworks, and deploy production-ready AI solutions. This is a hands-on role where you'll own solutions from design through to deployment while working on cutting-edge Generative AI technologies. If you enjoy solving real-world problems and building practical AI solutions that make an impact, we'd love to hear from you.

Skills and experience required

Core skills

• 5+ years' experience in Data Engineering, Machine Learning, AI Engineering, or Data Science.
• Strong Python and SQL skills.
• Hands-on experience with Generative AI and Large Language Models (LLMs).
• Experience evaluating LLMs using golden datasets, model benchmarking, or LLM-as-a-Judge techniques.
• Experience building and deploying production-ready ML solutions.
• Strong understanding of data pipelines, validation, and quality frameworks.
• Experience integrating APIs and cloud-based AI services.

Soft skills

• Strong problem-solving and analytical skills.
• Comfortable owning solutions end-to-end.
• Excellent communication and stakeholder management.
• Experience working in Agile, cross-functional teams.
• Consulting or customer-facing experience is a plus.

What you will do

• Build and maintain scalable data pipelines and workflows.
• Develop evaluation frameworks for GenAI and LLM applications.
• Create and maintain golden datasets for model testing.
• Evaluate and benchmark LLM performance.
• Build ML-assisted tools to improve delivery and automation.
• Deploy production-ready AI solutions.
• Work closely with delivery teams to solve technical challenges.
• Continuously improve data quality, automation, and operational efficiency.

Why join us

People are at the Heart of our Business. By investing in people, we achieve exceptional results for our clients and create new opportunities for our teams to thrive. Check out this page for more details. If you have any questions contact our Talent Acquisition team on ta.admin@acuityanalytics. For more details about Acuity Analytics please see here: Read here.