AI Assurance Lead (LLM Evaluation, Fine Tuning and Model Risk)

About the Role

About Intelance Intelance is an independent technology, AI and cyber assurance firm based in the UK. We help organisations check, govern and improve their technology through enterprise architecture, AI governance, cyber assurance and data governance work. We are building a small panel of senior associates to deliver technology and AI due diligence on company sales and investments. The role You will check how AI systems are built, tested and governed, for clients who are selling, buying or investing in AI companies. You will test whether the AI does what the company claims, whether it is safe to rely on, and whether the data behind it is used lawfully. Our first engagements are with AI workflow platforms in regulated sectors that combine plain code, classic machine learning and fine tuned open source language models. You report to an Intelance engagement partner and work with our technology due diligence lead, who brings your findings into the final report. What you will do Map where AI sits in a product: which steps are plain code, which use machine learning and which use language models. Review how open source models are fine tuned, what data they learn from, and whether client contracts allow that use. Test the evaluation approach: test suites, accuracy measures, human review rules and how failures are caught and fixed. Check controls against prompt injection, data leaking between clients and tampering with models. Check reliance on outside AI providers, and what data, if any, they receive. Rate each finding by how it could affect the deal, and write clear, practical fixes. What you will bring At least five years building, evaluating or assuring machine learning or language model systems. Hands on experience of fine tuning open source language models and designing evaluation suites. Working knowledge of ISO/IEC 42001, the NIST AI Risk Management Framework or the EU AI Act. The ability to explain model risk in plain words to founders, buyers a

Requirements & Qualifications

• Strong problem solving foundations, knowledge of modern engineering practices, and interest in technology systems.

Perks & Benefits

• Official mentor support
• verified hiring timeline
• and career progression.