Senior Software Engineer, AI Developer Experience

About the Role

At Vanta, our mission is to help businesses earn and prove trust. We believe that security should be monitored and verified continuously, and we empower companies to practice better security and prove it with ease. Vanta has a kind and talented team, and while some have prior security experience, many have been successful at Vanta without it.  Build the systems, infrastructure, and developer workflows that make AI-powered engineering more useful, reliable, and easy for Vanta engineers to adopt. The AI DX team is building the foundations for a more autonomous software development experience at Vanta, including background agents, agent evaluation systems, and tooling that helps engineers work more effectively with AI. The team combines software engineering, developer experience, AI systems, and product thinking to turn emerging capabilities into reliable workflows used in real engineering work. As a Senior Software Engineer on the AI DX team, you’ll help shape these systems from the ground up. You’ll work directly with engineers to understand friction in their workflows, build practical solutions, and use evidence from real usage to continuously improve quality, reliability, and adoption. Visit our Vanta Engineering Blog https://www.vanta.com/all-categories/engineering to learn more about what our team is working on!  What you’ll do as a Senior Software Engineer at Vanta: - Plan, build, and improve background-agent infrastructure that enables reliable, trackable, and repeatable automated engineering work. - Develop systems for evaluating agent performance using task outcomes, quality measures, human intervention, cost, and other signals. - Create evaluation sets and feedback loops that help AI systems improve over time through regular review, tuning, and correction. - Improve how engineers discover, understand, and use shared AI tools and workflows. - Evaluate AI development tools, including code generation, AI-assisted review, and testing, against real

Key Responsibilities

• Plan, build, and improve background-agent infrastructure that enables reliable, trackable, and repeatable automated engineering work.
• Develop systems for evaluating agent performance using task outcomes, quality measures, human intervention, cost, and other signals.
• Create evaluation sets and feedback loops that help AI systems improve over time through regular review, tuning, and correction.
• Improve how engineers discover, understand, and use shared AI tools and workflows.
• Evaluate AI development tools, including code generation, AI-assisted review, and testing, against real

Requirements & Qualifications

• Strong problem solving foundations, knowledge of modern engineering practices, and interest in technology systems.

Perks & Benefits

• Official mentor support
• verified hiring timeline
• and career progression.