Technical Director - Mainframe AI Infrastructure

Accountabilities:

• Define and execute the AI technical strategy for mainframe and infrastructure modernization initiatives, translating it into actionable roadmaps, OKRs, and delivery milestones aligned with business priorities.

• Lead architecture design for LLM-based and agentic systems, including orchestration, retrieval-augmented generation, tool usage, memory, security, observability, and scalable production deployment.

• Drive delivery of AI-native product experiences by partnering with engineering teams to prioritize use cases, iterate quickly, and ensure high-impact, user-centered solutions.

• Establish strong safety, reliability, and evaluation frameworks for AI systems, including monitoring tools, guardrails, and continuous improvement mechanisms.

• Develop reusable engineering standards, libraries, and best practices for AI development, including prompt engineering, evaluation frameworks, and human-in-the-loop workflows.

• Lead and grow high-performing, inclusive engineering teams by mentoring managers and ICs, supporting hiring, and fostering a culture of ownership and psychological safety.

• Partner cross-functionally with product, support, customer success, and GTM teams to ensure successful rollout, adoption, and continuous feedback loops for AI capabilities.

• Define and own key success metrics such as adoption, system reliability, performance, and developer velocity, using insights to guide investment and prioritization.

• Collaborate on complex, cross-platform initiatives involving enterprise-scale systems to ensure technical feasibility, ROI, and architectural integrity.

Requirements:

• 15+ years of software engineering experience, including extensive leadership of multiple engineering teams and managers in cloud and enterprise/mainframe environments.

• Deep hands-on experience with modern AI systems, including large language models, retrieval-augmented generation, agentic workflows, tool/function calling, and evaluation systems.

• Strong background in designing scalable distributed systems, with experience operating in complex, multi-product environments with clear ownership boundaries.

• Proven ability to think at both systems level and product level, connecting technical architecture with real customer workflows and business outcomes.

• Experience building and scaling high-performing, inclusive engineering organizations, including hiring, mentoring, and developing technical leaders.

• Strong communication skills with the ability to translate complex AI and system concepts into clear, actionable narratives for technical and non-technical stakeholders.

• Experience working in fast-paced, globally distributed, remote-first environments across multiple time zones.

• Demonstrated use of AI-first development practices, including experimentation with agentic coding workflows and AI-assisted engineering processes.

• Familiarity with experimentation frameworks, offline evaluation, and human review loops to continuously improve AI system performance.

• Strong adaptability and resilience, with the ability to lead through ambiguity and drive clarity in evolving technical landscapes.

Benefits:

• Competitive annual salary range: $161,000 - $225,400 gross per year

• Unlimited vacation policy, plus paid holidays and sick leave

• Comprehensive health, wellness, life, and disability insurance coverage for employees and dependents

• 401(k) and Roth retirement savings plans with company matching contributions

• Monthly student loan repayment assistance program

• Tuition and certification reimbursement programs

• Access to leadership development and technical training opportunities

• Flexible remote-first work environment.

How Jobgether works:
We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.
We appreciate your interest and wish you the best!
 Why Apply Through Jobgether?

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

#LI-CL1