Staff Software Engineer ( AI )

Accountabilities

In this role, you will define and lead the technical direction of AI platform systems while contributing hands-on to backend and platform engineering. You will establish architectural standards, guide cross-team alignment, and ensure scalable and secure AI adoption across the organization. You will also play a key role in shaping model infrastructure, evaluation systems, and AI data pipelines as the platform evolves. Key responsibilities include:

• Own and define the reference architecture for AI platform systems, including APIs, RAG pipelines, vector retrieval, and model serving infrastructure

• Lead design standards, architectural reviews, and build-vs-buy decisions across AI and platform components

• Develop and maintain scalable data pipelines and infrastructure supporting production AI services

• Design and implement backend services in Python and REST APIs, with occasional full-stack contributions (React/TypeScript)

• Build evaluation frameworks, observability systems, and performance monitoring for AI models and services

• Integrate and manage LLM-based systems, including prompt management, response validation, and fallback strategies

• Ensure compliance and security by design, collaborating with security teams on governance and regulatory requirements

• Mentor engineers, lead technical discussions, and promote engineering excellence across teams

• Partner with product and engineering leadership to define AI roadmap and platform evolution

Requirements

This position requires extensive experience in software engineering with strong exposure to AI systems, distributed architectures, and cloud platforms. You should be comfortable operating at a staff-level scope, influencing technical direction across multiple teams while delivering hands-on solutions. Strong communication, leadership, and system design skills are essential. Key requirements include:

• 8+ years of experience in software engineering with cross-team architectural influence

• Proven experience delivering AI-powered or GenAI-based production systems

• Strong proficiency in Python and RESTful API development (e.g., FastAPI or Django)

• Experience with LLM integrations, RAG pipelines, prompt engineering, or evaluation frameworks

• Solid understanding of distributed systems, cloud-native architecture, and scalable backend systems

• Familiarity with AWS or similar cloud platforms and modern DevOps practices (CI/CD, Docker, Kubernetes)

• Experience with vector databases and semantic search technologies (e.g., Pinecone, pgvector, OpenSearch)

• Knowledge of MLOps/LLMOps concepts, model lifecycle, and production deployment practices

• Ability to write architectural documentation (RFCs, ADRs) and communicate across technical and non-technical audiences

• Experience mentoring engineers and contributing to engineering culture and standards

• Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience

Benefits

• Fully remote work environment

• High-impact role shaping enterprise AI platform strategy

• Opportunity to work on cutting-edge GenAI and LLM-based systems

• Strong influence across architecture, engineering standards, and platform direction

• Collaborative, cross-functional engineering culture

• Exposure to regulated, large-scale financial technology systems

• Career growth opportunities in senior technical leadership pathways

How Jobgether works:
We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.
We appreciate your interest and wish you the best!
 Why Apply Through Jobgether?

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

#LI-CL1