Senior AI Infrastructure Engineer

We do Consulting Differently

BRG’s AI Department is hiring a Senior AI Infrastructure Engineer to build the Azure-based platform powering our Virtual AI Lab—scaling to 100,000+ documents/day using state-of-the-art LLMs from OpenAI and Anthropic.

About the Role

You will design, implement, maintain, and monitor the Azure cloud infrastructure, managed IaC-first, that supports BRG’s AI and data-pipeline workloads. You will set the standard for Terraform / OpenTofu, GitOps on AKS, and the observability layer across the platform, partnering with the AI Systems Architect and application teams.

Key Responsibilities

• Design, implement, maintain, and monitor Azure infrastructure (AKS, Key Vault, VNet / Private Link, Entra ID, Azure Monitor) supporting AI and data pipelines.

• Own a modular Terraform / OpenTofu codebase with disciplined state management—remote backends, locking, workspace isolation, drift detection.

• Run GitOps for infrastructure (PR-driven plan / apply) and workloads (ArgoCD or Flux with Helm / Kustomize); enforce policy-as-code (OPA, Checkov, tfsec).

• Operate AKS clusters for AI/ML workloads—GPU node pools, autoscaling, batching, right-sizing—supporting pipelines built with Haystack, LangChain, or LangGraph.

• Build distributed document-processing pipelines (queuing, retry, idempotency) and manage hosted LLM integrations (Azure OpenAI, Anthropic).

• Own the observability layer: OpenTelemetry (traces / metrics / logs) via Azure Monitor and Prometheus / Grafana; define SLOs, alerting, and AI-cost telemetry (token usage, GPU hours, pipeline latency).

• Ensure secure handling of sensitive client data: encryption at rest / in transit, least-privilege access, audit logging, and compliance posture.

Required Qualifications

• 6–8 years in infrastructure, platform, or distributed-systems engineering.

• Strong, hands-on Microsoft Azure experience (AKS, networking, Entra ID, Key Vault, Azure Monitor). AWS or GCP is a plus but not a substitute.

• Deep Terraform or OpenTofu experience with evidence of modular design, remote state management, and GitOps-driven change workflows.

• Production Kubernetes (AKS preferred) with ArgoCD or Flux.

• Experience deploying AI/ML pipelines using Haystack, LangChain, or LangGraph (or equivalent).

• Working knowledge of OpenTelemetry and modern observability practice (SLOs, tracing, structured logging).

• Strong Python (and/or Go); experience optimising GPU workloads for AI compute.

• Strong written and verbal English; comfortable collaborating in a distributed team.

Nice to Have

• Azure OpenAI and hosted LLM operations at scale; vector databases and RAG infrastructure.

• Policy-as-code (OPA / Gatekeeper, tfsec, Checkov); progressive delivery (Argo Rollouts, Flagger).

• Compliance experience (SOC 2, ISO 27001) in legal or regulatory data contexts.

#LI-RT1

About BRG

BRG combines world-leading academic credentials with world-tested business expertise and purpose-built emerging technologies. Our culture centers on agility and connectivity which sets us apart and gets you ahead.

At BRG, our professionals include specialist consultants, industry experts, renowned academics, and leading-edge data scientists. Together, they bring a diversity of real-world experience, data, and human and artificial intelligence, to economics, disputes, and investigations; corporate finance; and performance improvement services that address the most complex challenges facing organizations across the globe.

Our unique structure nurtures the interdisciplinary relationships that give us the edge, laying the groundwork for more informed insights and more original, incisive thinking.  When paired with our global reach and resources, our diverse perspectives and technical capabilities make us uniquely capable to address our clients’ challenges. We get results because we know how to apply our thinking to your world.

At BRG, we don’t just show you what’s possible. We’re built to help you make it happen.

BRG is proud to be an Equal Opportunity Employer. Our hiring practices provide equal opportunity for employment without regard to race, religion, color, sex, gender, national origin, age, United States military veteran status, ancestry, sexual orientation, marital status, family structure, medical condition including genetic characteristics or information, veteran status, or mental or physical disability so long as the essential functions of the job can be performed with or without reasonable accommodation, or any other protected category under federal, state, or local law.