AI Inference Engineer QVAC

Accountabilities

In this role, you will be responsible for designing, optimizing, and maintaining the inference layer that enables high-performance AI execution on edge devices. You will ensure systems are robust, efficient, and scalable across diverse hardware environments.

• Develop and optimize C++-based inference systems for deploying AI models on edge devices.

• Enhance and adapt inference engines such as llama.cpp, ggml, and ONNX for improved performance and compatibility.

• Improve runtime efficiency, focusing on memory usage, latency, throughput, and long-session stability.

• Collaborate with research teams to transition models from experimentation to production-ready deployments.

• Define and maintain core abstractions that support scalable and maintainable inference capabilities.

• Integrate AI-driven features into existing products, ensuring seamless performance and reliability.

• Continuously evaluate and implement new technologies to improve system capabilities and efficiency.

Requirements

You are a highly skilled engineer with a strong foundation in systems programming and machine learning, capable of working on complex, performance-critical AI infrastructure.

• Strong programming expertise in C++, with additional experience in JavaScript considered a plus.

• Proven experience with inference frameworks such as llama.cpp, ggml, ONNX, or similar technologies.

• Solid understanding of deep learning concepts, including transformers, LLMs, and diffusion models.

• Experience deploying and optimizing machine learning models on edge devices or constrained environments.

• Ability to quickly learn and apply new technologies in a fast-evolving AI landscape.

• Strong problem-solving skills with attention to performance, scalability, and reliability.

• Degree in Computer Science, AI, Machine Learning, or a related field, or equivalent practical experience.

Benefits

• Fully remote, globally distributed work environment

• Opportunity to work on cutting-edge AI and decentralized technologies

• High ownership and impact on core product infrastructure

• Collaboration with top talent in AI, systems engineering, and fintech

• Dynamic, fast-paced environment focused on innovation and experimentation

• Exposure to advanced AI frameworks and next-generation product development

• Competitive compensation aligned with experience and expertise

How Jobgether works:
We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.
We appreciate your interest and wish you the best!
 Why Apply Through Jobgether?

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.

#LI-CL1