# Machine Learning Engineer Lead — Compunnel

- Location: Raleigh, NC
- Posted: Oct 19, 2026
- Status: open (checked Nov 21, 2026)
- Apply (employer's site): https://staffline.compunnel.com/Support/UploadResume?JobId=yLcjuJF9v9UDKkV86O9Oyw%3d%3d&Source=4414&EntityGroup=2321
- Employer record: https://visajobs.io/company/compunnel-software-group.md

## Sponsorship history
- Tier: Strong history
- Occupation (SOC): Software Developers (15-1252)
- Employer's certified LCAs for this occupation in NC, FY2024–FY2026: 369
- …in the whole US: 3,011
- With this exact title: 0
- Median DOL prevailing wage, level I / II: $91k / $112k
- Staffing / consulting firm: 98% of its H-1B applications place workers at client sites (FY2024–FY2026)

## Description
Job Summary
The Machine Learning Engineer Lead will define and lead the architecture of scalable AI/ML and agentic systems across the global product portfolio. This senior technical leadership role will focus on large-scale distributed ML systems, LLM and RAG architectures, Agentic AI frameworks, tool orchestration, and enterprise platform engineering. The role will shape long-term AI platform strategy, establish technical standards, and mentor engineering teams while supporting highly available, secure, and scalable AI systems.
Key Responsibilities
• Define reference architectures for LLM, machine learning, and agent-based systems across products.
• Design high-availability and low-latency inference platforms capable of operating at global scale.
• Establish reusable platform components for model lifecycle management, deployment, monitoring, and operationalization.
• Architect scalable AI platforms supporting large-scale distributed ML systems and enterprise AI workloads.
• Architect multi-step, reasoning-driven agentic AI systems.
• Design orchestration patterns for tool use, API invocation, and structured function calling.
• Lead the implementation and governance of Model Context Protocol (MCP) servers to standardize tool integration and context management.
• Define guardrails, permissions, security controls, and audit mechanisms for enterprise-safe AI systems.
• Establish and maintain best practices for MLOps, CI/CD, observability, scalability, and system reliability.
• Design and implement scalable inference systems using containerization and Kubernetes.
• Drive the deployment and optimization of LLM, Generative AI, and RAG solutions in production environments.
• Design cloud-based AI/ML architectures across AWS, Azure, or GCP.
• Establish technical standards and architectural patterns for AI/ML and agentic systems across engineering teams.
• Embed Responsible AI principles into platform architecture and engineering practices.
• Provide technical leadership, mentorship, and guidance to senior engineers and engineering teams.
• Collaborate with cross-functional teams to influence technical direction and ensure alignment with enterprise AI platform strategy.
• Support people management, leadership, and team development activities as required.
Required Qualifications
• 10+ years of experience building and deploying production-grade machine learning systems at scale.
• Strong experience with LLMs, Generative AI, and RAG deployments in production environments.
• Strong Python development background.
• Expertise designing and implementing AI/ML systems in cloud environments such as AWS, Azure, or GCP.
• Hands-on experience with Kubernetes, containerization, and scalable inference systems.
• Experience designing agentic AI systems and tool orchestration frameworks.
• Experience implementing and governing MCP servers or structured architectures for tool integration and context management.
• Experience with large-scale distributed ML systems and enterprise platform engineering.
• Experience establishing MLOps, CI/CD, observability, and system reliability practices.
• Demonstrated people management, technical leadership, or mentorship experience.
• Strong understanding of high-availability and low-latency AI/ML architectures.
• Ability to define technical standards and influence architecture and engineering decisions across teams.

> History, not a promise: past H-1B filings do not mean an employer will sponsor you or a given role. Data: U.S. DOL OFLC LCA disclosure (FY2024–FY2026 for role counts, certified LCAs) and the USCIS H-1B Employer Data Hub. Not legal advice. Methodology: https://visajobs.io/methodology
