Machine Learning Engineer, AI Labs
TLDR
Design and optimize enterprise-scale LLM serving infrastructure using vLLM, SGLang, and KV Cache optimization for production-grade AI systems.
Join the Future of Security at Netskope
Netskope (NASDAQ: NTSK) is a leader in modern security and networking for the cloud and AI era. We secure and accelerate cloud, data, and AI in real time, everywhere. Thousands of customers, including more than 30 of the Fortune 100, trust the Netskope One platform, its Zero Trust Engine, and the powerful NewEdge network to gain full visibility and control without performance trade-offs.
At Netskope, our technology is driven by our greatest strength: our people. We believe that belonging powers innovation, and success is both personal and organizational. We embrace differences in gender, ethnicity, beliefs, ability, and identity, creating an environment where every voice is heard and respected. We empower our employees to bring their authentic selves to work, grow their careers through continuous education and mentorship, and lead with transparency and curiosity. Join a team where you belong, where you are encouraged to be an entrepreneur, and where together, we continue to redefine the landscape of security.
Visit Careers at Netskope to learn more. Follow us on LinkedIn and Instagram.
About Netskope & AI Labs
Within Netskope Engineering, Netskope AI Labs is the powerhouse advancing state-of-the-art artificial intelligence (AI) and machine learning (ML) to protect the modern enterprise. We build the intelligence behind the Netskope Intelligent Security Service Edge (SSE) platform.
We are seeking a high-caliber Machine Learning Engineer to help us build, optimize, and deploy enterprise-scale AI solutions. Working closely with senior architects, you will directly influence our Secure Access Service Edge (SASE) architecture, turning cutting-edge AI research into production-grade reality.
Note on Leveling: We believe great talent doesn't always fit into a rigid box. Candidates are assessed individually and leveled (from mid to senior) according to their specific skills, background, and technical depth.
What’s in it for You?
- High-Impact Ownership: You aren't just maintaining pipelines; you are playing a critical role in the AI transformation of a market-leading cloud security company.
- Cutting-Edge Stack: Work on the bleeding edge of LLM inference optimization, utilizing tools like vLLM, SGLang, and advanced KV Cache optimization.
- Elite Collaboration: Work alongside top-tier engineers, researchers, and ML scientists to solve the industry’s toughest challenges in latency, throughput, and cloud security.
What You Will Do
- Collaborate on the AI Roadmap: Play a key role alongside senior architects and team members in driving the execution of critical AI/ML technical strategies, building highly scalable, reliable, and production-grade systems.
- Architect High-Performance Inference Systems: Design, optimize, and deploy enterprise-scale LLM serving infrastructures. You will push the boundaries of throughput and latency.
- Own the End-to-End AI Lifecycle: Partner closely with ML scientists and product stakeholders to translate complex business requirements into elegant, deployed code.
- Enforce AI Excellence: Implement and scale strict "Report Cards" for production models, tracking real-world accuracy, latency, and security relevance.
What You Bring
- Industry Experience: 10+ years of overall experience in software engineering and product development, with a specialized focus in one of two tracks:
- The AI/ML Focus: 2+ years of production experience developing, optimizing, and deploying AI/ML solutions (or an equivalent blend of an advanced technical degree + hands-on experience).
- The Distributed Systems Focus: 6+ years of deep experience architecting, building, and scaling high-performance distributed systems, combined with a strong desire to apply those infrastructure skills to cutting-edge AI/LLM engineering.
- The Modern AI Stack: Direct exposure to (or a strong conceptual understanding of) optimizing LLMs in production. Familiarity with high-throughput inference frameworks (e.g., vLLM, SGLang, TensorRT-LLM) and memory management techniques like KV Cache optimization is a massive plus.
- Clear Communication: The ability to distill complex technical architecture or infrastructure bottlenecks into clear, actionable concepts for cross-functional teams.
- The Startup Mindset: You are an energetic self-starter who thrives in fast-paced, dynamic environments and isn't afraid to wear multiple hats to get a product across the finish line.
Education
- BSCS or equivalent required, MSCS or equivalent strongly preferred.
Compensation:
At Netskope, salary is one component of our competitive total rewards package. The salary range for this position is as listed below. This is a national range. For purposes of complying with applicable laws, the range applies to candidates in California, Colorado, Illinois, Maryland, New York, Washington, and other states.
The successful candidate’s starting pay will also be determined based on job-related skills, experience, qualifications, location, and market conditions.
For all sales roles, the posted salary range is the On Target Earnings (OTE) range for the role, which is the sum of base salary and target commission amount at 100% goal achievement.
In addition to salary, candidates may be eligible for other forms of compensation such as participation in a bonus plan (for non-sales roles) and a stock award program. Candidates may also be eligible for a comprehensive health plan and other benefits that can be reviewed at Netskope Benefits site.
Salary Range
$128,000—$260,500 USD
Netskope is committed to implementing equal employment opportunities for all employees and applicants for employment. Netskope does not discriminate in employment opportunities or practices based on religion, race, color, sex, marital or veteran statues, age, national origin, ancestry, physical or mental disability, medical condition, sexual orientation, gender identity/expression, genetic information, pregnancy (including childbirth, lactation and related medical conditions), or any other characteristic protected by the laws or regulations of any jurisdiction in which we operate.
Netskope respects your privacy and is committed to protecting the personal information you share with us, please refer to Netskope's Privacy Policy for more details.
The application window for this position is expected to close within 50 days. You may apply by filling out the below information, or visiting our Netskope Careers site.
Benefits
Education Stipend
grow their careers through continuous education and mentorship
Health Insurance
a comprehensive health plan
Other benefits
Stock Options
a stock award program
Netskope is a cloud security company focused on redefining how organizations manage cloud, network, and data security. Targeting enterprises that require robust security solutions, Netskope stands out through its innovative approach and commitment to creating a transparent and collaborative work environment.
- Founded
- Founded 2012
- Employees
- 500+ employees
- Industry
- Internet Software & Services
- Total raised
- $1B raised