Senior AI Engineer
TLDR
Design, build, and productionize end-to-end agent workflows with LLMs, focusing on orchestration, evaluation, and reliability.
Position Summary
We’re hiring a product-oriented Senior AI Engineer who loves tinkering with LLMs and shipping real agent systems. We spend less time on fine-tuning and more on orchestration, evaluation, and reliability—so agents do real work safely, quickly, and repeatedly.
What we’re looking for
Agentic systems: Function/tool calling, multi-step planning, routing, memory, and retrieval.
Engineering first: You can wire up services, craft eval harnesses, and debug latency/cost at scale.
LLM breadth: Comfortable comparing models/hosts, prompt strategies, and guardrail techniques.
Product focus: You instrument outcomes, run A/Bs, and iterate to improve task success rates.
Opinionated: Deep level of understanding of the technological landscape, making both high level system and granular code design decisions based on understanding rather than preference - diving deep on unknown patterns in order to build the best product.
Responsibilities
Design, build, and productionize agent workflows end-to-end (APIs, tools, evals, monitoring).
Create safety, cost, and latency controls; build dashboards and alerts for reliability.
Partner with product/design to invent new interaction patterns and ship them fast.
Document patterns and mentor engineers on best practices for LLM-powered features.
Nice to have
Experience with workflow engines (e.g., Temporal), comfort in full stack engineering
Logistics:
Compensation: $190K - $250K salary, competitive equity (4 year vest)
Location: New York City. We are a fully in-office team working out of Midtown Manhattan Monday through Friday. We allow for WFH days when anyone is traveling, but we do not allow for permanent remote work.
Benefits:
Generous health, dental, and vision insurance
401k with 3% automatic contribution (no vesting)
Paid Lunches
Wellness and Citi Bike benefit
Unlimited PTO
Benefits
Equity Compensation
competitive equity (4 year vest)
Health Insurance
Generous health, dental, and vision insurance
Paid Time Off
Unlimited PTO
Wellness Stipend
Wellness and Citi Bike benefit
Raylu AI is an AI-native deal origination platform tailored for private markets, including Growth Equity, Venture Capital, and Private Equity. It enhances the sourcing process for investors by delivering accurate and insightful deal opportunities, utilized by over 50 funds managing more than $500 billion in assets.