← Back to AI Engineer Jobs
Ladders logo

Senior AI Engineer (Production Agentic & RAG Systems)

Ladders

🇺🇸New York, US

For our client, we are seeking a Senior AI Engineer (production Agentic & RAG Systems) to join the team of a leader in the Technical Services space. This role will lead work at the intersection of data, AI-enabled capabilities, and scalable technology delivery. You will work across engineering, product, operations, and business stakeholders to translate complex requirements into practical technology solutions. The position offers the opportunity to influence architecture, execution quality, and the technology capabilities that enable long-term growth within a Technical Services environment.

Location: Remote - US based candidates only, no visa sponsorship available

Compensation: $130,000 – $180,000 annually

Responsibilities

  • Design agent orchestration in LangGraph / LangChain or similar
  • Build end-to-end production RAG: chunking, embeddings, vector stores
  • Own development of Python/FastAPI services with streaming and error contracts
  • Instrument for tracing and evaluation of ML performance metrics
  • Ship applications using Docker + Kubernetes through CI/CD pipelines
  • Drive cost engineering for LLM: model routing and prompt optimization
  • Collaborate with data engineering on semantic layers and pipelines

Qualifications

  • 5+ years in software engineering; 2+ years in production LLM/agentic systems
  • Proficient in Python and FastAPI (async, REST, SSE)
  • Production expertise in LangChain/LangGraph or equivalent
  • Experience with RAG: embeddings, chunking, hybrid retrieval
  • Familiarity with Kubernetes and Docker in production environments
  • Knowledge of major LLM providers in production, preferably AWS Bedrock
  • Strong English communication skills; able to lead design discussions

Benefits

  • Work in a hands-on engineering role with real user impact
  • Contribute to cutting-edge AI and GenAI technologies
  • Gain experience in deploying scalable production systems
  • Opportunity for end-to-end ownership of complex projects

Our client is an equal opportunity employer. We encourage you to apply even if you don’t meet every qualification—your background could be exactly what this team needs.

Apply on linkedinVisit company →

More ai engineer jobs roles

  • Sr. Applied AI EngineerChatGPT Jobs · New York, NY, US→
  • Senior AI EngineerKarbon Business · Bengaluru, Karnataka, India→
  • AI EngineerLG Electronics · Seoul, KR→
  • Senior Data & AI Engineer (w/m/d)Capgemini · Paris, FR→
  • AI Engineer (m/f/d)Kuehne+Nagel · Schindellegi, CH→
  • Senior AI Engineer - PythonRECRUITERS · Dublin, IE→
  • AI ENGINEERLITIT · Vilnius, LT→
  • Generative AI EngineerJuicyLemons · San Francisco Bay Area→
View all ai engineer jobs roles →

Don't miss the next ai engineer jobs role

Set up an alert and we'll email you matching openings. No spam, unsubscribe anytime.

Double opt-in: we'll email you a link to confirm. No spam, unsubscribe anytime.