About The Role
As an AI Engineer in the United States (Remote) via Rex.zone, you will design, build, and operate ML systems that move from experimentation to production. The work includes training and fine-tuning models (including LLMs), establishing evaluation harnesses, and using RLHF-style feedback loops where appropriate.
What You Will Do
- Develop and maintain end-to-end ML pipelines for training, evaluation, and deployment
- Implement model evaluation and offline/online metrics to track model performance improvement
- Integrate human feedback and RLHF signals into training workflows when applicable
- Partner with data teams on annotation guidelines compliance, QA sampling, and error analysis
- Build prompt evaluation and regression test suites for LLM features
- Optimize inference latency, throughput, and cost for production services
- Implement monitoring, drift detection, and incident response runbooks for model behavior
Required Qualifications
- Mid-Senior experience shipping ML systems into production
- Strong Python engineering skills and familiarity with ML libraries
- Practical experience with model training, fine-tuning, and evaluation workflows
- Understanding of training data quality, labeling noise, and QA evaluation methods
- Familiarity with LLM training pipelines and prompt evaluation practices
How To Apply
Search Rex.zone for AI Engineer jobs in the United States and apply to roles that match your domain and stack.
Highlight production ML impact, evaluation methodology, and measurable reliability/performance improvements.