Job Description
Responsibilities
- Design and build AI-powered features including eval frameworks and prompt optimization
- Develop LLM-as-judge pipelines for automated quality assessment
- Build and maintain model routing, caching, and fallback systems
- Experiment with new model capabilities and translate them into product features
- Collaborate with customers to understand AI workflow pain points and build solutions
Minimum Qualifications
- Strong software engineering skills with Python and TypeScript
- Hands-on experience building with LLMs in production (not just prototypes)
- Deep understanding of prompt engineering, eval methodologies, and model behavior
- Willingness to work in person in Bay Area, CA
Preferred Qualifications
- Experience with fine-tuning, RAG, or agent frameworks
- Background in ML infrastructure or MLOps
- Familiarity with observability systems or developer tools
- Contributions to open-source AI/ML projects
Apply for this role
Email [email protected] with the following:
- Your resume
- A cover letter explaining why you're interested and what you'd bring
- Links to your LinkedIn, GitHub, or personal website (if applicable)
- A project you have built using Respan (Keywords AI)
- Your Respan organization ID
Send application
Looking for more opportunities?
Browse thousands of graduate jobs and entry-level positions.