AI Software Engineer (Python, LLM, RAG)

AI Software Engineer (Python, LLM, RAG)

Prestigious Global Financial Organization \| New York, NY (Onsite 3-4 days/week)

Most AI engineering jobs are demos and prototypes. This one ships. Our client, a world-class organization whose work spans professional information services and global philanthropy, is building AI into the tools thousands of professionals rely on every day, and they need an engineer who can take LLM-powered features from idea to production.

The Role

You'll design, build, and ship AI-powered applications end to end: working with large language models, building the pipelines and services around them, and partnering directly with business teams to turn real problems into working products. This is a hands-on software engineering role first — AI is the toolkit, shipping is the job.

You'll get rare range here: use cases across legal and policy intelligence, research, and mission-driven programs, with the resources of a world-class technology organization behind you.

What You'll Need

• Strong software engineering fundamentals — Python, APIs, production services
• Hands-on experience building with LLMs: RAG pipelines, prompt engineering, embeddings, agents
• Experience taking AI features to production, not just proof of concept
• Comfort working directly with non-technical stakeholders to shape use cases
• NYC-based, onsite 3-4 days a week

Bonus Points

• Cloud AI platforms (Azure OpenAI, AWS Bedrock, Vertex AI)
• Vector databases, orchestration frameworks (LangChain, LlamaIndex, or similar)
• Data engineering or MLOps background

Why This Role

AI roles this hands-on, with this much organizational backing and this little bureaucracy, are rare. You'll see your work used by real professionals within weeks, not quarters, and you'll be early on a team that's defining how one of the world's most respected organizations uses AI.