AI ML Python Developer

Design and develop scalable backend services and REST APIs using Python, FastAPI/Flask/Django.

Build and integrate Generative AI/LLM-based applications, including RAG, AI agents, embeddings, and tool/function calling.

Work with Azure OpenAI and other LLM providers.

Use AI frameworks such as LangChain, LlamaIndex, LangGraph, or similar.

Implement LiteLLM for LLM gateway, routing, fallback, and usage/cost management.

Implement rate limiting, throttling, caching, retries, and API quotas for scalable services.

Use Langfuse for LLM observability, tracing, prompt management, token/cost tracking, and evaluation.

Design and work with PostgreSQL/MySQL, MongoDB, and Redis.

Deploy and manage applications using Microsoft Azure, Docker, and CI/CD.

Develop unit/integration tests, troubleshoot production issues, and optimize performance and cost.

• Participate in system design, code reviews, and technical architecture discussions.