Applied AI Engineer

zappyhire

Bangalore 3 Years Exp Posted 1h ago

Job Description

  • Design, implement, and optimize Generative AI applications using Python and frameworks such as FastAPI. 

  • Build AI solutions using LLM frameworks like LlamaIndex and LangChain. 

  • Implement containerized deployments using Docker. 

  • Develop and optimize Retrieval-Augmented Generation (RAG) pipelines for improved information retrieval. 

  • Work with self-hosted and cloud-based vector databases for efficient search and retrieval. 

  • Design and manage knowledge graphs and graph-based RAG systems. 

  • Implement re-ranking models and retrieval optimization techniques. 

  • Apply prompt engineering and context engineering to enhance model performance. 

  • Establish guardrails to ensure safe, ethical, and compliant AI deployments. 

  • Build data preprocessing and transformation pipelines for structured and unstructured data. 

  • Perform inference using offline LLMs via platforms like Ollama or Hugging Face (Llama, Mistral). 

  • Integrate online LLM providers such as OpenAI, Anthropic, or GCP for real-time inference. 

  • Monitor AI workflows using observability tools like MLflow or Arize Phoenix. 

  • Evaluate model performance using frameworks such as TruLens or custom-built evaluation systems. 

  • Continuously improve AI systems based on evaluation insights, metrics, and user feedback. 

Skills for a Generative AI Engineer:

  • Experience building Generative AI applications using Python and FastAPI. 

  • Hands-on knowledge of LLM frameworks such as LangChain or LlamaIndex. 

  • Ability to work with unstructured data (PDFs, documents, chunking, search) and structured data. 

  • Experience designing RAG-based systems, including prompt engineering and retrieval optimization. 

  • Familiarity with vector databases (Qdrant, Pinecone, Weaviate) and search solutions. 

  • Exposure to AI agents, workflows, and basic orchestration concepts. 

  • Experience using cloud platforms like Azure or AWS. 

  • Working knowledge of online and offline LLMs (OpenAI, Llama, Mistral). 

  • Understanding of AI evaluation, monitoring, and observability concepts. 

  • Experience with Docker and CI/CD pipelines for deploying AI applications. 

Good to Have: 

  • Experience with MCP clients and servers 

  • Knowledge of multimodal LLMs for image and voice processing 

  • Knowledge of deploying applications in cloud or on-prem infrastructure 

  • Knowledge of fine-tuning techniques and data preparation for fine-tuning 

Qualifications: 

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field 

  • Proven experience in AI/ML engineering and related technologies 

  • 3+ years of experience building applications using Python and asynchronous programming 

  • Experience working with SQL and NoSQL databases 

  • Strong problem-solving skills and ability to work in a fast-paced environment 

    • Excellent communication and teamwork skills