AI Application & Prompt Specialist
harting
Job Description
Design, build and productionize internal AI solutions that combine strong prompting/LLM experience with production-grade Python engineering, agent orchestration, and secure enterprise integrations. Deliver reusable frameworks, observability, and guardrails so business teams can adopt LLM-enabled features safely and reliably.Build reusable SDKs, libraries and microservices for LLM integrations (prompt templates, prompt chaining, tool calling, caching, retry & backoff logic)
Architect and implement multi-agent orchestration and workflow systems using LangGraph and/or LangChain patterns to support supervisor/worker and tool-calling agent designs
Implement secure RAG pipelines: document ingestion, chunking strategies, embeddings, vector DB integration (Qdrant, OpenSearch, FAISS-style stores) and retrieval tuning
Write production Python code (APIs, async messaging, WebSockets, background workers) to integrate LLMs (cloud-hosted or private) and vector stores; package services with containers and CI/CD
Deploy and operate LLM components on cloud platforms (AWS + Bedrock or equivalent; familiarity with Azure OpenAI is a plus) and manage secrets/OAuth2 and RBAC integrations
Define and run systematic prompt evaluation and monitoring (accuracy, hallucination, cost-per-response); implement guardrails and automated tests for prompt suites (unit tests, A/B experiments)
Integrate AI features with enterprise systems (ServiceNow, SAP SuccessFactors, internal HR/ERP systems) to enable end-to-end workflows (ticket creation, approvals, data updates)
Implement observability/alerting (latency, throughput, cost, drift, hallucination rates) and incident handling; produce runbooks and monitoring dashboards
Collaborate with product, legal, security and domain experts to ensure privacy, compliance and acceptable use; implement technical controls (input redaction, auditing, access controls)
Document patterns, run enablement sessions and deliver onboarding materials for internal developers and business users