Data & AI Engineer
webbtree
Job Description
• Design, build and optimise large-scale search/retrieval pipelines using OpenSearch / Elasticsearch.
• Work with keyword, vector, semantic and hybrid search; embeddings, ranking, relevance and filtering.
• Design scalable MySQL data models, schemas, indexes and queries; optimise database performance.
• Build ingestion, transformation, indexing/re-indexing and data pipelines supporting AI, analytics and reporting.
• Build BI-ready datasets and Tableau dashboards; ensure data quality and consistency.
• Experiment with and evaluate embeddings, rerankers, LLMs and ML models using accuracy, relevance, latency and cost.
• Build LLM/GenAI workflows using LangChain and Langfuse; support tracing, observability and evaluation.
• Take AI/data experiments from POC → production with backend and product teams; optimise latency, throughput, reliability and cost.
• Work with AWS infrastructure including OpenSearch, S3, EC2 and RDS.