AI Infrastructure Engineer
kkr
Job Description
- Design and operate the model training, fine-tuning, and inference infrastructure that supports KKR's enterprise AI applications.
- Build deployment pipelines for LLMs and classical ML models across batch, real-time, and streaming workloads.
- Drive inference optimization across accelerator types (GPU/TPU and equivalents) and support custom fine-tuning workflows.
- Stand up evaluation, monitoring, alerting, and rollback systems for models running in production.
- Partner closely with AI Engineering teams to remove infrastructure friction and accelerate the path from experimentation to deployment.
- Establish best practices for model versioning, artifact management, reproducibility, and responsible AI deployment in a regulated financial services environment.
- Contribute to the long-term AI platform roadmap, ensuring KKR's infrastructure scales with the firm's growing AI ambitions.