Job Description & Details
This role puts you at the bleeding edge of enterprise LLM deployment, moving past simple API wrappers into heavy-duty administration of platforms like M365 Copilot, Claude Enterprise, and ChatGPT Enterprise. If you enjoy wrangling connectors, managing granular access controls, and building actual automated workflows rather than just talking about AI strategy, this is a solid gig.
What You'll Actually Be Doing
You'll spend your days configuring enterprise AI environments, making sure users have the right entitlements without turning the security team into your mortal enemy. A big chunk of your time will go into developing reusable AI skills, setting up integrations with internal project tracking and document management systems, and packaging everything through proper CI/CD pipelines. You'll also partner with governance to keep the AI catalog clean and audit-ready while helping teams actually adopt these tools through enablement and training.
The Core Tech Stack
You need solid Python skills and a deep understanding of API integrations, Git workflows, and LLM platform administration. The team relies heavily on Retrieval-Augmented Generation (RAG) and connector development to bridge enterprise data platforms with tools like Microsoft Teams and custom LLM solutions. Knowing how to version-control AI skills and enforce governance standards in a regulated environment is non-negotiable here.
Interview Expectations
Expect the hiring manager to grill you on how you handle secure API integrations and data leakage risks when connecting LLMs to enterprise data stores. They are likely to ask you to design a robust RAG pipeline architecture from scratch and explain how you would troubleshoot latency or context window bottlenecks. They want to see that you think like a platform engineer who respects security, not just a scripter throwing API calls together.
Application Advice
Make sure your resume leans hard into your experience with Python, Git, and API development, explicitly calling out any enterprise platforms or connectors you have built. If you have worked in regulated industries or managed access controls and LLM governance frameworks, put those achievements right at the top. The ATS is looking for exact keyword matches around enterprise AI administration, RAG, and workflow automation, so don't leave room for guesswork.