Job Description & Details
This is a hands-on backend role where you'll be building out the plumbing for real-world Generative AI applications rather than just writing experimental scripts. If you know your way around Python backend services and want to spend your days wiring up LLMs and RAG pipelines on Google Cloud, this 4-month gig is right up your alley.
What You'll Actually Be Doing
You'll spend your days designing and maintaining Python backend services that interface with LLMs and handle heavy data processing. Expect to write clean, modular code for FastAPI endpoints that deal with messy unstructured inputs like PDFs, Excel files, and text documents. You'll be knee-deep in setting up retrieval workflows, managing asynchronous jobs via Pub/Sub, and ensuring that the AI outputs don't hallucinate by implementing solid validation and retry logic.
The Core Tech Stack
You need absolute fluency in Python and FastAPI to handle the heavy async lifting and API design required here. On the AI side, deep practical knowledge of GenAI frameworks, prompt orchestration, and RAG mechanics—like chunking, embeddings, and vector retrieval—is non-negotiable. Google Cloud Platform is your playground, so you should be very comfortable spinning up Cloud Run, leveraging Vertex AI, querying BigQuery, and keeping secrets secure in Secret Manager.
Interview Expectations
Expect the hiring team to hand you a scenario where an LLM returns malformed JSON or times out under heavy load, asking you to architect a retry, fallback, and validation mechanism on the fly. They'll also likely probe deep into your RAG implementations, asking how you handle semantic chunking and metadata filtering when document retrieval accuracy starts dropping in production.
Application Advice
Skip the generic summaries and put your Python backend architecture and GCP deployment wins front and center on your resume. Make sure exact terms like FastAPI, Vertex AI, RAG pipelines, and Cloud Run appear naturally in your experience bullets to effortlessly clear the automated recruiter screens.