AI Engineer II

As an AI Engineer in the Office AI team, you work to enhance Office productivity with AI-driven experiences and services across key applications. The team builds the core platforms and experiences that bring large language models (LLMs) and realtime intelligence into Office apps. These platforms are key components of Microsoft Copilot, combining the power of large language models with enterprise data and native integration with Office apps to streamline productivity, including content generation, navigation, comprehension and more.

We are looking for a creative AI Engineer who will collaborate with software engineers, researchers, and product managers to express product needs as well defined machine learning problems, push the state of the art in LLMs and bring prototypes all the way to planet scale production. You’ll build the engineering that makes AI work in production: you will build APIs, platforms and services around AI features; design data pipelines and feedback loops; deploy and finetune state of the art deep learning models; orchestrate prompts and tools; and monitor AI specific signals—such as drift, hallucinations, safety and cost—alongside traditional service reliability metrics.

Join us to empower people through AI, bringing cutting edge deep learning into everyday work at scale. At Microsoft, our mission is to empower every person and every organization to achieve more; we show up with a growth mindset, innovate to empower others, and collaborate to realize shared goals. Rooted in respect, integrity, and accountability, we foster an inclusive culture where everyone can thrive. If you are passionate about applying state of the art AI to positively impact millions, this role is for you.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

• Ship features with PM & Engineering. Co own scenario goals; translate product requirements into scientific plans and productionized solutions that meet quality/latency/cost targets.
• Generative AI and advanced technologies. Apply knowledge of generative AI, large language models, and modern frameworks to develop intelligent features and automation within the service.
• Azure platform integration. Deploy, integrate, and manage AI powered solutions within the Azure ecosystem, ensuring security, scalability, and compliance with best practices.
• Continuous learning and mentoring. Stay current with advances in generative AI and software engineering. Invest time in learning new tools and frameworks, propose improvements to build processes, and share knowledge with colleagues.

• Master’s degree in computer science or related field.
• 1 + years of experience designing and running infrastructure systems that operate globally on a large scale.
• Experience deploying AI models into production environments and building systems that monitor and retrain models automatically.
• Passion for mentoring others and contributing to an inclusive team culture.
• Distributed systems and cloud. Familiarity with Azure services, microservices architectures, and distributed storage systems (experience with Cosmos DB or similar is a plus). Ability to design and run fault tolerant infrastructure on a large scale and to implement secure, compliant solutions.
• AI and machine learning skills. Handson experience with generative AI or machine learning frameworks (e.g., PyTorch, TensorFlow, Hugging Face) and a solid understanding of LLM concepts, embeddings, and prompt engineering.