AI Solution Architect

About the role

Roche is looking for an AI Solution Architect in Shanghai to turn cutting-edge AI capabilities into real-world healthcare solutions. You will lead the end-to-end design, development and iterative improvement of the AI infrastructure, platform and application layers, keeping everything within enterprise security and compliance standards. The role blends enterprise system design, platform engineering and agile delivery with deep AI expertise.

Key responsibilities

• Design, build and manage Kubernetes clusters, MLOps and LLMOps platforms, and AI gateways and governance frameworks
• Architect and deliver scalable AI and agentic applications, microservices and backend systems, and lead engineering teams
• Plan and harden AI infrastructure, including GPU servers, storage, networks and Linux toolchains, and automate infrastructure with IaC
• Manage large-scale projects with Agile and Scrum, and author architectural documentation and technical knowledge bases

Required profile

• 10+ years as a Solution Architect, with at least 2+ years in AI architecture or AI platform design
• Fluent English and Mandarin
• Experience in pharma, life sciences or top-tier tech is highly preferred; GxP architecture experience is highly preferred
• Proven track record of leading large-scale AI platforms and mentoring teams

Required skills

• Kubernetes, MLOps and LLMOps (Kubeflow, MLflow, Databricks)
• LangChain, LangGraph, RAG, vector and graph databases
• Terraform, Ansible, Packer, CloudFormation, GitLab CI/CD, JFrog
• Linux (RHEL/CentOS), Python or Go, Prometheus, Grafana, OpenTelemetry, ELK
• RDMA networks, GPU hardware and storage (NAS/SAN)