Jobiglo

No results.

Data Engineer – Service & Support Data Lake

SAP · Shanghai

Mid 🇬🇧 English
Python pandas pytest SQL Spark PySpark CI/CD integration testing monitoring logging alerting

Job description

About the role

As a Data Engineer on SAP's Service & Support Data Lake team, you will modernize data engineering capabilities that power AI‑driven customer support services. You will work in a collaborative environment to transform isolated pipelines into a unified, intelligent analytics platform.

Key responsibilities

  • Design, build and maintain scalable real‑time and batch data pipelines with clear architecture and high quality standards.
  • Write production‑grade Python code (pandas, pytest) and Spark/PySpark transformations, ensuring strong testing discipline and modular design.
  • Troubleshoot complex data issues end‑to‑end, including root‑cause analysis, performance bottlenecks and reliability incidents.
  • Implement anonymization and PII controls in line with governance requirements.
  • Develop metadata pipelines for schema profiling, business context extraction and lineage tracking.
  • Contribute to semantic layers that map technical fields to business terminology for self‑service analytics.
  • Establish monitoring, alerting and data‑quality controls to ensure secure, reliable analytical assets.
  • Partner with the Tech Lead and Architect to translate requirements into production‑ready systems.

Required profile

  • Bachelor's degree or equivalent practical experience.
  • 3+ years of professional experience coding in Python and SQL.
  • 3+ years of experience with Spark / PySpark, including performance optimisation.
  • 3+ years designing, deploying and operating high‑volume data pipelines.
  • Strong software‑engineering fundamentals: clean code, modular design, version control and documentation.
  • Hands‑on experience with unit/integration testing, CI/CD pipelines and on‑call support.

Required skills

  • Python (pandas, pytest)
  • SQL
  • Apache Spark / PySpark
  • Data pipeline design and orchestration
  • CI/CD tools and Git
  • Unit and integration testing
  • Monitoring, logging and alerting

What we offer

  • Continuous learning and skill growth opportunities
  • Comprehensive benefits package
  • Supportive team culture focused on wellbeing and inclusion

Questions fréquentes

Le salaire n'est pas communiqué publiquement par le recruteur. Vous pouvez postuler et négocier directement avec SAP.
Cliquez sur "Postuler maintenant" en haut de la page. Vous pouvez importer votre CV en 1 clic — Jobiglo extrait automatiquement vos informations et postule pour vous.

Why are you reporting this job?

Thank you for your report. We will review this job.

Explore further

Salaries, guides and searches in China.

Apply in 30 seconds

Enter your email to apply. An account will be created automatically.

By continuing, you accept our terms of use.

Already have an account? Login

💬 Chat with us on Telegram Chat on WhatsApp

Published 1 month ago

Expires 1 week from now

35 views · 0 interested

Boost your chances

Upload your CV — we will match you with relevant openings.

Analyzing your CV...

SAP

Shanghai