Data Engineer – Service & Support Data Lake
SAP · Shanghai
Job description
About the role
As a Data Engineer on SAP's Service & Support Data Lake team, you will modernize data engineering capabilities that power AI‑driven customer support services. You will work in a collaborative environment to transform isolated pipelines into a unified, intelligent analytics platform.
Key responsibilities
- Design, build and maintain scalable real‑time and batch data pipelines with clear architecture and high quality standards.
- Write production‑grade Python code (pandas, pytest) and Spark/PySpark transformations, ensuring strong testing discipline and modular design.
- Troubleshoot complex data issues end‑to‑end, including root‑cause analysis, performance bottlenecks and reliability incidents.
- Implement anonymization and PII controls in line with governance requirements.
- Develop metadata pipelines for schema profiling, business context extraction and lineage tracking.
- Contribute to semantic layers that map technical fields to business terminology for self‑service analytics.
- Establish monitoring, alerting and data‑quality controls to ensure secure, reliable analytical assets.
- Partner with the Tech Lead and Architect to translate requirements into production‑ready systems.
Required profile
- Bachelor's degree or equivalent practical experience.
- 3+ years of professional experience coding in Python and SQL.
- 3+ years of experience with Spark / PySpark, including performance optimisation.
- 3+ years designing, deploying and operating high‑volume data pipelines.
- Strong software‑engineering fundamentals: clean code, modular design, version control and documentation.
- Hands‑on experience with unit/integration testing, CI/CD pipelines and on‑call support.
Required skills
- Python (pandas, pytest)
- SQL
- Apache Spark / PySpark
- Data pipeline design and orchestration
- CI/CD tools and Git
- Unit and integration testing
- Monitoring, logging and alerting
What we offer
- Continuous learning and skill growth opportunities
- Comprehensive benefits package
- Supportive team culture focused on wellbeing and inclusion
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in China.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
Published 1 month ago
Expires 1 week from now
35 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
SAP
Shanghai