Data Engineer
We are looking for a Data Engineer to join a client project in the e-commerce and lighting retail sector in Germany.
The project focuses on a pricing engine and the surrounding data platform. You will work on building analytical datasets, enriching ML features, extending rule-based fallback pricing logic, and automating the distribution of pricing outputs to downstream systems.
Key responsibilities:
-
Build and maintain production-grade data pipelines
-
Develop analytical datasets and data models
-
Enrich datasets with ML features
-
Extend and improve rule-based pricing logic
-
Automate data distribution to downstream systems
-
Develop and integrate REST APIs
-
Ensure data quality, monitoring, logging, and observability
-
Work with large-scale datasets using Spark
Requirements:
-
Strong Python and SQL skills
-
Solid experience building production-grade data pipelines
-
Hands-on experience with dbt and data modelling
-
Experience with Apache Spark and large-scale data processing
-
Experience with REST API development and integration
-
AWS experience
-
Databricks experience
-
Strong understanding of data quality, testing, monitoring, logging, and observability
Project details:
-
Industry: E-commerce / Lighting Retail
-
Engagement: Full-time
-
Duration: 6 months, with a possibility of extension.
-
Start: End of September / early October
-
Work format: Fully remote
-
Working language: English