Senior Data Engineer
Our client is a specialized consultancy for statistics, data science, and AI. They work across various industries—including the public sector, insurance companies, and other data-intensive sectors. They are specifically seeking to expand our team for our public sector projects.
There, they develop solutions that are not only technically sophisticated but also have a tangible positive impact on society. They are looking for strong Senior Data Engineers who are not deterred by complex problems but are drawn to them—and who want to build systems that truly make a difference.
Your role
Do you want to do more than just manage existing data infrastructures? Do you want to strategically lead data engineering projects and help shape sustainable data platforms from the ground up? Do you think in terms of data architecture, scalability, quality, security, and operational excellence—and do you want to make a visible difference with your work in the public sector? Then you've come to the right place.
As a Senior Data Engineer, you will assume technical responsibility for the data engineering area: from architecture and fundamental technical decisions through design and implementation to operation, monitoring, and continuous optimization of data pipelines and data platforms. You will develop robust, scalable data solutions that not only work today but are also maintainable in the long term and can withstand productive use.
Responsibilities:
-
Lead the data engineering topics in the project, drive strategic decisions and assume overall responsibility for this area.
-
Design, develop, maintain and optimize ETL/ELT pipelines.
-
Ensure that data pipelines remain scalable, maintainable, and as lean as possible, even with growing data volumes and an increasing number of data sources.
-
Define and establish standards and best practices for pipeline design, testing, monitoring, operation and performance.
-
Review changes to data pipelines and data architecture and ensure compliance with quality standards.
-
Hands-on experience working with the Cloudera/Apache stack and modern data stack technologies.
-
Ensure data quality, access control, data protection and data security throughout the entire data lifecycle.
Requirements:
-
Several years of solid experience in data engineering and in a leading technical role.
-
Proven experience in the design and implementation of scalable ETL/ELT pipelines.
-
Experience with batch and streaming data pipelines.
-
Practical experience with modern data stack tools such as dbt and S3/Object Storage.
-
Excellent understanding of data architecture, scalability, maintainability, and data engineering best practices.
-
Excellent SQL skills and good programming skills, ideally in Python and/or Java.
-
Experience with code reviews, the establishment of engineering standards, and performance optimization.
-
A high sense of responsibility and the ability to independently manage and implement technical projects.
-
Experience in developing customized data pipelines from scratch, even without the use of pre-built frameworks or special cloud functionalities.
-
Demonstrable experience in processing different data formats, e.g., tabular data, JSON, texts, images or other formats.
-
Experience in handling confidential, security-critical and personal data.
-
Good knowledge of Cloudera tooling and the Apache ecosystem is advantageous, but not a mandatory requirement.
-
Excellent German and English skills for collaboration within the team and with stakeholders.
We offer:
-
Long-term employment with competitive compensation, based on experience.
-
Possibility to work remotely.
-
An open, transparent and fun work culture.
-
Multi-national team and collaborative work environment.
-
Continuous knowledge sharing with engaged co-workers.
-
Career and professional growth opportunities.