Senior Data Engineer (Azure Databricks Specialist)

We are looking for an experienced and highly skilled Senior Data Engineer to lead the establishment of our client’s modern data platform on Databricks within an Azure environment. In this role, you will be a key player in their BI team, responsible for building a scalable Lakehouse architecture and leading significant migration processes of business logic and data models from legacy systems (SAP BW and SSIS) to the cloud.

Responsibilities

• Design, develop, and maintain end-to-end data pipelines in Databricks using PySpark and SQL.

• Lead the migration of data processes and models from legacy systems (such as SAP BW and SSIS) to a Medallion (Bronze/Silver/Gold) architecture in the cloud.

• Build and optimize data layers to ensure high-performance delivery for BI tools: Qlik and Power BI.

• Integrate data from diverse sources, including SAP, MS SQL Server, and Salesforce.

• Implement Data Governance, security standards, and access management using Unity Catalog.

• Perform performance tuning and cost optimization for Databricks clusters and jobs.

Requirements

Technical Experience:

• At least 3 years of hands-on experience with Databricks – profound knowledge of Spark (PySpark/SQL), Delta Lake, and performance tuning. (Mandatory)

• Proven experience working within the Azure ecosystem (Azure Data Factory, ADLS Gen2). (Mandatory)

• High-level proficiency in Python and SQL.

Significant Advantages:

• Familiarity with data sources: MS SQL Server and Salesforce

• Experience working with SAP systems (S4/HANA preferred).

• Familiarity with SAP BW (understanding objects and models for migration purposes).

• Familiarity with SSIS processes and the ability to translate existing logic into Spark code.

• Relevant certifications (e.g., Databricks Data Engineer Associate\Professional).

Skills & Languages:

• High-level English proficiency (Written and Verbal) – Mandatory for technical documentation and communication with global interfaces.

• Deep understanding of data modeling (Dimensional Modeling) and interfacing with BI visualization tools (Qlik / Power BI).

• Ability to work independently in a fast-paced technological environment and lead technical projects from inception to completion.

We offer

• Long-term employment with competitive compensation, based on experience.

• Possibility to work remotely.

• An open, transparent and fun work culture.

• Multi-national team and collaborative work environment.

• Continuous knowledge sharing with engaged co-workers.

• Career and professional growth opportunities.