Data Engineer (Databricks + Pyspark) in Warsaw

We have a requirement from our client Data Engineer (Databricks + Pyspark) in

Poland.

Location:

Poland

Employment Type:

B2B contract

Contract Duration:

6 months

Experience:

5+ years of experience

Work Mode:

remote, if required should visit once in a while

Good to Have Skills :

Azure-Data Architecture

Project:

Build an internal AI-based Data Modeling tool where a Data Architect can ask AI to create a model according to customer standards, review and refine it through a Databricks web application, approve it, and deploy the approved schema into Databricks Unity Catalog.

Requirements:

Databricks with pyspark,Unity catalog,GHCP,Data modelling,

Databricks Apps,Lakehouse

Postgres, Data Architecture knowledge, have worked on Databricks open solution accelerators

Roles and Responsibilities

Lead the design and development of endtoend data architecture solutions on Azure

Build and optimize data pipelines and workflows using Databricks and Azure SQL

Create and maintain dimensional data models to support analytics and reporting

Work closely with stakeholders to gather requirements and provide technical guidance

Monitor data platform performance and troubleshoot issues proactively

Mentor junior team members on Azure data services and data modeling concepts

Document architecture designs data flows and technical specifications

Ensure alignment of data solutions with organizational standards and compliance policies