As a recruitment company, DCG understands that every business is powered by experienced professionals. Our management style and partnership approach enable us to meet your needs and provide continuous support. Due to our ongoing growth and the large number of recruitment projects we undertake for our partners, we are currently looking for:
Responsibilities:
Migrate 100+ legacy ETL pipelines across multiple source systems to an Airflow-on-Kubernetes orchestration platform
Design, build, and maintain scalable data ingestion pipelines
Ensure data pipelines are reliable, observable, and operationally maintainable
Collaborate with source-system teams and stakeholders to onboard new financial data feeds
Maintain and support existing data pipelines and integrations
Develop the Snowflake transformation layer using DBT and Python-based data modeling
Contribute to CI/CD, testing, and data-quality practices
Contribute to the technical direction and ongoing development of the data platform
Requirements:
Strong hands‑on experience with Python
Solid experience with Apache Airflow or similar orchestration tools
Proven ETL and data pipeline development experience
Practical experience with Git and standard version‑control workflows
Working knowledge of Snowflake or another major cloud data warehouse
Understanding of data modeling fundamentals, including dimensional modeling, partitioning, and incremental load strategies
Ability to work effectively in a large, cross‑team environment with multiple stakeholders and dependencies
Very good command of English, both spoken and written
Nice to have:
Experience with DBT (Data Build Tool)
Familiarity with AI coding assistants such as GitHub Copilot for development, testing, and documentation
Experience with financial or banking data, including credit risk or regulatory reporting
Exposure to Scala, Spark, or Snowpark
Experience with Kafka or other streaming/messaging platforms
Familiarity with CI/CD tooling such as Jenkins and data‑quality/testing frameworks
Experience with legacy‑to‑modern ETL migrations, including DataStage or Informatica to Airflow/dbt‑style stacks
Offer:
Private medical care
Co‑financing for the sports card
Constant support of dedicated consultant
Personal Consulting Agency (License No. 4642)
Senior Data Engineer Python, Apache Airflow, Snowflake, SQL Gdańsk – pracodawca: Diverse Consulting Group
Nasza firma to doskonały pracodawca, który oferuje wyjątkowe możliwości rozwoju w dynamicznej dziedzinie badań i rozwoju. Pracując w Warszawie lub zdalnie, będziesz częścią innowacyjnego zespołu, który współpracuje z wiodącymi uczelniami oraz startupami, co sprzyja kreatywności i wymianie wiedzy. Oferujemy elastyczne godziny pracy, wsparcie w rozwoju kariery oraz inspirującą kulturę pracy, która stawia na współpracę i innowacje.
Dane kontaktowe:
Zespół rekrutacyjny Diverse Consulting Group