We are looking for an experienced Senior PostgreSQL / Data Engineer to join a team building a high-performance, enterprise-grade data platform for the financial markets / FX domain. This is a great opportunity for someone who enjoys working with large-scale data, complex PostgreSQL environments and near real-time processing. The platform handles approximately 40 million messages every day and provides up-to-date market data with refresh intervals as short as one second. About the project
You will contribute to the design, development and optimization of a data platform responsible for: Processing data for 46 currency pairs Handling approximately 40 million messages per day Processing data in near real-time Managing large-scale data storage with 2-year retention Integrating the platform with messaging systems such as RabbitMQ Providing downstream teams with access to frequently refreshed data, with updates available every 1 second Ensuring high availability, scalability and performance Designing solutions capable of supporting large data volumes in a demanding financial environment Must-have
Strong commercial experience with PostgreSQL Very good understanding of PostgreSQL architecture Hands-on experience with table partitioning Strong knowledge of database indexing and query optimization Experience with B-Tree, Hash, GIN, GiST and/or BRIN indexes Experience building or maintaining ETL processes Experience working with large-scale / Big Data environments Good knowledge of Linux Experience working with performance-critical database environments Fluent Polish and English Nice to have
Python Kafka or RabbitMQ Apache Airflow CI/CD Experience in the banking, financial services or FX domain Experience with real-time or near real-time data processing We hereby inform you that Inetum Polska sp. z o.o. has implemented an internal reporting (whistleblowing) procedure. The content of the procedure and the possibility to submit an internal report are available at: https://inetum.whispli.com/speakup?locale=pl
#J-18808-Ljbffr
Senior PostgreSQL / Data Engineer in Katowice – pracodawca: Inetum2
Pracując jako Data Engineer w Inetum Polska, dołączysz do dynamicznego zespołu zajmującego się nowoczesnymi technologiami chmurowymi i Big Data w branży lotniczej. Oferujemy przyjazną kulturę pracy, która sprzyja innowacjom oraz ciągłemu rozwojowi zawodowemu, a także możliwość pracy nad projektami mającymi realny wpływ na bezpieczeństwo i efektywność systemów lotniczych. Nasze biuro w Polsce zapewnia elastyczne godziny pracy oraz wsparcie w nauce i rozwoju umiejętności technicznych, co czyni nas doskonałym pracodawcą dla osób poszukujących satysfakcjonującej kariery w inżynierii danych.
