Описание
We are looking for an experienced Senior PostgreSQL / Data Engineer to join a team building a high-performance, enterprise-grade data platform for the financial markets / FX domain. This is a great opportunity for someone who enjoys working with large-scale data, complex PostgreSQL environments and near real-time processing. The platform handles approximately 40 million messages every day and provides up-to-date market data with refresh intervals as short as one second. Задачи
Processing data for 46 currency pairs Handling approximately 40 million messages per day Processing data in near real-time Managing large-scale data storage with 2-year retention Integrating the platform with messaging systems such as RabbitMQ Providing downstream teams with access to frequently refreshed data, with updates available every 1 second Ensuring high availability, scalability and performance Designing solutions capable of supporting large data volumes in a demanding financial environment Требования
Strong commercial experience with PostgreSQL Very good understanding of PostgreSQL architecture Hands-on experience with table partitioning Strong knowledge of database indexing and query optimization Experience with B-Tree, Hash, GIN, GiST and/or BRIN indexes Experience building or maintaining ETL processes Experience working with large-scale / Big Data environments Good knowledge of Linux Experience working with performance-critical database environments Fluent Polish and English Будет плюсом: Python; Kafka or RabbitMQ; Apache Airflow; CI/CD; Experience in the banking, financial services or FX domain; Experience with real-time or near real-time data processing Условия
A cafeteria system that allows employees to personalize benefits by choosing from a variety of options. Generous referral bonuses, offering up to PLN6,000 for referring specialists. Additional revenue sharing opportunities for initiating partnerships with new clients. Ongoing guidance from a dedicated Team Manager for each employee. Tailored technical mentoring from an assigned technical leader, depending on individual expertise and project needs. Dedicated team-building budget for online and on-site team events. Opportunities to participate in charitable initiatives and local sports programs. A supportive and inclusive work culture with an emphasis on diversity and mutual respect.
#J-18808-Ljbffr
Data engineer in financial markets in Warsaw – pracodawca: Inetum
Inetum Polska to doskonały pracodawca, który oferuje dynamiczne środowisko pracy w branży lotniczej, gdzie innowacje i technologia są na pierwszym miejscu. Pracownicy mają możliwość rozwoju zawodowego poprzez udział w zaawansowanych projektach z wykorzystaniem najnowszych technologii, takich jak Azure i Databricks, a także korzystają z kultury współpracy i wsparcia, co sprzyja wymianie wiedzy i doświadczeń. Dodatkowo, lokalizacja w Polsce zapewnia dostęp do różnorodnych zasobów oraz inspirującego otoczenia, co czyni tę rolę jeszcze bardziej atrakcyjną.
