Senior PostgreSQL / Data Engineer
The role focuses on designing, developing, and optimizing a high‑performance PostgreSQL‑based platform that processes 40 million financial messages daily with near‑real‑time refreshes. You will build scalable data pipelines, integrate messaging systems, and ensure efficient storage and access for downstream teams.
Skills required
About this role
We are looking for an experienced Senior PostgreSQL / Data Engineer to join a team building a high-performance, enterprise-grade data platform for the financial markets / FX domain.
This is a great opportunity for someone who enjoys working with large-scale data, complex PostgreSQL environments and near real-time processing. The platform handles approximately 40 million messages every day and provides up-to-date market data with refresh intervals as short as one second.
About the project
You will contribute to the design, development and optimization of a data platform responsible for:
- Processing data for 46 currency pairs
- Handling approximately 40 million messages per day
- Processing data in near real-time
- Managing large-scale data storage with 2-year retention
- Integrating the platform with messaging systems such as RabbitMQ
- Providing downstream teams with access to frequently refreshed data, with updates available every 1 second
- Ensuring high availability, scalability and performance
- Designing solutions capable of supporting large data volumes in a demanding financial environment
Qualifications
Must-have:
- Strong commercial experience with PostgreSQL
- Very good understanding of PostgreSQL architecture
- Hands-on experience with table partitioning
- Strong knowledge of database indexing and query optimization
- Experience with B-Tree, Hash, GIN, GiST and/or BRIN indexes
- Experience building or maintaining ETL processes
- Experience working with large-scale / Big Data environments
- Good knowledge of Linux
- Experience working with performance-critical database environments
- Fluent Polish and English
Nice to have:
- Python
- Kafka or RabbitMQ
- Apache Airflow
- CI/CD
- Experience in the banking, financial services or FX domain
- Experience with real-time or near real-time data processing
Additional Information
We hereby inform you that Inetum Polska sp. z o.o. has implemented an internal reporting (whistleblowing) procedure. The content of the procedure and the possibility to submit an internal report are available at:
https://inetum.whispli.com/speakup?locale=pl
