About The Role In this role, you will contribute to building scalable and reliable data solutions on Google Cloud Platform, leveraging modern Big Data technologies and cloud-native services. You will work with batch and streaming data processing systems, helping organizations transform, manage, and unlock the value of their data. As part of a collaborative engineering team, you will participate in the full project lifecycle, from discovery and solution design to implementation and production deployment.
About The Role In this role, you will contribute to building scalable and reliable data solutions on Google Cloud Platform, leveraging modern Big Data technologies and cloud-native services. You will work with batch and streaming data processing systems, helping organizations transform, manage, and unlock the value of their data. As part of a collaborative engineering team, you will participate in the full project lifecycle, from discovery and solution design to implementation and production deployment.
Responsibilities
Design, develop, and maintain scalable data pipelines for batch and streaming workloads
Build and optimize data processing solutions using Python (must), SQL, Java, Apache Spark, and Databricks
Create cloud-native data architectures leveraging GCP services including BigQuery, Dataflow, Cloud Composer, Pub/Sub, and Cloud Storage
Implement data transformation, modeling, and analytics engineering practices using dbt and Dataform
Collaborate with business stakeholders, architects, and engineering teams to translate data requirements into effective technical solutions
Support development of modern data platforms and analytics solutions on GCP with GCP native services and/or Databricks
Contribute to technical design discussions, architecture decisions and continuous improvement initiatives
Ensure data quality, reliability and performance across data processing workflows
Support end-to-end project delivery, including PoCs, MVPs, production deployments and platform enhancements
Requirements
5+ years of professional experience in Big Data or Data Engineering
Advanced expertise in Python and SQL (Java nice to have) for large-scale data processing and transformationHands-on experience developing data solutions on Google Cloud Platform (GCP)
Experience with Apache Spark and data processing frameworks such as Cloud Dataflow or Apache Beam
Proven background building scalable solutions using Databricks and Lakehouse concepts
Experience with orchestration tools such as Apache Airflow or Cloud Composer
Knowledge of streaming technologies such as Apache Kafka or Google Cloud Pub/Sub
Strong knowledge of BigQuery and modern cloud data architectures
Experience with data transformation and modeling tools such as dbt and Dataform
Strong analytical thinking, troubleshooting capabilities, and problem-solving skills
Effective communication with both technical and non-technical stakeholders
Upper-intermediate or higher level of English
SoftServe is an equal opportunity employer. Qualified applicants will receive consideration regardless of race, color, ancestry, ethnicity, national origin, religion, sex, sexual orientation, gender identity or expression, age, citizenship, disability, health condition, marital or family status, veteran status, or any other characteristic protected by applicable law.
Senior Big Data Engineer (Python + GCP) in Warsaw – pracodawca: SoftServe Inc.
SoftServe Inc. oferuje elastyczne opcje pracy oraz możliwość współpracy z zespołem ekspertów w dziedzinie AI i Data Science. Pracownicy mają szansę na rozwój zawodowy poprzez mentoring oraz udział w innowacyjnych projektach związanych z generatywną AI i systemami wieloagentowymi. Firma stawia na budowanie silnych relacji z klientami, co sprzyja dynamicznemu rozwojowi kariery.
