Senior data Engineer
Our client is a leading GameTech company, operating in 17 markets across 3 continents. With a diverse team of 2,700+ professionals from 40+ nationalities, we are committed to innovation, leveraging cutting-edge technology to deliver world-class entertainment experiences. Recognized among the Best Workplaces in Europe, we foster a dynamic, collaborative, and growth-driven culture.
Responsabilities:
Design, develop, and maintain scalable data processing pipelines in a distributed and data intensive production environment.
Design, develop, and maintain microservices in Python that serve data features in production.Develop and maintain internal tools to support CI/CD pipelines, experiment tracking, and data versioning.
Ensure data integrity and reliability by implementing robust data quality processes.
Work closely with cross-functional teams, including Data Scientists, Software Engineers, and DevOps, to optimize data workflows.Contribute to the architectural decisions and best practices for data engineering.
Requirements:
Significant experience in software development using Python in a large-scale, high-performance production environment.
Extensive hands-on experience with Apache Spark and PySpark.
Strong experience in data modelling and handling both structured and unstructured data.
Significant experience with Apache Kafka.
Experience working in cloud environments (AWS, GCP, or Azure).
Expert skills in Distributed Software System design.
Nice-to-Have Qualifications:
Experience working with the Databricks Platform.
Experience with streaming data and real-time data processing frameworks.
Experience with NoSQL databases such as Redis and Neo4j.
A good understanding of Machine Learning algorithms and the ML project lifecycle.
Sobre a vaga
Tipo de contrato: FULL_TIME
Especialização: Tecnologias de informação
Área: Data and BI
Indústria: TI
Salário: Negotiable
Tipo de trabalho: Híbrido
Nível de experiência: Gerente
Local: Lisboa
FULL_TIMEReferência da vaga: T12Z5B-BDF775BE
Data postada: 15 de abril de 2025
Consultor: Cátia Carlos
lisboa information-technology/data-and-bi 2025-04-15 2025-06-14 it Lisbon PT Robert Walters https://www.robertwalters.pt https://www.robertwalters.pt/content/dam/robert-walters/global/images/logos/web-logos/square-logo.png true