Senior Data Engineer

Our client is a leading GameTech company, operating in 17 markets across 3 continents. With a diverse team of 2,700+ professionals from 40+ nationalities, we are committed to innovation, leveraging cutting-edge technology to deliver world-class entertainment experiences. Recognized among the Best Workplaces in Europe, we foster a dynamic, collaborative, and growth-driven culture

Responsibilities

• Design, develop, and maintain scalable data processing pipelines in a distributed and data intensive production environment.
• Design, develop, and maintain microservices in Python that serve data features in production.Develop and maintain internal tools to support CI/CD pipelines, experiment tracking, and data versioning.
• Ensure data integrity and reliability by implementing robust data quality processes.
• Work closely with cross-functional teams, including Data Scientists, Software Engineers, and DevOps, to optimize data workflows.
• Contribute to the architectural decisions and best practices for data engineering.

Requirements:

• Significant experience in software development using Python in a large-scale, high-performance production environment.
• Extensive hands-on experience with Apache Spark and PySpark.
• Strong experience in data modeling and handling both structured and unstructured data.
• Significant experience with Apache Kafka.
• Experience working in cloud environments (AWS, GCP, or Azure).
• Expert skills in Distributed Software System design.

Nice-to-Have Qualifications:

• Experience working with the Databricks Platform.
• Experience with streaming data and real-time data processing frameworks.
• Experience with NoSQL databases such as Redis and Neo4j.
• A good understanding of Machine Learning algorithms and the ML project lifecycle.