
Website Kaizen Gaming
Description
Job Title: Data Engineer
As a Senior Data Engineer, you will focus on delivering robust and scalable data pipelines which transform raw data to features that can be used in Machine Learning models.
As a Senior Data Engineer your will:
- Design, develop and maintain scalable data processing pipelines in a distributed, and data-intensive production environment;
- Design, develop and maintain microservices in Python that serve these features on production;
- Design, develop and maintain internal tools that enable CI/CD pipelines, experiment tracking and data versioning;
- Guarantee data integrity by employing data quality processes.
What you’ll bring:
- Significant experience in software development using Python on a large scale, high-performance production environment;
- Significant hands-on experience with Spark and PySpark;
- Significant experience with data modeling and handling structured and unstructured data;
- Significant experience with Apache Kafka;
- Experience with cloud environments;
- Expert skills in Distributed Software System design;
- Excellent problem solving and communication skills.
Nice to have:
- Experience with the Databricks Platform;
- Experience with streaming data and real-time data processing frameworks;
- Experience with NoSQL DBs, such as Redis and Neo4j;
- Good understanding of ML algorithms and the ML-project lifecycle.
To apply for this job please visit careers.kaizengaming.com.
Data Engineer at Kaizen Gaming, Remote (Global)
Share with someone