Tripledot Studios - Senior Data Engineer

London£12/hour1w ago

In Office Senior EMEA Artificial Intelligence Senior Data Engineer Kubernetes Airflow SQL Data Quality Kubeflow

Requirements

• Experience building and operating data pipelines, including ingestion, preparation, data quality checks, backfills and orchestration. • Working knowledge of Kubernetes, Airflow, SQL and Spark. • A practical approach to delivering work, with reliability and consistency in how you maintain systems and work with others. • The ability to collaborate constructively with engineers within your team and across studios. • Experience in the games industry. It's a plus, not a requirement; we can help you learn the domain if you bring the right technical knowledge. • Experience with change data capture or streaming. • Exposure to machine learning workflows. • Knowledge of Kubeflow.

Responsibilities

• Help build the game event data hub and ingest data from multiple studios. • Develop and orchestrate data ingestion, preparation, quality checks and backfills. • Centralize dataset metadata and data quality information using tools such as OpenMetadata, giving the team visibility into the health of its data assets. • Improve monitoring and notifications so teams know when pipelines or data assets need attention. • Coordinate changes with studio data engineers to keep shared solutions aligned with their needs and patterns. • Contribute to productionizing machine learning pipelines, monitoring them and making fixes as you rotate across the team's responsibilities.

Benefits

• 25 days paid holiday in addition to bank holidays to relax and refresh throughout the year • 25 days paid holiday • Hybrid Working: We work in the office 3 days a week, Tuesdays and Wednesdays, and a third day of your choice. • Hybrid Working: • 20 days remote working: Work from anywhere in the world, or use the time to cover mandatory office days to WFH, 20 days of the year. • 20 days remote working: • Daily Free Lunch: when in the office you get £12 every day to order from JustEat. • Daily Free Lunch: • Regular company events and rewards: quarterly on-site and off-site events that celebrate cultural events, our achievements and our team spirit. • Employee Assistance Program: Anytime you need it, tap into confidential, caring support with our Employee Assistance Program, always here to lend an ear and a helping hand. • Employee Assistance Program: • Family Forming Support: Receive vital support on your family forming/ fertility journey with our support program [subject to policy] • Family Forming Support: • Life Assurance & Group Income Cover: Financial protection for you and your loved ones. • Life Assurance & Group Income Cover: • Continuous Professional Development: Propel your career with continuous opportunities for professional development. • Continuous Professional Development: • Private Medical Cover & Health Cash Plan: Opt-in (P11d benefit) comprehensive private medical cover with Bupa and cash plan with Medicash. • Private Medical Cover • & Health Cash Plan: • Dental Cover: Opt-in (P11d benefit). • Dental Cover: • Cycle to Work Scheme: Salary sacrifice bike purchase scheme. • Cycle to Work Scheme: • Pension Plan: Qualifying earnings or opt-in 4% contributory match schemes offered. • Pension Plan: