moneyboxapp - Moneybox - Senior Data Engineer

London Office - Hybrid3w ago

In Office Senior EMEA Cybersecurity Cloud Computing Senior Data Engineer Data Engineer SQL Python MongoDB NoSQL Azure Service Bus

Requirements

• An experienced data engineer who enjoys solving complex technical problems and building reliable systems • Comfortable taking significant ownership and operating with a high degree of autonomy • Able to act as a trusted technical partner and help shape technical direction • Pragmatic and able to balance strong engineering practices with the needs of a fast-moving business • Curious and motivated by improving systems, processes and ways of working • A strong communicator who can explain complex technical concepts clearly to both technical and non-technical audiences • Someone who cares about the quality of their work and the impact it has on customers and colleagues • Comfortable working across team boundaries and bringing clarity to ambiguous or complex problems • Strong experience designing, building and operating scalable production data pipelines • Strong understanding of ETL and ELT architectures and patterns • Strong programming and data transformation skills, particularly using technologies such as Python, Spark and SQL • Experience working with cloud-based data platforms • Experience designing systems for reliability, observability, performance and data quality • Strong understanding of data modelling and the principles behind well-structured analytical data • Experience making technical design decisions and taking ownership of significant engineering work • Ability to independently investigate problems and drive work through to completion • Ability to communicate technical concepts clearly and work effectively with a broad range of stakeholders • Experience with NoSQL technologies such as Cosmos DB, DynamoDB or MongoDB • Experience with messaging or event-streaming technologies such as Azure Service Bus or Event Hubs • Experience using infrastructure-as-code tools such as Terraform • Understanding of REST APIs, authentication and API security • Experience working with sensitive or regulated data • Experience improving the cost and performance of large-scale data workloads • ## Whats in it for you?

Responsibilities

• Act as a senior technical partner within Data Engineering, providing continuity and ownership across the platform • Help set the technical direction and priorities for Data Engineering • Own, maintain and improve our core data processing and analytical platforms, with a strong focus on reliability, scalability and resilience • Design, build and maintain robust data pipelines and integrations across Moneybox systems • Lead the design of significant data architecture and integration changes • Build integrations to ingest new data sources and make them available across our analytical platforms • Partner with Backend Engineering and Insight teams to maintain reliable, accurate and meaningful data models as our products evolve • Establish and promote good engineering practices across data pipelines, modelling, observability, performance and reliability • Ensure data quality and integrity throughout our pipelines, identifying and addressing issues before they impact downstream users • Provide technical guidance to engineers and analysts working with the data platform • Work with Engineering, Information Security and Compliance to ensure analytical data is secure, appropriately restricted and handled in line with our policies • Monitor and improve the performance, efficiency and cost of our data processing platforms • Take ownership of complex technical problems and drive them through to resolution • Keep up to date with developments in data engineering and identify where new technologies or approaches could deliver meaningful value • Contribute to the wider engineering community at Moneybox, sharing expertise and helping raise standards across our technology estate • ## Our Data Technology Stack • Cloud: Microsoft Azure • Data platforms: Azure Databricks, SQL Server, Cosmos DB and Blob Storage • Data processing: Python, Spark and SQL • Messaging: Azure Service Bus and Event Hubs • DevOps and infrastructure: Azure DevOps, GitHub Actions and Terraform • You don’t need to have worked with every technology we use, but we expect you to have strong experience with comparable technologies and the ability to learn quickly.