tem - Senior Data Engineer
Requirements
• Strong Python skills, with proven experience building and maintaining production data pipelines. • Experience owning the design, reliability, and resilience of a data pipeline or system end-to-end, not just writing pipeline code. • Great communication skills, comfortable working directly with stakeholders to scope and agree SLAs, and explaining technical trade-offs to non-technical audiences. • Strong team player, comfortable working independently against a backlog and making judgement calls on prioritisation, while fitting into an existing team of 4. • Experience with time-series data at scale. • Experience with modern data stack tooling (Airflow, Snowflake, BigQuery, Redshift, ClickHouse). • Background in high-growth startups or scale-ups. • Genuine interest in how AI tooling and workflows intersect with data engineering. • We're open to someone who doesn't tick every box here, as long as they bring solid AWS or GCP experience and the ability to own their own work end-to-end.
Responsibilities
• Own the design, reliability, and recovery strategy for the ingestion pipelines and systems in your domain. • Maintain and improve the data platform, including working through the existing tech debt backlog. • Build monitoring and alerting so issues surface before they become incidents. • Set the data quality checks that make an SLA commitment possible, and hold the line on them. • Help take the number of data products with a defined SLA from 2 to 10. • Own the design, reliability, and resilience of ingestion pipelines end-to-end, including TSDS, with a clear recovery strategy when things break. • Build and maintain ETL/ELT pipelines for new and existing data sources. • Decide the right approach (batch vs. streaming) for each pipeline in your domain, including high-scale, low-latency requirements for time-series data. • Set data quality checks that make an SLA commitment possible, and hold the line on them. • Platform Maintenance • Own the day-to-day reliability of the data platform: monitoring, testing, and fixing issues before they become firefights. • Own code quality and standards for the systems you're responsible for, including CI checks (linting, tests, coverage). • Work through the existing tech debt backlog, prioritising fixes that unblock SLA commitments. • Optimise pipelines for performance and cost as data volumes grow. • Handle the failure modes specific to energy data: late arrivals, reprocessing, backfills. • Monitoring & Alerting • Build and improve observability across your systems so problems surface before they cause downstream impact. • Set up alerting tied to the SLAs the team is committing to. • Investigate and resolve issues within your domain, escalating genuinely cross-system problems. • Supporting Expansion • Help scope and prepare the platform for new data sources tied to international expansion. • Flag where current architecture won't hold up as scope grows, even if fixing it isn't your call to make alone. • Work closely with the AI team as their data needs on the platform grow.
Benefits
• £82,700 – £93,350 • Offers Equity • Upload your resume here to autofill key application fields. • Drop your resume here! • Parsing your resume. Autofilling key fields... • Please let us know what to call you! • If you’d like, please let us know your pronouns so we can address you respectfully throughout the process. • We need to know how to contact you. • Please let us know what excites you about this opportunity! • Please add your CV here for review. • or drag and drop here • Feel free to leave blank if you don't have one. • Where you are currently based. • We just want to make sure we're in the same ballpark before asking you to spend time interviewing. Totally fine to leave it blank if you'd rather not say right now. • I prefer not to answer • Another Gender Identity • Heterosexual / straight • Asian or Asian American • Black or African American • Hispanic or Latine • Indigenous or Native American • Native Hawaiian or Other Pacific Islander • Person with disability • Refugee or immigrant • None of the above • If you agree to our Privacy Policy, and for us to retain your data for future hiring purposes, please click the "I agree" checkbox below. • Note: The consent period lasts for 2 years • Recruiting Privacy Policy
Apply in one click
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT