Valtech - Lead Data Engineer (Platform)

• To be considered for this role, you must meet the following essential qualifications: • Strong proficiency in Python for building frameworks, automation tooling and reusable components • Hands-on experience with Databricks (including notebooks, workflows, jobs and Unity Catalog) • Strong SQL skills and experience with distributed processing frameworks such as Apache Spark • Deep experience with dbt Core, including project structure, models, tests, macros and deployment at scale • Proven experience designing and maintaining CI/CD pipelines (e.g. GitHub Actions, Azure DevOps or GitLab CI) • Experience with data engineering platform design, including scalable pipeline and workflow architectures • Strong understanding of software engineering principles (DRY, SOLID, modular design) • Experience working with version control systems and modern Git workflows • Experience with cloud platforms (preferably AWS) and infrastructure-as-code concepts (e.g. Terraform) • Experience implementing automated testing strategies (unit, integration, data quality) • Strong understanding of platform monitoring, logging and alerting practices • Experience writing technical documentation and developer-facing guidance • Experience working in complex engineering environments with multiple teams • Experience with Databricks Asset Bundles (DAB) or similar deployment frameworks • Experience integrating AI-assisted development tools (e.g. GitHub Copilot or similar) into engineering workflows • Experience defining AI coding standards, agent configurations or prompt engineering frameworks • Knowledge of Delta Lake and Lakehouse architecture patterns • Experience working on large-scale platform engineering or developer platform teams • Understanding of IAM, secrets management and security compliance in cloud environments • Experience driving adoption of engineering platforms across multiple teams • Strong communication and technical leadership skills • If you do not meet all the listed qualifications or have gaps in your experience, we still encourage you to apply. At Valtech, we recognize that talent comes in many forms, and we value diverse perspectives and a willingness to learn. • Commitment to reaching all kinds of people • We design experiences that work for all kinds of people - and that starts with our own teams. At Valtech, we’re intentional about building an inclusive culture where everyone feels supported to grow, thrive and achieve their goals. No matter your background, you belong here. Explore our Diversity & Inclusion site to see how we’re creating a more equitable Valtech for all.