Capco - Principal Data Engineer
Requirements
• Strong proficiency in Python, Scala, or Java, with hands-on experience of Big Data technologies including Spark, Hadoop, or similar distributed processing frameworks. • Experience building real-time event streaming solutions using technologies such as Kafka, Spark Streaming, or Amazon Kinesis within AWS environments. • Proven expertise designing modern data architectures including Data Lakehouse and Data Warehousing solutions, alongside CI/CD, DevOps practices, and data governance including GDPR. • A collaborative engineering mindset with experience delivering scalable cloud solutions and using AI-enabled tools responsibly to improve engineering productivity while maintaining appropriate human oversight and quality assurance. • Excellent stakeholder communication skills with the ability to translate business requirements into practical, high-quality technical solutions. • Expertise in data modelling, schema design, and working with structured and semi-structured datasets. • Experience with distributed technologies including Hadoop, Spark, HDFS, Hive, Databricks, or AWS Lake Formation. • Knowledge of automating ingestion and transformation frameworks within cloud-native data platforms. • Experience delivering solutions within highly regulated industries such as financial services. • Passion for mentoring others, driving engineering best practices, and exploring responsible AI and automation to continually improve delivery.
Responsibilities
• Design and build end-to-end data pipelines using AWS-native services and modern cloud data architectures, ensuring scalable, secure, and resilient solutions. • Partner with clients and cross-functional teams to understand business requirements, define technical solutions, and deliver production-grade data platforms. • Lead the development of robust, tested, fault-tolerant data engineering solutions while promoting responsible engineering standards and governance. • Mentor engineers, share technical expertise, and encourage the effective and responsible use of approved AI tools and automation to enhance collaboration and delivery.
Benefits
• Deliver high-impact technology solutions for Tier 1 financial institutions • Work in a collaborative, flat, and entrepreneurial consulting culture • Access continuous learning, training, and industry certifications • Be part of a team shaping the future of digital financial services • Help shape the future of digital transformation across FS & Energy • We offer a competitive, people-first benefits package designed to support every aspect of your life: • Core Benefits: Discretionary bonus, competitive pension, health insurance, life insurance and critical illness cover. • Mental Health: Easy access to CareFirst, Unmind, Aviva consultations, and in-house first aiders. • Mental Health: • Family-Friendly: Maternity, adoption, shared parental leave, plus paid leave for sickness, pregnancy loss, fertility treatment, menopause, and bereavement. • Family-Friendly: • Family Care: 8 complimentary backup care sessions for emergency childcare or elder care. • Family Care: • Holiday Flexibility: 5 weeks of annual leave with the option to buy or sell holiday days based on your needs. • Holiday Flexibility: • Continuous Learning: Minimum 40 Hours of Training Annually: Take your pick—workshops, certifications, e-learning—your growth, your way. Also, Business Coach assigned from Day One: Get one-on-one guidance to fast-track your goals and accelerate your development. • Continuous Learning: • Healthcare Access: Convenient online GP services. • Healthcare Access: • Extra Perks: Gympass (Wellhub), travel insurance, Tastecard, season ticket loans, Cycle to Work, and dental insurance. • Inclusion at CapcoWe’re committed to a barrier-free, inclusive recruitment process. If you need any adjustments at any stage, just let us know – we’ll be happy to help. We welcome applicants from all backgrounds. At Capco, we value the difference you make, and the differences that make you. Our #BeYourselfAtWork culture champions diversity, equity and inclusivity, and we bring a collaborative mindset to our partnerships with clients and colleagues. #BeYourselfAtWork is the cornerstone of our success and a value that our employees live and breathe every day. #LI-DNI • Inclusion at Capco
Apply in one click
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT