wagey.ggwagey.gg
27,166  jobs27,166  jobs
Browse Tech JobsCompaniesFeaturesPricingFAQs
Log InGet Started Free
Jobs(27,166)/Senior Data Engineer Role(229)/kpler (55) - Senior Data Engineer - Financial Flows
Pro members applied to this job 36 hours before you saw itGet Pro ›
kpler

kpler - Senior Data Engineer - Financial Flows

United Kingdom2d ago
In OfficeSeniorEMEACloud ComputingTourismSenior Data EngineerPythonRESTAWSDockerKubernetesQuestDBElasticsearchSQLClickHousePHPData QualityDocumentation

Requirements

• 5+ years of professional experience building, operating, and scaling production-grade data pipelines and backend infrastructure. • Advanced expertise in Python, with a strong background refactoring and rewriting production-critical code for performance and testability. • Proven hands-on experience building and maintaining real-time or streaming API ingestion pipelines (REST, WebSockets) handling time-series datasets. • Solid production experience deploying and managing containerized applications on AWS using Docker, Kubernetes, and modern CI/CD practices. • Strong database fundamentals in SQL and experience working with distributed search or time-series databases (e.g., Elasticsearch, QuestDB, ClickHouse). • Deep experience establishing automated data quality frameworks, observability (monitoring/alerting), and root-cause troubleshooting for production systems. • Domain knowledge of financial market structures, futures contracts, open interest, and commodities trading symbology. • Experience integrating data from major financial market vendors (e.g., Bloomberg, LSEG, Enverus, Trading Technologies). • Familiarity with legacy PHP codebase migration or reading PHP algorithms to translate into Python. • Practical familiarity with GitOps frameworks and infrastructure-as-code tooling. • We are a dynamic company dedicated to nurturing connections and innovating solutions to tackle market challenges head-on. If you thrive on customer satisfaction and turning ideas into reality, then you’ve found your ideal destination. Are you ready to embark on this exciting journey with us? • We make things happen • We act decisively and with purpose, going the extra mile. • We build
together • We foster relationships and develop creative solutions to address market challenges. • We are here to help • We are accessible and supportive to colleagues and clients with a friendly approach. • Our People Pledge • Don’t meet every single requirement? Research shows that women and people of color are less likely than others to apply if they feel like they don’t match 100% of the job requirements. Don’t let the confidence gap stand in your way, we’d love to hear from you! We understand that experience comes in many different forms and are dedicated to adding new perspectives to the team.

Responsibilities

• Design, build, and operate resilient batch and real-time streaming data ingestion pipelines connecting to external financial market data providers via APIs and WebSockets. • Lead the architectural migration of legacy backend infrastructure to modern cloud-native environments on AWS, establishing high standards for system reliability and scalability. • Drive the refactoring and rewrite of the CTA positioning indicator calculation blocks from PHP to Python, ensuring strict mathematical output parity, comprehensive test coverage, and optimized latency. • Ingest and model complex financial datasets—including futures pricing, open interest, and trading volumes—across time-series stores and search engines like QuestDB and Elasticsearch. • Implement automated data validation, proactive alerting, and system monitoring to ensure market data feeds remain accurate, continuous, and fault-tolerant. • Deploy, maintain, and scale containerized services across Docker and Kubernetes environments using automated CI/CD pipelines and GitOps workflows. • Partner closely with quantitative researchers, commodity analysts, and product managers to translate complex trading models into high-performance production pipelines. • Provide technical mentorship to peer engineers, raising team-wide engineering rigor through thoughtful code reviews, system design guidance, and architectural documentation.

Apply in one click

Upload My Resume

Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT

Apply in One Click
Apply in One Click

Similar roles

ClarityClarity - Senior Data Engineer2w ago
·London, United Kingdom·Equity
In OfficeEMEASeniorCloud ComputingArtificial IntelligenceSenior Data EngineerPythonSQLGitDockerKubernetes
PlayStation GlobalPlayStation Global - Senior Data Engineer1w ago
·Remote - United Kingdom, London
RemoteEMEASeniorCloud ComputingSenior Data EngineerDocumentationdbtSnowflakeGitKubernetesPySparkData QualitySQLAWSDatabricksPythonGovernanceData Governance
PlayStation GlobalPlayStation Global - Senior Data Engineer2w ago
·Ireland, Dublin - Hybrid
In OfficeEMEASeniorCloud ComputingSoftwareSenior Data EngineerDocumentationSQLPythonDatabricksdbt
VML/WPP Enterprise SolutionsVML/WPP Enterprise Solutions - Senior Data Engineer5d ago
·Cape Town, South Africa·Equity
In OfficeEMEASeniorCloud ComputingArtificial IntelligenceSenior Data EngineerGitData GovernanceReportingSnowflakeGovernanceProduct MarketingGCPBigQueryAirflowSQLStitchFivetranSegmentAmplitudePendoMixpanelPythonPower BILookerTableauDigital MarketingVaultKafkaDockerKubernetesAWSAzureData Quality
KnowBe4KnowBe4 - Senior Data Engineer (Remote in Brazil)4w ago
·Remote - Brazil
RemoteLATAMSeniorCybersecurityCloud ComputingSenior Data EngineerSQLPythonAWSData Quality
teyateya - Senior Data Engineer (Data Platform)4w ago
·London, United Kingdom
In OfficeEMEASeniorCloud ComputingData AnalyticsSenior Data EngineerJavaPythonGovernanceSQLData Governance
Point72Point72 - Senior Data Engineer, Mi-Platform4w ago
·United Kingdom
In OfficeEMEASeniorCloud ComputingSenior Data EngineerPythonAWSAzureAirflowVector
temtem - Senior Data Engineer4w ago
·Remote - United Kingdom·£83k - £93k/year + Equity
RemoteEMEASeniorCloud ComputingData AnalyticsSenior Data EngineerData QualityPythonSnowflakeAirflowRedshift
codatcodat - Senior Data Engineer3mo ago
·United Kingdom - Hybrid·£90k - £110k/year
RemoteEMEASeniorCloud ComputingSenior Data EngineerPythonAirflowDatabricksSQLDagster

Browse more by category

Show 229 moreSenior Data EngineerShow 4,615 morePythonShow 586 moreRESTShow 2,339 moreAWSShow 655 moreDockerShow 1,312 moreKubernetesShow 1 moreQuestDBShow 125 moreElasticsearchShow 2,330 moreSQLShow 56 moreClickHouse
Privacy·Terms··Contact·FAQ·Wagey on X