Sword Health - Senior Data Platform Engineer
Upload My Resume
Drop here or click to browse · PDF, DOCX, DOC, RTF, TXT
Requirements
• Proven experience designing and operating data platforms at scale - warehouse, data lake, or lakehouse architectures in production. • Hands-on experience with a modern lakehouse table format - Iceberg strongly preferred; Delta Lake or Hudi also welcome. You understand how the format works under the hood: metadata layout, snapshots, manifests, compaction, copy-on-write vs. merge-on-read. • Clear mental model of catalogs (REST, Polaris, Glue, Unity, Hive) - their trade-offs, and how compute stays detached from storage. • Exposure to at least one vendor lakehouse or query platform - Snowflake, Starburst, or Databricks — at the level where you can reason about its architecture, not just use its UI. • Strong experience with a distributed processing engine - Flink strongly preferred; Spark also fine. You can reason about its internals, fine-tune a running job, and debug a pipeline that’s silently degrading. • Familiarity with durable execution - Temporal, Restate, or similar - or at minimum a solid mental model of what durable execution means and why it matters for data workflows. • Production experience building and operating APIs (REST or gRPC) at scale - good instincts about contracts, versioning, retries, rate limiting, and observability. • Solid understanding of Kafka and event-driven architectures (producers/consumers, partitioning, delivery semantics). • Comfortable in regulated environments (healthcare, fintech, gov) where audit, compliance, and data governance are part of every design. • Platform mindset: you design for self-service, API-first, and with systems and agents - not only humans - as legitimate consumers. • Deeper familiarity with open/REST catalogs (Polaris, Nessie, Unity) beyond basic use. • Observability stack fluency (Prometheus, Grafana, OpenTelemetry). • Prior work on agentic or AI-facing API surfaces, or MCP-style interfaces. • Experience in HIPAA, FedRAMP, or SOC 2 environments. • dbt, DataHub, or data contract tooling exposure. • Mindset and Collaboration • Service orientation: you build APIs (and increasingly agent-facing tools) that others love to use. • Reliability-first: failure modes, retries, and observability are part of day-one design. • Cross-functional: you enjoy working with data engineers, analysts, and ML engineers and understanding their problems. • Documentation mindset: good APIs come with great docs — and good docs now means machine-readable too. • Iterative: you ship incrementally and improve based on feedback. • €46,900 - €73,700 a year • This range includes base, variable and equity • These compensation bands are just the starting point. Once someone joins and proves they’re outlier talent, we adjust quickly to ensure their compensation aligns with their impact. • Our job titles may span more than one career level. Actual pay is determined by skills, qualifications, experience, location, market demand, and other factors. Compensation details listed in this posting reflect the base salary and any potential variable, bonus or sales incentives, and the Company’s estimation of the value of private company stock options, if applicable. The pay range is subject to change, future value of company stock options is not guaranteed, and compensation may be modified in the future. In addition to our total compensation, Sword offers a number of benefits as listed below.
Responsibilities
• Design and evolve Sword’s streaming lakehouse - the foundation that every data consumer in the company depends on. • Build and operate distributed streaming pipelines that move data at low latency and high reliability. • Own the durable workflows that coordinate complex data movement across systems. • Shape the platform’s API surface - the interface producers and consumers use so they never need to touch infrastructure. • Drive evaluations and integrations with vendor data platforms, sitting inside the architectural trade-offs rather than just consuming the output. • Contribute to the self-service and agentic layer: interfaces designed to be consumed by humans, systems, and AI agents alike. • Partner with data engineers and analysts on contracts, governance, and lineage. • Build and maintain AI-ready data infrastructure that powers ML and AI-driven products across Sword. • Leverage AI coding assistants and LLMs to accelerate development, automate documentation, and raise code quality. • Work in a regulated environment where audit, compliance, and governance are part of every design.
Benefits
• Health, dental and vision insurance • Meal allowance • Equity shares • Remote work allowance • Flexible working hours • Work from home • Discretionary vacation • Snacks and beverages • Note: Please note that this position does not offer relocation assistance. Candidates must possess a valid EU visa and be based in Portugal. • Sword Health complies with applicable Federal and State civil rights laws and does not discriminate on the basis of Age, Ancestry, Color, Citizenship, Gender, Gender expression, Gender identity, Gender information, Marital status, Medical condition, National origin, Physical or mental disability, Pregnancy, Race, Religion, Caste, Sexual orientation, and Veteran status. • We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
No credit card. Takes 10 seconds.