Senior Data Engineer (Core Data Platform)
Upload My Resume
Drop here or click to browse · PDF, DOCX, DOC, RTF, TXT
Requirements
• Experience working with healthcare data standards (e.g., HL7, FHIR) and regulatory compliance. • healthcare data standards • HL7, FHIR • Familiarity with reporting and visualization tools such as Superset, Grafana, Tableau. • reporting and visualization tools • Superset, Grafana, Tableau • Understanding of data security, compliance, and governance frameworks (e.g., HIPAA, GDPR, SOC 2). • data security, compliance, and governance frameworks
Responsibilities
• Design, develop, and implement robust ETL/ELT data pipelines for large-scale data ingestion, transformation, and storage. • Design, develop, and implement • ETL/ELT data pipelines • Ensure data quality, integrity, and governance by implementing validation techniques, data monitoring, and automated testing. • data quality, integrity, and governance • validation techniques, data monitoring, and automated testing. • Collaborate with cross-functional teams, including data scientists, analysts, platform engineers, and business stakeholders, to develop scalable and reusable data solutions. • cross-functional teams, • Automate deployments and testing using CI/CD pipelines with Git, Terraform, GitHub Actions, or Jenkins. • Automate deployments and testing • Git, Terraform, GitHub Actions, or Jenkins. • Design and build custom data tools and abstractions to support analytics, machine learning, and real-time data processing. • ustom data tools and abstractions • Work with DevOps and platform teams to establish efficient deployment and monitoring processes for internal and external data products. • DevOps and platform teams • Develop and implement alerting, monitoring, and observability frameworks for data pipelines to ensure reliability and proactive issue resolution. • alerting, monitoring, and observability frameworks • Contribute to the data architecture and strategy, driving improvements in scalability, performance, and cost optimization. • data architecture and strategy, • scalability, performance, and cost optimization. • Stay up to date with emerging technologies and industry best practices to continuously enhance data engineering capabilities. • emerging technologies and industry best practices t • We are looking for people who have: • We are looking for people who have • 5+ years of hands-on experience in data engineering, with expertise in distributed data processing and big data frameworks (e.g., Apache Spark, Apache Iceberg, Trino, Apache Airflow, dbt, Dagster). • 5+ years • data engineering • distributed data processing • big data frameworks • Apache Spark, Apache Iceberg, Trino, Apache Airflow, • dbt, Dagster • Advanced programming skills in Scala or Python for data transformation and automation. • Scala or Python • Experience with real-time data streaming technologies such as Apache Flink, Spark Streaming, or Kafka. • real-time data streaming technologies • Apache Flink, Spark Streaming, or Kafka • Strong experience in performance tuning for Spark and optimizing large-scale data workflows. • performance tuning for Spark • Proficiency in SQL and database management, with hands-on experience in Massively Parallel Processing (MPP) databases such as Amazon Redshift, Snowflake, Teradata. • Massively Parallel Processing (MPP) databases • Amazon Redshift, Snowflake, Teradata • Familiarity with cloud-based data services (AWS, RDS, DynamoDB) and containerized infrastructure (EKS, Docker, Kubernetes). • cloud-based data services • containerized infrastructure • Hands-on experience integrating DevOps and CI/CD practices in data engineering using GitHub Actions, Jenkins, or Terraform. • DevOps and CI/CD • GitHub Actions, Jenkins, or Terraform • Proven ability to build monitoring, alerting, and observability tools for data pipelines to ensure high availability and reliability. • monitoring, alerting, and observability • Experience in data mapping, validation, and testing frameworks to ensure accuracy and consistency. • data mapping, validation, and testing frameworks • Exposure in machine learning/deep learning using PyTorch, Tensorflow, or Keras (PyTorch preferred) • Exposure to machine learning workflows and familiarity with MLOps tools for model deployment and lifecycle management. • machine learning workflows • MLOps tools • Self-starter with strong problem-solving skills • fast-paced, agile
Benefits
• ✅ Impact-Driven Work – Be a key player in building data solutions that advance analytics and enable AI-driven innovations in the healthcare sector.✅ Cutting-Edge Technology Stack – Work with modern big data, cloud, and AI-driven solutions.✅ Collaborate with Experts – Join a team of top engineers to solve complex data challenges.✅ Career Growth – Opportunity to lead projects and drive technical innovations. • Impact-Driven Work • building data solutions • Cutting-Edge Technology Stack • modern big data, cloud, and AI-driven solutions • Collaborate with Experts • top engineers • Career Growth • lead projects and drive technical innovations • If you're passionate about building scalable data solutions and working with the latest in data engineering and AI-driven analytics, we’d love to hear from you! 🚀 • building scalable data solutions • working with the latest in data engineering and AI-driven analytics • Don't meet every requirement? Studies have shown that women, communities of color and historically underrepresented talent are less likely to apply to jobs unless they meet every single qualification. At 1upHealth we are dedicated to building a diverse, inclusive and authentic workplace. We encourage folks to apply if they meet at least 50% of the qualifications above. • At 1upHealth, our mission is to unlock health data and improve industry outcomes. As leaders in FHIR® interoperability, our platform makes it easier for partners to access, integrate, aggregate, and share data across a variety of systems. 1upHealth is building a data ecosystem to promote the digital transformation of the industry and encourage insight-driven healthcare. • 100% Paid BCBS Medical and Dental Insurance for Employees • Vision Insurance • Equity for All Employees • Lifestyle Savings Account • Parental Leave (6 weeks bonding leave for all new parents + 10 weeks for birthing parents) • Security Alert: 1upHealth only uses email domains of First Name. Last [email protected] or [email protected] to communicate with prospects. You will never receive an email from a third-party email service such as gmail. In addition, we will never ask a candidate for employment to share personal information (such as banking information, social security numbers, passport, etc), purchase their own equipment, or pay to apply to an open position. • Security Alert:
Similar Jobs
No credit card. Takes 10 seconds.