Gradient AI - Staff Data Engineer

Remote - USA+ Equity3mo ago

Remote Staff NA Health Insurance Insurance Data Engineer Python SQL Apache Spark Snowflake Databricks Airflow Prefect Dagster Terraform Kubernetes Docker AWS Data Quality dbt

Requirements

• BS in Computer Science, Bioinformatics, or another quantitative discipline with 7+ years of relevant working experience. • Deep expertise in health, medical, and bioinformatics data, including real-world healthcare datasets, with a strong understanding of the complexities and challenges of processing medical and biological information. • Proficiency in Python and SQL within a professional environment. • Hands-on knowledge of big data tools like Apache Spark (PySpark), Databricks, Snowflake, or similar platforms • Experience with data orchestration frameworks such as Airflow, Dagster, or Prefect. • Experience with modern DevOps practices, including CI/CD, IaC (Terraform), containerization (Docker/Kubernetes), and cloud environments (AWS preferred). • Knowledge of data transformation tools, such as dbt, is a plus

Responsibilities

• Design, build, and implement data systems to support ML and AI models for our health insurance clients, ensuring strict compliance with healthcare data privacy and security regulations (e.g., HIPAA). • Develop tools for extracting, processing, and profiling diverse healthcare data sources, including EHRs, medical claims, pharmacy data, and genomic data. • Collaborate with data scientists to transform large volumes of health-related and bioinformatics data into modeling-ready formats, prioritizing data quality, integrity, and reliability in healthcare applications. • Build and maintain infrastructure for the extraction, transformation, and loading (ETL) of data from a variety of sources using SQL, AWS, and healthcare-specific big data technologies and analytics platforms. • Ensure data pipelines meet the unique requirements of health, medical, and bioinformatics data processing, including translating complex medical and biological concepts into actionable data requirements.

Benefits

• A fun, team-oriented startup culture. • Generous stock options - we all get to own a piece of what we’re building. • Unlimited vacation days. • Flexible schedule that supports working from home. • Full benefits package includes medical, dental, vision, 401k, paid paternal leave, and more. • Ample opportunities to learn and take on new responsibilities.