Pro members applied to this job 36 hours before you saw itGet Pro ›

NeueHealth - Sr. Data Engineer

Remote2d ago

Remote Senior WW Cloud Computing Artificial Intelligence Data Engineer Scala Databricks C#Azure Docker Kubernetes SQL Quality Assurance

Requirements

• Bachelor’s degree in Computer Science, Computer Engineering, Information Systems, or equivalent experience required.• Around Five (5) years of experience in an enterprise or commercial software development environment. Healthcare IT background is highly preferred.• Enterprise development experience coding in Scala.• Experience building batch and streaming data pipelines (Scala).• Experience with API design.• Extensive experience developing data-intensive solutions in a Cloud environment.• Extensive experience developing solutions that use event sourcing and/or Big Data architectures. • Preferred Qualifications:• Experience engineering big-data solutions using technologies like Databricks, Hive, and Spark.• Experience with functional programming in Scala and C#• Experience building distributed systems with microservices and/or service-oriented architectures• Experience working within an Azure environment. Hands on Azure admin and DevOps experience is a plus.• Familiarity with containerization/virtualization, e.g., Docker, Kubernetes• Familiarity with Databricks infrastructure management• Familiarity with CI/CD best practices

Responsibilities

• Write traditional code and server-less functions using the language best suited for the task, which is primarily Scala. May include development with C# and SQL. • Build APIs, data microservices and ETL pipelines, to share data with internal and external partners and write interfaces to public data sets to enrich our analytics data stores. • Develop and optimize processes for fine-tuning large language models (LLMs) and implementing Retrieval-Augmented Generation (RAG) frameworks to enhance AI-driven solutions. • Participate in building and owning a culture of DevOps and Quality Assurance. • Continuously document your code, framework standards, and team processes. • Build and support Data Ingestion frameworks deployed in Azure. • Other duties and responsibilities as assigned.