Shift5 - Staff Data Engineer
Requirements
• Engineering Experience: 6+ years of software/data engineering experience with a deep understanding of software engineering practices and concepts. • Core Languages: 6+ years of experience with a major programming language (GoLang, Java, or Python). • Core Languages: • Databases & Big Data: 6+ years of relational database experience (PostgreSQL, MySQL, Oracle, etc.) alongside 6+ years of experience with Big Data (Hadoop, Spark) and Data Modeling. • Databases & Big Data: • Cloud & Containers: 4+ years of experience with containerization and cloud services (Docker, Kubernetes) and cloud monitoring tools. • Cloud & Containers: • Data Pipelines & Stack: Expertise with batch and streaming data pipelines (Apache Airflow, Benthos) and familiarity with modern data stack components (ingestion, transformation, orchestration). • Data Pipelines & Stack: • Preferred: • U.S. citizenship required and ability to obtain a security clearance. • U.S. citizenship • Education: MS in Computer Science, Cybersecurity, Cyber Intelligence, or equivalent. • Education: • Data Architecture: Experience and understanding of data lakes/warehouses (e.g., Snowflake, Databricks, Redshift). • Data Architecture: • DevOps Practices: Proficiency with CI/CD, source control, design reviews, and integrating observable practices. • DevOps Practices: • Advanced Languages & Tools: Experience with Rust, SDK design, and implementation (including code gen of type-specific bindings to Python, Go, TypeScript). • Advanced Languages & Tools: • Travel Flexibility: Willingness to travel occasionally to customer and partner sites to support field integration and deployment efforts. • Travel Flexibility:
Responsibilities
• Design & Build Pipelines: Design, build, and maintain robust, scalable batch and streaming data processing, storage, and integration pipelines using technologies such as Apache Airflow or Benthos. • Design & Build Pipelines: • Feature Ownership & Leadership: Interpret requirements and design specifications, taking full ownership of building features from the ground up. Mentor and lead the rest of your team to deliver the right solutions. • Feature Ownership & Leadership: • Write Quality Code: Write clean, well-documented, scalable, extensible, and testable code to ensure application quality and maintainability. • Write Quality Code: • Cross-Functional Collaboration: Partner with data scientists and engineers to create semantic data models representing complex vehicular systems, and integrate applications cleanly across other Shift5 componentry. • Cross-Functional Collaboration: • Support Stakeholders: Build scalable data products for data scientists, transportation engineers, and executives to drive insights and decision-making. • Support Stakeholders: • Cloud Optimization: Create efficient, reliable, cost-effective, dynamically scalable, and observable solutions utilizing AWS cloud services. • Cloud Optimization: • Data Analysis & Quality: Analyze complex data sets to create data ontologies, verify data quality/integrity, and ensure data accuracy throughout pipelines. • Data Analysis & Quality: • Field Support: Support the design process and occasionally travel to customer sites (estimated a few times per year) to collaborate with Field Engineers on data integration and deployment. • Field Support: • What Success Looks Like • High-Impact Delivery: You successfully deliver scalable, observable, supportable, and reliable data processing applications that empower customers to run smarter, safer fleets. • High-Impact Delivery: • End-to-End Ownership: You confidently steer complex data applications from scratch—including requirements gathering, design, planning, and implementation—in a fast-paced environment. • End-to-End Ownership: • Collaborative Impact: You actively shape product design alongside multidisciplinary teams, acting as a technical leader and force-multiplier for your peers. • Collaborative Impact: • Adaptability: You efficiently multitask and smoothly accommodate changing priorities on demand to meet the dynamic needs of a scaling company. • Adaptability:
Benefits
• Bonus program and equity in a fast-growing startup • Competitive medical, dental, and vision coverage for employees and their families • Health Savings Account with annual employer contributions • Employer-paid Life and Disability Insurance • Uncapped paid time off policy • Flexible work & remote work policy • Tax-deferred public transit benefits with Metro SmartBenefits (DC/MD/VA) • We are committed to building an inclusive culture of belonging that embraces the diversity of our people and represents the communities in which we work and the customers we serve. We know the happiest and highest performing teams include people with diverse perspectives and ways of solving problems. We strive to attract and retain talent from all backgrounds and create workplaces where everyone feels empowered to bring their full, authentic selves to work.
Apply in one click
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT