ASTRABRIGHT ANALYTICS & KNOWLEDGE ALLIANCE, INC - Multimodal Data Engineer

With our headquarters in Silicon Valley and teams in Paris, Singapore$120k - $225k+ Equity2w ago

In Office Mid APAC Artificial Intelligence Robotics Data Engineer Airflow Ray Dagster Quality Control Data Quality

Requirements

• 3+ years of experience in data engineering or building large-scale data systems, with hands-on ownership of production data workflows. • Experience delivering datasets or data systems end to end, including scope, timeline, quality, cost, and acceptance criteria for external clients or internal model teams. • Hands-on experience with at least two data modalities, such as text, images, audio, video, or 3D point clouds. • Experience designing and operating large-scale data pipelines using distributed processing tools such as Spark, Ray, or Flink; orchestration tools such as Airflow, Dagster, or Argo; cloud object storage; and containerized batch compute. • Working knowledge of the infrastructure behind data pipelines, including cloud permissions, storage layout and lifecycle rules, compute provisioning, orchestration environments, and cost monitoring. • Experience designing data quality and acceptance processes, including sampling plans, defect categories, measurable quality gates, or model-assisted quality control. • Familiarity with data privacy and security practices, including access control, anonymization, license and provenance tracking, and encryption. • Ability to translate ambiguous requirements into actionable technical plans with explicit assumptions, resource needs, risks, and acceptance criteria. • Strong ownership, sound judgment, and comfort working across engineering and operations in a fast-moving environment. • Experience preparing pretraining, supervised fine-tuning, RLHF, or evaluation datasets for LLMs or multimodal foundation models. • Experience with data for autonomous driving, robotics, embodied AI, or other sensor-based domains. • Experience with large-scale deduplication, data quality scoring, or dataset composition design. • Experience building annotation platforms or internal data tools, or working with external annotation vendors. • Experience modeling and optimizing the cost of GPU- or compute-intensive data pipelines. • Experience establishing engineering standards and improving workflows on a growing team.

Responsibilities

• Assess incoming data requirements for feasibility, technical challenges, risks, cost, and delivery timeline. Define execution plans, resource needs, quality specifications, and written acceptance criteria before work begins. • Own technical delivery for assigned projects, from scoping through final handoff. Break requirements into tasks with clear owners, priorities, deadlines, and deliverables, and coordinate work across engineers, annotation teams, and external vendors. • Build and improve scalable pipelines for multimodal data sourcing, processing, cleaning, annotation, quality assurance, storage, and delivery. • Establish quality gates at ingestion and before delivery. Define measurable checks, identify checks that could not be performed, and prevent data that fails agreed specifications from being delivered. • Improve visibility into project and dataset status through tools such as requirement-to-delivery trackers and dataset indexes covering progress, ownership, yield, inventory, quality, cost, sample links, and delivery history. • Help operate the infrastructure behind our data workflows, including object storage, batch processing, compute and GPU resources, orchestration environments, annotation platforms, and internal data services. • Track infrastructure usage and project costs, and identify ways to improve quality, throughput, and efficiency without compromising delivery commitments. • Standardize recurring workflows, automate manual steps, build internal tooling, and document reusable practices based on project retrospectives. • Partner with client-facing teams and foundation model teams to clarify data needs, communicate technical tradeoffs, and raise feasibility or quality risks early.

Benefits

• The base salary range for this position is $120,000 – $225,000 USD annually. Compensation may vary outside this range based on a candidate’s qualifications, skills, competencies, and experience. • Base salary is one part of the total compensation package at Abaka AI. This role is also eligible for equity and a comprehensive benefits package, including health, dental, and vision coverage, PTO, and a flexible work schedule.