Airbnb - Senior Software Engineer, Streaming Infrastructure
Requirements
• Experience building managed or multi-tenant platforms used by other engineering teams. • Familiarity with MySQL/Aurora, schema evolution, or large-scale batch data processing. • Our Commitment To Inclusion & Belonging: • Airbnb is committed to working with the broadest talent pool possible. We believe diverse ideas foster innovation and engagement, and allow us to attract creatively-led people, and to develop the best products, services and solutions. All qualified individuals are encouraged to apply. • We strive to also provide a disability inclusive application and interview process. If you are a candidate with a disability and require reasonable accommodation in order to submit an application, please contact us at: [email protected]. Please include your full name, the role you’re applying for and the accommodation necessary to assist you with the recruiting process. • We ask that you only reach out to us if you are a candidate whose disability prevents you from being able to complete our online application. • Equal Employment Opportunity: • Equal Employment Opportunity
Responsibilities
• The Ingestion team is the front door to DMT. We build and operate two managed, multi-tenant platforms that move data out of Airbnb's online databases for offline processing: • SpinalTap: near real-time change data capture (CDC) streaming to Kafka for every Aurora and UDS table at Airbnb. • SpinalTap: • DBExports: periodic full-table snapshots and mutation exports. • DBExports: • Teams across Airbnb depend on these systems, including payments, fraud detection, financial reporting, search, messaging, notifications, and machine learning. Reliability, performance, and scale are the product. You'll work closely with DMT's other teams, which own real-time streaming infrastructure, pipeline orchestration, and schema management, and you'll have the chance to work across the broader platform • Be hands-on (code, design, test) and work with partner teams, internal customers, and leadership to deliver multi-month projects on time. • Design, build, and operate large-scale CDC and batch export systems that run across every online database at Airbnb. • Help shape the architecture of DMT's unified data movement platform while it's being built. • Improve the reliability, performance, and efficiency of systems that critical business functions depend on. • Make it easier for engineers at Airbnb to get their data into offline systems without needing to be database or pipeline experts. • Take part in on-call and raise the operational bar for a platform that other teams build on. • Your Expertise: • Your Expertise: • 5+ years of experience building and operating large-scale backend distributed systems, such as data ingestion, streaming, CDC, storage, or data platforms. • Hands-on experience with streaming systems like Kafka, and with how databases capture and publish changes (binlogs, Debezium, or similar). • Ability to own and go deep in a complex codebase. • Experience maintaining, analyzing, and debugging production systems at scale. • Clean, readable, testable, and maintainable code. • Strong collaboration and communication skills in a remote-working environment. • Strong ownership and a track record of delivering on time.
Apply in one click
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT