egen - Lead Data Engineer
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT
Requirements
• 7+ years in data engineering, with at least 2 years in a lead or senior individual contributor capacity on Google Cloud-based platforms • BigQuery (Advanced): Deep knowledge of BigQuery architecture, including partitioning, clustering, slot management, storage optimization, and query execution tuning • Streaming & Batch Pipelines: Strong hands-on experience building unified pipelines using Dataflow (Apache Beam), Dataproc, and Pub/Sub • Infrastructure as Code: Production experience developing and managing cloud infrastructure with Terraform • Open Table Formats: Working knowledge of Apache Iceberg, including its role in enabling cloud and engine interoperability (e.g., across BigQuery, Spark, Snowflake) • Data Governance: Experience with Dataplex and Data Catalog for automated data quality checks, metadata tagging, and column-level lineage from source to destination • Experience leading or mentoring data engineering teams • Familiarity with CI/CD for data pipelines (Cloud Build, GitHub Actions) • Exposure to multi-cloud or hybrid data architectures • Background in regulated industries (healthcare, financial services) where governance and lineage are critical
Responsibilities
• Architect and optimize large-scale data platforms on Google Cloud, with BigQuery as the analytical backbone • Design and build unified batch and streaming pipelines that handle high-volume, mission-critical workloads • Lead infrastructure-as-code practices, ensuring environments are repeatable, secure, and version-controlled • Implement open table formats to enable cross-cloud and cross-engine data interoperability • Establish automated data quality, metadata, and lineage practices across the data estate • Partner with data scientists, analysts, and product teams to translate business needs into reliable data products • Mentor engineers, review designs, and raise the bar on engineering standards
Benefits
• This role is eligible for our competitive salary and comprehensive benefits package to support your well-being: • Comprehensive Health Insurance • Paid Leave (Vacation/PTO) • Paid Holidays • Parental Leave • Bereavement Leave • 401 (k) Employer Match • Employee Referral Bonuses • Check out our complete list of benefits here - >https://egen.ai/people/#benefits • Important: All roles are subject to standard hiring verification practices, which may include background checks, employment verification, and other relevant checks. • EEO and Accommodations:
No credit card. Takes 10 seconds.