Altimate - Senior Software Engineer
Upload My Resume
Drop here or click to browse · PDF, DOCX, DOC, RTF, TXT
Requirements
• 8+ years of experience in Software engineering, with a focus on building scalable data pipelines and systems • Strong proficiency in Python and SQL • Extensive experience with SQL query profiling, optimization, and performance tuning, preferably with Snowflake • Deep understanding of SQL Abstract Syntax Tree (AST) and experience working with SQL parsers (e.g., sqlglot) for generating column-level lineage and dynamic ETLs • Experience in building data pipelines using Airflow or dbt • Solid understanding of cloud platforms, particularly AWS • Familiarity with Kubernetes (K8s) for containerized deployments
Benefits
• Projects You'll Work On: • Building PB Scale Data Pipelines: Building highly performant large scale data infrastructure that can scale to 100K+ jobs and handle PB scale data per day. • Cloud-Native Data Infrastructure: Design and implement robust, scalable data infrastructure on AWS, utilizing Kubernetes and Airflow for efficient resource management and deployment. • Intelligent SQL Ecosystem: Design and develop a comprehensive SQL intelligence system encompassing query optimization, dynamic pipeline generation, and data lineage tracking. Leverage your expertise in SQL query profiling, AST analysis, and parsing to create a sophisticated engine focused on query performance improvements, building adaptive data pipelines, and implementing granular column-level lineage. • Innovation at the Forefront: Push the boundaries of data engineering by combining traditional techniques with cutting-edge AI technologies. • High Visibility: Directly affect the productivity and capabilities of global data teams, as your contributions will be crucial to the daily operations of thousands of users spread across 100s of countries. • Open Source Contribution: As part of our commitment to the developer community, you will contribute to our open-source initiatives, gaining recognition in the tech community. • Career Growth: This role is a launchpad into the rapidly advancing field of AI-powered data engineering, offering exposure to state-of-the-art technologies and generative AI applications. • Extensive professional development opportunities and resources for continuous learning • Dynamic and intellectually stimulating work environment with a team of talented engineers • Opportunities to shape the direction of the company and leave a lasting impact • If this sounds like the perfect role for you, we can't wait to meet you! Apply now and let's build something amazing together.
Similar Jobs
No credit card. Takes 10 seconds.