G-P - Software Engineer II (Data Platform)
Upload My Resume
Drop here or click to browse · PDF, DOCX, DOC, RTF, TXT
Requirements
• Experience: 3+ years of experience in software engineering, with a track record of building production-grade backend or data systems. • Databricks/Spark Mastery: Strong hands-on experience with Apache Spark and the Databricks/Delta Lake ecosystem is essential. • Databricks/Spark Mastery: • Apache Spark • Databricks/Delta Lake • Coding Fundamentals: Expert-level Python and SQL skills, with a deep understanding of software design principles, debugging, and distributed computing concepts. • Coding Fundamentals: • Automation Mindset: Experience with CI/CD practices and a working knowledge of Terraform (or similar IaC) to help automate the platform’s lifecycle. • Automation Mindset: • Terraform • Reliability Focus: A background in building monitored, observable systems where data quality and validation are treated as first-class citizens. • Reliability Focus: • 🌟 What Makes Us Different: • AI-Infused SDLC: We operate in an AI-accelerated environment. We encourage our engineers to leverage AI-first mindset throughout the SDLC from planning to AI-assisted development tools (e.g., GitHub Copilot, Cursor) to increase velocity, automate unit test generation, and focus on high-level architectural challenges rather than boilerplate code. • AI-Infused SDLC: • Actual compensation for this position may vary and will depend on multiple factors such as relevant qualifications, experience, education, and geographic location. For Full-Time Regular Employees, this position is also eligible for additional compensation as follows: • Sales Roles: This position is eligible for a commission structure in addition to base salary. • Non-Sales Roles: This position is eligible for an annual bonus which is paid dependent on various factors, including and without limitation, individual and company performance in addition to base salary.
Responsibilities
• Build & Enhance Data Platform Systems • Design and develop core components of the data platform, including high-volume event ingestion pipelines and real-time processing workflows using Apache Spark. • high-volume event ingestion pipelines • Apache Spark • Develop reusable data access layers and "framework-based" ETL/ELT processes that transform structured business data and event streams into trusted Lakehouse assets. • Contribute to the development of internal APIs and backend services that enable other engineering teams to interact with the data platform. • Build robust, fault-tolerant pipelines with a focus on data correctness, consistency, and availability. • data correctness, consistency, and availability • Implement schema enforcement and validation gates to maintain strict data governance across systems, preventing "data swamp" scenarios. • schema enforcement and validation gates • Optimize code and query performance to ensure workloads are both fast and cost-efficient. • Drive Observability & Quality • Build and own the observability framework (logging, metrics, and alerting) to monitor pipeline health, data freshness SLAs, and system uptime. • observability framework • Proactively identify and resolve bottlenecks in production; participate in root-cause analysis and incident response. • automated testing • Collaborative Platform Engineering • Participate in design discussions and code reviews, bringing a software engineering lens to data problems. • Follow governance and PII handling standards in day-to-day development, ensuring safe logging and access-aware implementations.
Benefits
• G-P values its employees and offers excellent benefits and perks including generous paid parental leave, flexible time off, spending accounts, medical insurance, dental insurance, vision insurance, sabbatical after 5 years and more. • Individuals residing, or applying to work, in the United States: California or Philadelphia, Pennsylvania, please review the following additional information:G-P will consider qualified applicants with arrest or conviction records in accordance with the California Fair Chance Act, Los Angeles City Fair Chance Act Ordinance, Los Angeles County Fair Chance Act Ordinance, and San Francisco Fair Chance Act Ordinance. Los Angeles applicants can review additional information regarding the Los Angeles City Fair Chance Act here: Fair Chance Initiative for Hiring Ordinance, and Philadelphia applicants can review information pertaining to Philadelphia’s Fair Criminal Record Screening Standards Ordinance here: Fair Chance Poster. Any consideration of a candidate’s background check with arrest or conviction records will include an individualized assessment based on the factors required by applicable law, including the candidate’s specific record and the duties and requirements of the specific job. • United States: California or Philadelphia • Pennsylvania, • G-P. Global Made Possible.
No credit card. Takes 10 seconds.