Kpler - Senior Data Engineer (Data EcoSystems)
Upload My Resume
Drop here or click to browse · PDF, DOCX, DOC, RTF, TXT
Requirements
• Skills needed: Java programming for Snowflake ingestion pipelines. • Years of experience: Not explicitly stated. • Education: Not explicitly stated. • Certifications: None mentioned. • Must-haves: Experience with monitoring and observability, stability, performance, scalability, on-call readiness in data services; ability to identify bottlenecks and reduce failure modes proactively; experience leading complex initiatives across teams while coordinating end-to-end architecture implementation; knowledge of Snowflake ingestion pipelines.
Responsibilities
• Develop and maintain complex engineering applications that handle large volumes of structured and unstructured data efficiently. • Design scalable database systems to support the company's big data needs while ensuring high availability and disaster recovery capabilities. • Implement robust ETL (Extract, Transform, Load) processes for seamless integration between disparate sources of information within our organization. • Optimize query performance using advanced SQL techniques and database indexing strategies to ensure rapid data retrieval times. • Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications that can be implemented in the engineering platform. • Monitor system health, troubleshoot issues proactively, and implement preventative measures to minimize downtime and ensure continuous operation of data systems. • Stay current with emerging technologies relevant to big data processing such as Hadoop, Spark, or NoSQL databases; evaluate their potential integration into existing infrastructure for enhanced performance capabilities. • Ensure compliance with industry standards and regulations regarding the handling and protection of sensitive information within our organization's systems.
Benefits
• Paid Time Off (PTO) is included; however, exact numbers or policies regarding PTO days/hours per year aren't specified here. • Insurance coverage offered to employees isn't detailed within the given text snippet. • Perks are mentioned but not specifically enumerated in this excerpt of the job posting. • Remote work options available, though specifics such as frequency or conditions for remote work aren't provided herein.
Similar Jobs
No credit card. Takes 10 seconds.