3Pillar - Senior Data Engineer
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT
Requirements
• Strong proficiency in Python programming language. • Minimum 5 years of experience in data engineering or a related field. • Deep understanding of AWS services including Kinesis, S3, Athena, Redshift, DynamoDB, and Lambda. • Experience with data ingestion pipelines, ETL processes, and data warehousing concepts. • Proficiency in SQL and NoSQL databases. • Strong problem-solving and analytical skills. • Excellent communication and collaboration skills. • Experience with data security and privacy best practices.
Responsibilities
• Develop and maintain scalable AWS infrastructure for big data processing and analytics projects within the company's product development team. • Design, implement, and optimize complex ETL processes to transform raw data into actionable insights using various tools such as Amazon Redshift, Athena, or Kinesis Data Analytics. • Collaborate with cross-functional teams including engineering, business intelligence, and operations to understand project requirements and align technical solutions accordingly. • Monitor system performance and troubleshoot issues related to data processing pipelines using AWS CloudWatch and other monitoring tools. • Ensure compliance with company policies and industry regulations regarding data privacy and security when handling sensitive information within the organization's infrastructure. • Stay updated on emerging technologies, best practices in big data engineering, and evolving trends to continuously improve existing systems or propose new solutions as needed by leadership.
No credit card. Takes 10 seconds.