Sr. Data Engineer
Upload My Resume
Drop here or click to browse · PDF, DOCX, DOC, RTF, TXT
Requirements
• Strong proficiency in Python programming language. • Minimum 5 years of experience in data engineering or a related field. • Deep understanding of AWS services including Kinesis, S3, Athena, Redshift, DynamoDB, and Lambda. • Experience with data ingestion pipelines, ETL processes, and data warehousing concepts. • Proficiency in SQL and NoSQL databases. • Strong problem-solving and analytical skills. • Excellent communication and collaboration skills. • Experience with data security and privacy best practices.
Responsibilities
• Develop and maintain scalable AWS infrastructure for big data processing and analytics projects within the company's product development team. • Design, implement, and optimize complex ETL processes to transform raw data into actionable insights using various tools such as Amazon Redshift, Athena, or Kinesis Data Analytics. • Collaborate with cross-functional teams including engineering, business intelligence, and operations to understand project requirements and align technical solutions accordingly. • Monitor system performance and troubleshoot issues related to data processing pipelines using AWS CloudWatch and other monitoring tools. • Ensure compliance with company policies and industry regulations regarding data privacy and security when handling sensitive information within the organization's infrastructure. • Stay updated on emerging technologies, best practices in big data engineering, and evolving trends to continuously improve existing systems or propose new solutions as needed by leadership.