Data Engineering Intern

Responsibilities

• Develop and implement solutions for managing large datasets within the company's infrastructure.
• Collaborate with cross-functional teams to understand business needs and translate them into technical requirements.
• Conduct data quality assessments and cleaning as necessary, ensuring accuracy in reporting and analytics processes.
• Design, develop, deploy, test, document, monitor, troubleshoot, optimize, maintain, and secure databases or other forms of storage systems used by the company to manage its big data assets.
• Perform ETL (Extract, Transform, Load) operations using tools like Apache NiFi, Talend Open Studio for Data Integration, Informatica PowerCenter, etc., as required in projects.
• Create and maintain a robust set of SQL queries that can be used to extract meaningful insights from the company's data assets when needed by business users or other teams within ShopBack.
• Monitor system performance using tools like Prometheus/Grafana, New Relic, Datadog etc., as required in projects and provide regular reports on key metrics for management review.
• Participate actively in team meetings to discuss project statuses, roadblocks encountered during the implementation of solutions or troubleshooting issues with data systems when needed by ShopBack's engineering teams.
• Stay up-to-date and familiarize yourself with industry best practices for big data management as well as emerging technologies in this field to continuously improve your skill set, including but not limited to Apache Spark, Hadoop ecosystem tools (like Pig/Hive), NoSQL databases like MongoDB or Cassandra.
• Contribute actively and constructively during code reviews with peers on data engineering projects as required by ShopBack's internal processes for ensuring high quality of work delivered in the company’s products, services etc., including but not limited to tools such as GitHub/GitLab/Bitbucket or other version control systems used internally at ShopBack.
• Attend and actively participate in training sessions on new technologies relevant to data engineering projects within your organization when required by management for skill enhancement purposes.
• Work closely with the business analysts, product managers etc., as needed during project scoping phases or while understanding their requirements before starting any technical work related to a specific big data solution implementation at ShopBack.