Zencore - Senior Data Engineer (Contract)
Requirements
• 5+ years of experience serving as a data engineer or in a comparable engineering capacity • Strong skills with Python or a JVM language (Java, Scala) • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases. • Experience working with cloud data warehouses, specifically BigQuery or +Snowflake • Experience working with data platforms built on public cloud in a production setting. • Experience working with GCP native data toolset is preferred. • Having built ELT or ETL pipelines processing large amounts of data. • Experience with dbt or Airbyte is preferred. • Experience developing production Spark or Hadoop applications • Gained experience with a workload scheduling and orchestration tool such as Apache Airflow/Cloud Composer • Familiarity with modern DataOps (e.g. quality eng, testing, pipeline deployments etc) practices and IaC (e.g. Terraform) • Familiarity with the constellation of tools in the data engineering ecosystem. You should be comfortable picking up and learning a new tool, as well as recommending tools that have served you well. • Experience with batch, micro-batch, and real-time streaming architectures • Good internal and customer-facing communication skills • Experience with relational database management systems and change data capture (CDC) is a plus • We are professionals you can Trust. Our people have the extensive experience to get the job done • We share unbiased opinions and are comfortable with the hard truths. You are the subject matter experts for our customers. • We are the Missing Link. You will connect our customers to Google and move quickly when others can’t • We remove uncertainty and risk by clearly outlining the process of cloud migration for our customers • We accelerate timelines and do not dwell on a challenge. You’ll move faster and expose “unknown unknowns” for our customers • We show empathy. Our customers believe in us because we can relate to their complexities. • First rule at Zencore - Be Kind • Own the process - own your customer’s success by proactive practices • Work hard to reach the destination, but make sure to enjoy the journey • Champion a consistent collaborative culture • Be receptive to Feedback • Challenge the Status Quo
Responsibilities
• Work with fast-paced innovative companies leveraging Cloud as the key driver of their transformation. • Cover a large spectrum of technology topics like ETL/ELT, Data Warehousing, Distributed Data Processing, and Streaming Data systems. • Build or maintain ELT or ETL pipelines processing large amounts of data. • Develop production Spark or Hadoop applications if applicable experience is present. • Work with a workload scheduling and orchestration tool such as Apache Airflow/Cloud Composer for managing tasks in the cloud environment. • Be familiar with modern DataOps practices, including quality engagement, testing, pipeline deployments etc., along with IaC tools like Terraform. • Have experience working with batch, micro-batch, and real-time streaming architectures to handle various data processing needs effectively.
Benefits
• Remote work options could potentially exist given Zencore’s innovative approach to customer engagement; however, this is also not directly stated in the job posting text provided.
Apply in one click
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT