Expertise in Databricks (Delta Lake, Spark, Databricks SQL, Unity Catalog, MLflow).
Strong background in data architecture and design of large-scale, distributed systems.
Proven experience building data pipelines (batch and streaming) with technologies like Delta Live Tables, Spark Structured Streaming, Kafka, Event Hubs, or Kinesis.
Solid understanding of DataOps practices: CI/CD for data workflows, testing frameworks, monitoring, and observability tools.
Proficiency in SQL and Python (PySpark).
Hands-on experience with cloud platforms (AWS, Azure, or GCP) including storage, networking, IAM, and security best practices.
Knowledge of data governance, lineage, and cataloging solutions (e.g., Unity Catalog, Collibra, Alation).
Ability to integrate APIs, third-party systems, and retail platforms into the data ecosystem.
Understanding of the entire business side.
Advanced English is essential (speaking)!
Responsibilities
To lead and manage a team of data engineers in the development and maintenance of Databricks clusters.
To design scalable solutions for big data analytics projects using Apache Spark within Databricks environment.
To collaborate with cross-functional teams to understand business needs, translate them into technical requirements, and ensure successful project delivery.
To monitor the performance of deployed models in production environments and optimize as necessary.
To mentor junior engineers on best practices for data engineering within Databricks environment.
To stay updated with industry trends and emerging technologies to continuously improve team's skill set.
Benefits
Health and dental insurance
Meal and food allowance
Childcare assistance
Extended paternity leave
Partnership with gyms and health and wellness professionals via Wellhub (Gympass) TotalPass;
Profit Sharing and Results Participation (PLR);
Life insurance
Continuous learning platform (CI&T University);
Free online platform dedicated to physical, mental, and overall well-being
Pregnancy and responsible parenting course
Partnerships with online learning platforms
Language learning platform
More details about our benefits here: https://ciandt.com/br/pt-br/carreiras
At CI&T, inclusion starts at the first contact. If you are a person with a disability, it is important to present your assessment during the selection process. See which data needs to be included in the report by clicking here.This way, we can ensure the support and accommodations that you deserve. If you do not yet have the assessment, don't worry: we can support you in obtaining it.
We have a dedicated Health and Well-being team, inclusion specialists, and affinity groups who will be with you at every stage. Count on us to make this journey side by side.