6+ years of professional experience in Data Engineering or equivalent technical roles (e.g., data architecture, big data development, or ETL engineering).
6+ years
2+ years of managerial experience, including mentoring, team leadership, and supporting delivery.
Strong expertise in SQL and distributed data systems.
Proficiency with PySpark and Databricks for processing and scaling large datasets.
PySpark
Databricks
Hands-on experience with Airflow for pipeline orchestration (Dagster/dbt a plus).
Airflow
Proven track record of delivering in fast-paced, deadline-driven environments with minimal oversight.
Strong problem-solving skills and ability to translate business needs into scalable technical solutions.
Excellent communication and collaboration skills with both technical and non-technical stakeholders.
Experience leveraging AI/ML models, vector search, or Elasticsearch to enhance data pipelines.
AI/ML models, vector search,
Elasticsearch
Familiarity with Django or similar web frameworks to support data-driven applications.
Django
This is a remote-friendly opportunity that can sit in NYC (where our headquarter is located), one of our office hubs (Austin, Miami, Denver or Mountain View,), or anywhere else in the US. However, depending upon where the remote work is performed, income could be subject to New York State tax withholding.
This is a remote-friendly opportunity that can sit in NYC (where our headquarter is located), one of our office hubs (Austin, Miami, Denver or Mountain View,), or anywhere else in the US.
As Our Data Engineering Manager You Will:
Working with product team to bring an idea to reality
Leveraging cutting edge technologies to solve complex data problems
Helping to lead a team through different data models and architectural decisions
You Are Likely To Succeed If:
Experience building a reliable and efficient data pipelines
Ability to meet tight deadlines in a fast paced environment
Responsibilities
Own the design, build, and optimization of end-to-end data pipelines that power our vendor universe.
Establish and enforce best practices in data modeling, orchestration, and system reliability.
Collaborate with product, engineering, and business stakeholders to translate requirements into robust, scalable data solutions.
Work extensively with Databricks and Airflow for large-scale data processing and orchestration.
Troubleshoot and resolve complex pipeline issues to ensure reliability and performance.
Contribute to the team’s technical strategy, helping drive improvements in scalability, performance, and efficiency.
Lead, mentor, and support engineers through challenges, code reviews, and project execution.
Benefits
Ownership That Matters: You’ll lead high-impact projects with real business outcomes
Ownership That Matters
Rapid Growth: We compress years of learning into months
Rapid Growth
Merit Over Titles: Trust and responsibility are earned through execution, not tenure
Merit Over Titles
Velocity with Purpose: We move fast, support each other, and aim high—always with purpose and intention
Velocity with Purpose:
If your ambition is matched by your work ethic—and you're hungry for a place where growth, impact, and ownership are the norm—YipitData might be the opportunity you’ve been waiting for.
We are looking for a highly skilled Data Engineering Manager to join our Data Engineering team and play a central role in building and scaling our vendor universe—the database of companies we track and analyze. Reporting directly to the Senior Director of Data Engineering, this role demands technical leadership, independence, and the ability to deliver under tight deadlines in a fast-paced environment.
Data Engineering Manager
As a Data Engineering Manager, you will design and maintain large-scale data pipelines, define best practices for ETL, and integrate emerging technologies to keep our platform on the cutting edge. You’ll work cross-functionally to deliver reliable, efficient, and scalable data solutions while contributing hands-on expertise in Databricks, Airflow, PySpark, and SQL.
Our compensation package includes comprehensive benefits, perks, and a competitive salary
We care about your personal life, and we mean it. We offer flexible work hours, flexible vacation, a generous 401K match, parental leave, team events, wellness budget, learning reimbursement, and more!
Your growth at YipitData is determined by the impact that you are making, not by tenure, unnecessary facetime, or office politics. Everyone at YipitData is empowered to learn, self-improve, and master their skills in an environment focused on ownership, respect, and trust. See more on our high-impact, high-opportunity work environment above!
The annual on-target earnings for this position is anticipated to be up to $215,000~ $240,000.
The final offer may be determined by a number of factors, including, but not limited to, the applicant's experience, knowledge, skills, abilities, as well as internal team benchmarks.
The compensation package also includes equity.
This role may be performed fully remotely within the United States. Please note that our US headquarters are located in NYC. We also have office hubs in Austin, Miami, and Mountain View. If the remote work is performed outside of these offices, income may be subject to New York State tax withholding.
This role may be performed fully remotely within the United States.
If the remote work is performed outside of these offices, income may be subject to New York State tax withholding.
Please note that for this position, we are not able to consider candidates who currently or in the future will require visa sponsorship.