AIA Contract Documents - Senior Data Engineer
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT
Requirements
• 5+ years of experience in Data Engineering or related field • Strong expertise in Databricks, including pipeline development, orchestration, and data architecture • Experience designing data models to support AI/ML applications • Proficiency in Python (PySpark) and SQL • Hands-on experience with Azure-based data environments • Experience with CI/CD tools such as Azure DevOps (ADO) • Ability to work independently with minimal oversight and ramp quickly in a fast-paced environment • Experience with Databricks Asset Bundles for deployment and environment management, preferred • Familiarity with transitioning CI/CD workflows to GitHub, preferred • Experience working in Agile development environments, preferred • Exposure to AI/ML workflows and data requirements for model development, preferred • What Success Looks Like • Efficient, scalable data pipelines supporting AI initiatives • Well-structured, high-quality datasets optimized for machine learning • Streamlined deployment and orchestration of Databricks assets across environments • Strong collaboration with stakeholders to deliver data solutions aligned with business needs
Responsibilities
• Design and implement scalable data models optimized for AI/ML use cases, ensuring data is structured for effective model training and inference • Architect and manage data pipelines using Databricks, including orchestration, job scheduling, and workflow optimization • Develop and maintain robust ETL/ELT processes to support data ingestion, transformation, and delivery across systems • Leverage Databricks Asset Bundles to manage deployment of data assets (pipelines, jobs, notebooks, and files) across environments • Collaborate with cross-functional teams to align data architecture with AI initiative requirements and business objectives • Ensure data quality, integrity, and governance standards are met across all pipelines and datasets • Contribute to CI/CD practices using Azure DevOps (ADO), with a future transition to GitHub-based workflows • Participate in Agile development processes, including sprint planning, stand-ups, and iterative delivery
Benefits
• $150K – $180K • Offers Bonus • Remote • Company-paid health benefits • 401k with company match • WFH Stipend • Upload your resume here to autofill key application fields. • Drop your resume here! • Parsing your resume. Autofilling key fields... • or drag and drop here • Current Employee at ACD / Referral • How many years of experience in Data Engineering do you have? • Decline to self-identify • Hispanic or Latino - A person of Cuban, Mexican, Puerto Rican, South or Central American, or other Spanish culture or origin regardless of race. • Hispanic or Latino • White (Not Hispanic or Latino) - A person having origins in any of the original peoples of Europe, the Middle East, or North Africa. • White • Black or African American (Not Hispanic or Latino) - A person having origins in any of the black racial groups of Africa. • Black or African American • Native Hawaiian or Other Pacific Islander (Not Hispanic or Latino) - A person having origins in any of the peoples of Hawaii, Guam, Samoa, or other Pacific Islands. • Native Hawaiian or Other Pacific Islander • Asian (Not Hispanic or Latino) - A person having origins in any of the original peoples of the Far East, Southeast Asia, or the Indian Subcontinent, including, for example, Cambodia, China, India, Japan, Korea, Malaysia, Pakistan, the Philippine Islands, Thailand, and Vietnam. • Asian • American Indian or Alaska Native (Not Hispanic or Latino) - A person having origins in any of the original peoples of North and South America (including Central America), and who maintain tribal affiliation or community attachment. • American Indian or Alaska Native • Two or More Races (Not Hispanic or Latino) - All persons who identify with more than one of the above five races. • Two or More Races • Hispanic or Latino • White (Not Hispanic or Latino) • Black or African American (Not Hispanic or Latino) • Native Hawaiian or Other Pacific Islander (Not Hispanic or Latino) • Asian (Not Hispanic or Latino) • American Indian or Alaska Native (Not Hispanic or Latino) • Two or More Races (Not Hispanic or Latino) • I identify as one or more of the classifications of protected veteran listed above • I am not a protected veteran
Similar Jobs
No credit card. Takes 10 seconds.