airSlate - Senior Data Engineer
Requirements
• Python/Scala/Java skills required • Experience with data processing tools such as Apache Spark, Flink, Beam and pipeline orchestration using Airflow or NiFi. • Knowledge of message brokers and distributed streaming platforms (e.g., Kafka). • Database experience with SQL, NoSQL, and open formats is required. • Familiarity with Dev Tools like Git, Docker, Kubernetes, Jira etc. • Experience in Infrastructure/Cloud services such as AWS or GCP preferred but not mandatory (NICE_TO_HAVE). • Understanding of Data Privacy and Security principles is required. • Knowledge of Algorithms, Data Structures, and Data Modeling expected. • Familiarity with data development principles/processes needed. • Experience in writing requirements/documentation desired. • Practical experience or understanding of CI/CD practices preferred but not mandatory (NICE_TO_HAVE).
Responsibilities
• Develop and maintain scalable ETL pipelines for large datasets to ensure efficient processing of big data analytics tasks within the organization's cloud infrastructure. • Design robust database schemas that optimize query performance while ensuring high availability and disaster recovery capabilities in a hybrid environment, including both on-premises systems and public/private clouds. • Implement security best practices to protect sensitive data throughout its lifecycle within the organization's infrastructure by developing access control mechanisms and encryption strategies for databases and cloud storage solutions. • Collaborate with cross-functional teams, including IT operations, business analysts, and product managers, to understand organizational needs related to big data analytics projects and align technical implementations accordingly. • Monitor system performance using established metrics and tools; identify bottlenecks or inefficiencies within the ETL processes and database systems that impact overall project timelines and deliverables. • Stay current with emerging technologies, industry trends, best practices for data engineering projects involving big data analytics tasks by attending relevant conferences, workshops, webinars, or online courses to continuously improve skills in the field of cloud computing and security engineering within a hybrid environment. • Document technical processes, methodologies, and architectures used throughout project development phases for future reference and knowledge transfer among team members; maintain comprehensive logs detailing system changes made during ETL pipeline modifications as well as database schema updates to ensure traceability and accountability in the event of issues or discrepancies. • Provide technical leadership by mentoring junior engineers, sharing expertise on best practices for data engineering projects involving big data analytics tasks within a hybrid environment; actively participate in code reviews with peers while providing constructive feedback to improve overall team performance and project outcomes based on established coding standards. • Communicate effectively with stakeholds across various departments, including business analysts, product managers, IT operations teams as well as external partners or vendors involved in the organization's big data analytics projects; translate technical requirements into actionable insights for non-technical audiences while ensuring clear understanding of project goals and deliverables. • Participate actively in recruitment efforts by reviewing applications, analyzing resumes using AI tools to identify qualified candidates with relevant experience or skills needed for data engineering projects involving big data analytics tasks within a hybrid environment; provide recommendations based on established criteria while maintaining confidentiality and privacy of applicant information. • Provide technical leadership by mentoring junior engineers, sharing expertise on best practices for data engineering projects involving big data analytics tasks within a hybrid environment; actively participate in code reviews with peers while providing constructive feedback to improve overall team performance and project outcomes
Benefits
• Salary: Explicitly stated as a benefit with an annual salary of $120k for the role in Poland and up to $150k+ based on experience. • Remote work options: The posting explicitly states that the company embraces remote and hybrid working with opportunities to work from offices in Poland, Romania or Ukraine as well as remotely from many countries.
Apply in one click
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT