xyz-reality - Senior Data Engineer
Requirements
• · Bachelor’s degree in computer science or a related field or equivalent proven experience in database and data pipeline development. • · Solid experience with relational databases and SQL, preferably PostgreSQL. • · Strong Python language and OOP skills. • · Experience in data modelling for both transactional systems and analytical systems. • · Strong debugging, troubleshooting, and performance optimization skills. • · Proficiency with Git, including active participation in code reviews. • · Excellent communication and teamwork skills. • · Keen in developing in-house tech stacks as well as utilizing off-the-shelf components to build a robust solution. • · Experience with Dagster or other data orchestration technologies. • · Familiarity with CI/CD pipelines, such as GitHub Actions and Luquibase. • · Knowledge of REST/GraphQL or other API design methodologies. • · Familiarity with working in Linux based environments. • · Experience with Docker and Kubernetes for container orchestration. • · Experience in Test-Driven Development (TDD), PyTest and software design patterns.
Responsibilities
• · Design, develop, and maintain dagster-based data pipeline using Python. • · Design and implement efficient data models accommodating the planned product features and application requirements. • · Develop SQL queries and procedures to be used by data pipeline and API services. • · Debug, maintain and improve our existing codebase. • · Develop and execute unit tests and integration tests to ensure software reliability. • · Conduct performance profiling and stress testing to optimize system responsiveness. • · Maintain clear, structured documentation for data models and ETL/ELT pipelines and codebases. • · Collaborate closely with cross-functional teams, including client applications and cloud teams. • · Stay adaptable, learning new technologies and contributing to various technical areas as needed.
Benefits
• 🏝️ 25 days annual leave + public holidays • 🩺 Private healthcare with Vitality • 🎄 Christmas shutdown days on top of leave allowance (2-4 per year usually) • 🚇 Office located within a 5-minute walk from Angel station • 🏠 Hybrid working • 🥳 Summer & Christmas staff parties • 🍣 Free lunch bought in and after-work gathering/drinks every other Thursday in the office • 💰 Employee referral scheme • 🚀 Make a real-world impact of revolutionising the construction industry • If you'd like to see the products and technology we have created so far on our journey you can view it in action through our YouTube https://www.youtube.com/@XYZReality/videos and Website http://www.xyzreality.com/
Apply in one click
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT