Senior Data Engineer

Job description

About Us At XYZ Reality, we are a well-established, award-winning Series-A start-up accelerating toward our next funding round. Our mission is to expand our platform, enhancing features, performance, and scalability while revolutionizing the construction industry. We are a multi-disciplinary, fast-paced company working across diverse domains, including cloud development, data governance and processing pipelines, electronics, embedded software/hardware, mechanical design/manufacturing, AI & computer vision, and data science—all powering our BIM Platform. To drive this mission, we are seeking a Data Engineer experienced in data modelling, databases and data pipelines to support our existing tech stack as well as developing new features with performance, scalability in mind. You will work closely with our API/backend development and data pipeline team to create robust and efficient solutions. Responsibilities · Design, develop, and maintain dagster-based data pipeline using Python. · Design and implement efficient data models accommodating the planned product features and application requirements. · Develop SQL queries and procedures to be used by data pipeline and API services. · Debug, maintain and improve our existing codebase. · Develop and execute unit tests and integration tests to ensure software reliability. · Conduct performance profiling and stress testing to optimize system responsiveness. · Maintain clear, structured documentation for data models and ETL/ELT pipelines and codebases. · Collaborate closely with cross-functional teams, including client applications and cloud teams. · Stay adaptable, learning new technologies and contributing to various technical areas as needed. Required Skills & Experience · Bachelor’s degree in computer science or a related field or equivalent proven experience in database and data pipeline development. · Hands-on experience with code driven orchestration tools such as Dagster or Airflow · Solid experience with relational databases and SQL, preferably PostgreSQL. · Strong Python language and OOP skills. · Experience in data modelling for both transactional systems and analytical systems. · Strong debugging, troubleshooting, and performance optimization skills. · Proficiency with Git, including active participation in code reviews. · Excellent communication and teamwork skills. · Keen in developing in-house tech stacks as well as utilizing off-the-shelf components to build a robust solution. Preferred Qualifications · Familiarity with CI/CD pipelines, such as GitHub Actions and Liquibase. · Knowledge of REST/GraphQL or other API design methodologies. · Familiarity with working in Linux based environments. · Experience with Docker and Kubernetes for container orchestration. · Experience in Test-Driven Development (TDD), PyTest and software design patterns. What We Offer 🏝️ 25 days annual leave + public holidays 🩺 Private healthcare with Vitality 🎄 Christmas shutdown days on top of leave allowance (2-4 per year usually) 🚇 Office located within a 5-minute walk from Angel station 🏠 Hybrid working 🪙 Biannual salary reviews 🥳 Summer & Christmas staff parties 🍣 Free lunch bought in and after-work gathering/drinks every other Thursday in the office 💰 Employee referral scheme 🚀 Make a real-world impact of revolutionising the construction industry If you'd like to see the products and technology we have created so far on our journey you can view it in action through our YouTube https://www.youtube.com/@XYZReality/videos and Website http://www.xyzreality.com/