Data Engineer

Job description

Your mission Are you ready to take part in the AI revolution in business? If yes, we have an exciting opportunity for you. We are looking for a Data Engineer passionate about building scalable, reliable data infrastructure that powers AI. You will help make data accessible, trustworthy, and ready for machine learning forming the foundation of Aily’s decision intelligence platform. About the team Our Data team owns the full data lifecycle—from ingestion and transformation to quality and delivery. We build scalable pipelines and APIs that power insights across domains like Finance, R&D, and Go-to-Market. What you’ll work on Designing and maintaining scalable, multi-tenant data pipelines Ensuring data quality, reliability, and governance Collaborating with Product, Engineering, and Data Science teams Tech stack Languages & Frameworks: Python is our core for pipelines, APIs, and CLI tooling. We use FastAPI and Pydantic to serve typed, high-performance REST APIs to our platform. Data Transformation & Modeling: We use dbt for our SQL-based transformation layer and SQLModel with Alembic for ORM-based schema management and versioned migrations. Storage & Analytics: We utilize DuckDB and DuckLake as our embedded analytics engine, all hosted on a robust AWS infrastructure (S3, IAM). Orchestration & Workflow: Apache Airflow handles our complex event-driven and scheduled job flows. Quality & Engineering Excellence: We prioritize reliability through pytest for QA validations, GitHub for version control, and a rigorous PR-based code review process. Your profile Core responsibilities Senior Data Engineer - 4+ years of experience All of the above, plus: Lead the design and implementation of complex, scalable data platforms and pipelines that support multiple teams and use cases. Drive improvements in data infrastructure, tooling and processes that reduce operational burden and improve data team efficiency. Own critical data systems end-to-end, from requirements to production monitoring, with only strategic guidance. Establish and enforce data engineering standards (quality, governance, reliability, performance) across the organization. Collaborate with ML Engineering, Data Science and Product teams to design data architecture that powers AI at scale. Principal Data Practitioner – 8+ years of experience Principal Data Engineer - 8+ years of experience All of the above + Act as technical authority for the Data Platform, deeply understanding Aily's data architecture and shaping long-term data strategy across teams Lead cross-team data architecture discussions and technical design sessions, ensuring scalable, future-proof solutions Define and maintain org-wide data standards (quality, governance, reliability, performance, security) and drive adoption across all teams Own multiple critical data initiatives simultaneously, managing complexity, external stakeholders, and leadership expectations Solve org-critical data challenges and represent data engineering standards as the ultimate quality gatekeeper Who we’re looking for Data Engineers who excel at building reliable, scalable data infrastructure that powers AI decision-making at enterprise scale. Hands-on builders who love creating robust data pipelines, optimizing systems for performance and cost, and ensuring data quality at every step. Strong collaborators who partner with Data Scientists, ML Engineers, Product teams, and business stakeholders to turn raw data into actionable insights. Startup mindset: thrives in ambiguity, proactively solves complex data challenges, and improves tooling beyond your immediate scope. Ready to Lead Boldly – building the data foundation that enables Aily's AI platform to deliver millions of real-time insights daily What we offer Benefits Medical insurance: Your health, and your family's, is our top priority. You're fully covered. Holiday flat in Valencia: Dreaming of sunny days in Spain? Our company flat is ready for your next getaway. Gifts for special occasions: We love celebrating you. Expect thoughtful surprises on Easter, Women's Day, Father's Day, and more. Anniversary gifts: Your 1st, 5th, and 10th work anniversaries are milestones worth celebrating, and we mark each of them with a special gift. Team-building events: We value connection beyond work, offering engaging team experiences in great locations to inspire collaboration and fun. End of year celebrations: We wrap up each year with a special celebration, filled with joy, laughter, and unforgettable moments. Day off on your birthday: Your special day is yours to enjoy, no work required. Community and social initiatives: We bring people together through activities like Bring Your Kids to the Office Day, donation drives, tree planting, sporting events, decorating the Christmas tree with your colleagues, celebrating new office openings, Principal33's anniversary, and more. Access to Udemy: Growth matters, so you get unlimited access to thousands of courses. Develop your skills anytime, anywhere. German language courses: Dedicated courses to help you build your German skills, supporting both personal and professional growth. Personal and professional growth: We support your development through masterclasses with experienced trainers, and we're open to investing in courses and training that help you grow.