Senior Databricks Data Engineer

Job description

Responsibilities Data Solution Design and Development Design, develop, and implement complex, scalable Lakehouse solutions on the Databricks platform across major cloud environments ( Azure, AWS, or GCP ). Design, build, and optimize modular data pipelines using Delta Lake to ensure data efficiency, reliability, and quality. Implement data governance and secure data access layers utilizing Databricks Unity Catalog . Programming & Scripting Write clean, efficient, and maintainable SQL and Python code within Databricks Notebooks and IDEs. Develop automation scripts leveraging the Databricks CLI and REST APIs to manage workspace assets and configurations. DevOps & Automation Establish, maintain, and optimize CI/CD pipelines (e.g., GitHub Actions, GitLab CI/CD) leveraging Declarative Automation Bundles (DABs) as the primary mechanism for rapid, reliable, and software-defined project deployments. Automate and orchestrate data pipeline processes using Databricks Workflows or Spark Declarative Pipelines (formerly DLT) Cloud Data Services Deliver solutions centered on the Databricks ecosystem, integrating seamlessly with cloud-native storage and security services (e.g., AWS S3/IAM, Azure ADLS/Entra ID, or Google Cloud Storage/IAM). Design and implement modern data modeling and data warehousing solutions using Databricks SQL Warehouses. Project and Team Management Own and manage the technical aspects of deliveries (at least at component level). Participate in project planning, task estimation, testing, and liaising with business stakeholders. Create comprehensive technical documentation. Requirements Programming & Scripting Must have proficiency in both SQL and Python , emphasizing clean, efficient, and maintainable code optimized for cloud data platforms. Hands-on experience utilizing AI coding tools and agents (e.g., Databricks Assistant in Chat/Agent mode, GitHub Copilot, Cursor, or Claude Code) to augment programming workflows, generate boilerplate code, and resolve errors. Experience with API integration and scripting for platform automation. DevOps & Automation Hands-on experience using Declarative Automation Bundles (DABs) to manage, bundle, and deploy Databricks resources as code. Solid understanding of standard CI/CD tools (e.g., GitHub Actions, GitLab CI/CD) and version control (Git/Databricks Repos) to streamline development lifecycles. Cloud Data Services A 3-5 years of hands-on experience in data engineering, with a strong focus on Databricks Lakehouse architecture . Proven track record of delivering at least one complex, scalable data solution utilizing core Databricks features ( Unity Catalog, Delta Lake, Databricks SQL ). Strong experience operating Databricks within at least one major cloud environment ( AWS, Azure, or GCP ). Bonus Points if you have: Experience working with dbt (specifically dbt-databricks) . Knowledge of Databricks AI/ML and GenAI capabilities (e.g., Mosaic AI, Databricks Assistant/Genie, MLflow, Feature Store, or Model Serving). Apache Spark knowledge. Soft and Other Skills Strong team player with a proactive mindset, eager to take on challenges and drive modern data solutions. Great problem-solving skills, analytical thinking, and a structured approach to decision-making. Native Hungarian and excellent written and verbal communication skills in English . Diverse projects - In each assignment, there is always something new, either on the technical or the business side, that helps you grow. Empowerment - Trust is a cornerstone of our culture. We'll hold your hand if you need it, but give you space if you’d like to push your limits. Don't lose sight of the goal, the rest is up to you. Flexible ways of working – We love our location on Bartók Béla RoadStreet which is not only an office but also a community space. However, we respect our people to do their work when and how they work best. Balanced life - We love what we do and aim to work together with others who do their work with love. At the same time, we highly value fresh minds, for which we think a healthy work/life balance is essential! Forget about pointless meetings and unnecessary administration. Mentoring from your first day – Continuous support is not just a set of fancy words we throw around here; your mentor follows you throughout your career path. Learning & Development opportunities - If you want to keep learning and improving, we are on to a great track! We look forward to helping you unlock your potential. Supportive corporate culture - In addition to our professional success, we are proud of the social cohesion that is based on comradery, mutual support, and respect and is constantly nurtured in the company. Hiflylabs is a Budapest-based company. We have 250+ employees at this moment and we are constantly thriving. Our application development team and business intelligence experts work to provide effective solutions to business problems. Our professional team has proved its expertise through 10 years of experience, participating in multiple Business Intelligence projects - both Hungarian and international - in various industries, such as the financial, telecommunication and energy sectors. We deliver a wide portfolio of innovative business solutions that include Data Warehouses, Business Intelligence, Data Analytics. In the last few years we have acquired a high level of competence in Application Development. Hiflylabs is committed to innovation, and encourages the realization of innovative initiatives in the form of independent startups. Get an insight on how we work and check out our Website , LinkedIn page and YouTube channel !