Senior Solutions Consultant

Job SummaryWe are seeking a skilled Senior Consultant – Databricks to design, develop, and implement modern data engineering solutions using the Databricks platform. The ideal candidate will work closely with customers and internal teams to understand business requirements, build scalable data pipelines, and deliver high-quality data solutions leveraging cloud-based Lakehouse architecture.The role requires strong hands-on experience in Databricks, Apache Spark, Python, and SQL, along with the ability to collaborate with stakeholders and contribute to end-to-end data platform implementations.Experience6+ years of overall experience in Information Technology.3+ years of hands-on experience with Databricks.Experience in developing and implementing enterprise data engineering solutions.Key ResponsibilitiesCollaborate with customers and business stakeholders to understand data and analytics requirements.Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark.Build and optimize ETL/ELT workflows for batch and near real-time data processing.Implement Data Lakehouse solutions following the Medallion Architecture (Bronze, Silver, Gold).Develop data transformation logic using Python, PySpark, and SQL.Ensure data quality, reliability, and performance through testing and optimization.Troubleshoot and resolve data processing and performance issues.Work closely with Solution Architects, Data Engineers, and DevOps teams to deliver end-to-end solutions.Participate in code reviews and follow development best practices.Create technical documentation and provide support during deployment and production activities.Required Technical SkillsStrong hands-on experience with Databricks.Proficiency in Python, SQL, and Apache Spark (PySpark).Good understanding of Data Lake and Lakehouse architecture.Experience implementing Bronze, Silver, and Gold data layers.Experience designing and developing ETL/ELT pipelines.Knowledge of Delta Lake and Spark performance optimization.Understanding of data modeling and data integration concepts.Experience working with structured and semi-structured data.Preferred SkillsExperience with cloud platforms such as Microsoft Azure, AWS, or Google Cloud Platform.Familiarity with Delta Live Tables, Unity Catalog, Databricks Workflows, and MLflow.Experience with orchestration tools such as Azure Data Factory, Apache Airflow, or similar.Knowledge of Git, CI/CD pipelines, and Agile development methodologies.Databricks or cloud platform certifications are an added advantage.Soft SkillsStrong analytical and problem-solving skills.Good communication and customer interaction skills.Ability to gather and analyze business requirements.Strong collaboration and teamwork skills.Ability to manage multiple tasks and deliver within project timelines.Willingness to learn new technologies and adapt to evolving project requirements.What You'll BringHands-on expertise in Databricks and modern data engineering practices.A customer-focused approach with the ability to translate business requirements into technical solutions.A passion for building scalable, reliable, and high-performance data platforms.The ability to work independently as well as collaboratively in cross-functional teams.

Job Summary

We are seeking a skilled Senior Consultant – Databricks to design, develop, and implement modern data engineering solutions using the Databricks platform. The ideal candidate will work closely with customers and internal teams to understand business requirements, build scalable data pipelines, and deliver high-quality data solutions leveraging cloud-based Lakehouse architecture.

The role requires strong hands-on experience in Databricks, Apache Spark, Python, and SQL, along with the ability to collaborate with stakeholders and contribute to end-to-end data platform implementations.

Experience

• 6+ years of overall experience in Information Technology.
• 3+ years of hands-on experience with Databricks.
• Experience in developing and implementing enterprise data engineering solutions.

Key Responsibilities

• Collaborate with customers and business stakeholders to understand data and analytics requirements.
• Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark.
• Build and optimize ETL/ELT workflows for batch and near real-time data processing.
• Implement Data Lakehouse solutions following the Medallion Architecture (Bronze, Silver, Gold).
• Develop data transformation logic using Python, PySpark, and SQL.
• Ensure data quality, reliability, and performance through testing and optimization.
• Troubleshoot and resolve data processing and performance issues.
• Work closely with Solution Architects, Data Engineers, and DevOps teams to deliver end-to-end solutions.
• Participate in code reviews and follow development best practices.
• Create technical documentation and provide support during deployment and production activities.

Required Technical Skills

• Strong hands-on experience with Databricks.
• Proficiency in Python, SQL, and Apache Spark (PySpark).
• Good understanding of Data Lake and Lakehouse architecture.
• Experience implementing Bronze, Silver, and Gold data layers.
• Experience designing and developing ETL/ELT pipelines.
• Knowledge of Delta Lake and Spark performance optimization.
• Understanding of data modeling and data integration concepts.
• Experience working with structured and semi-structured data.

Preferred Skills

• Experience with cloud platforms such as Microsoft Azure, AWS, or Google Cloud Platform.
• Familiarity with Delta Live Tables, Unity Catalog, Databricks Workflows, and MLflow.
• Experience with orchestration tools such as Azure Data Factory, Apache Airflow, or similar.
• Knowledge of Git, CI/CD pipelines, and Agile development methodologies.
• Databricks or cloud platform certifications are an added advantage.

Soft Skills

• Strong analytical and problem-solving skills.
• Good communication and customer interaction skills.
• Ability to gather and analyze business requirements.
• Strong collaboration and teamwork skills.
• Ability to manage multiple tasks and deliver within project timelines.
• Willingness to learn new technologies and adapt to evolving project requirements.

What You'll Bring

• Hands-on expertise in Databricks and modern data engineering practices.
• A customer-focused approach with the ability to translate business requirements into technical solutions.
• A passion for building scalable, reliable, and high-performance data platforms.
• The ability to work independently as well as collaboratively in cross-functional teams.

Unison Consulting was launched in Singapore on September 2012, the hub of the financial industry, with innovative visions in the technocratic arena. We are a boutique next-generation Technology Company with strong business-interests in Liquidity risk, Market Risk, Credit Risk and Regulatory Compliance. Unison provides technology consulting and services to implement Risk Management and Risk Analytics System for Financial Institutions. Our services suite comprises of Techno-Functional consulting, systems integration, Business Intelligence, information management, and custom development of IT solutions, plus project management expertise for financial institutions. We have expertise in latest cutting edge technology to achieve better total cost of ownership. Through our qualified professionals, we assist you drive your unique risk management strategies, whether that means efficient monitoring, improving risk appetite of the financial institutions, complying with regulations, or capturing growth opportunities through innovation, this is what maximizes your decision taking potential. At Unison Consulting, we view clients as partners, and our success is only measured by the success of our partners. So we put it all on the table in order to exceed expectations. Our staff consists of young, energetic and innovative consultants who are never afraid to challenge the conventions and push the boundaries in an effort to help our clients. For every project, no matter how large or how small, we strive to not only meet your needs, but deliver a showcase in your field.

Unison Consulting was launched in Singapore on September 2012, the hub of the financial industry, with innovative visions in the technocratic arena. We are a boutique next-generation Technology Company with strong business-interests in Liquidity risk, Market Risk, Credit Risk and Regulatory Compliance. Unison provides technology consulting and services to implement Risk Management and Risk Analytics System for Financial Institutions.

Our services suite comprises of Techno-Functional consulting, systems integration, Business Intelligence, information management, and custom development of IT solutions, plus project management expertise for financial institutions. We have expertise in latest cutting edge technology to achieve better total cost of ownership. Through our qualified professionals, we assist you drive your unique risk management strategies, whether that means efficient monitoring, improving risk appetite of the financial institutions, complying with regulations, or capturing growth opportunities through innovation, this is what maximizes your decision taking potential.

At Unison Consulting, we view clients as partners, and our success is only measured by the success of our partners. So we put it all on the table in order to exceed expectations. Our staff consists of young, energetic and innovative consultants who are never afraid to challenge the conventions and push the boundaries in an effort to help our clients. For every project, no matter how large or how small, we strive to not only meet your needs, but deliver a showcase in your field.