We are seeking a Senior Data Engineer with strong SQL and Java expertise to design and deliver scalable data solutions. In this role, you will leverage Java's robustness and Scala's functional data-processing power to build scalable pipelines, manage distributed big data frameworks, and optimize our data platform.Location: 3days/w onsite in GlasgowKey ResponsibilitiesDesign, develop, and maintain scalable data pipelines to support data integration, transformation, and analytics requirements.Write efficient, high-performance SQL queries, stored procedures, and data transformation logic.Build and maintain backend data processing applications using Java.Develop scalable APIs and microservices architectures.Work with batch and near real-time data processing frameworks to deliver reliable data solutions.Optimise data models, database performance, and query execution.Collaborate with data architects, analysts, and business stakeholders to translate requirements into scalable data solutions.Implement automated testing, monitoring, and data quality controls across the data platform.RequirementsEssential Skills & Experience• Java: 5+ years of professional experience with Java (Version 11 or higher preferred).• Advanced SQL skills with experience in performance tuning, data modelling, and complex query development.• Strong Java development experience, including object-oriented design and enterprise application development.• Experience designing and developing ETL/ELT pipelines.• Experience working with relational databases such as PostgreSQL, SQL Server, Oracle, or MySQL.• Understanding of data warehousing concepts and dimensional modelling.• Experience with version control systems such as Git.• Knowledge of cloud-based data platforms and modern data engineering practices.Desirable Skills• Experience with Scala development.• Experience with Apache Spark or other distributed data processing frameworks.• Experience with Kafka, Event Hubs, or other streaming technologies.• Exposure to cloud platforms such as Azure, AWS, or GCP.• Experience with CI/CD pipelines and DevOps practices.• Familiarity with data lake and lakehouse architectures.• Experience in banking or financial services industryBenefitsBenefitsBy joining us you can expect Autonomy to develop and grow your skills and experienceBe part of exciting project work that is making a difference in societyStrong, inspiring and thought-provoking leadershipA supportive and collaborative environmentAs well as this, we offer: Development access to LinkedIn Learning, a management development programme and trainingWellness 24/7 Confidential employee assistance programmeSocial - Breakfast Tuesdays, Thirsty Thursdays and Pizza on the last Thursday of each month as well as commitment to charitable causesTime off 25 days a year; plus the opportunity to purchase extra leave per yearPension Salary Exchange Scheme with 4% employer contribution and 5% employee contributionLife Assurance of 4 times base salaryPrivate Medical Insurance which is non-contributory (spouse and dependants included)Worldwide Travel Insurance which is non-contributory (spouse and dependants included)
We are seeking a Senior Data Engineer with strong SQL and Java expertise to design and deliver scalable data solutions.
In this role, you will leverage Java's robustness and Scala's functional data-processing power to build scalable pipelines, manage distributed big data frameworks, and optimize our data platform.
Location: 3days/w onsite in Glasgow
Key Responsibilities
- Design, develop, and maintain scalable data pipelines to support data integration, transformation, and analytics requirements.
- Write efficient, high-performance SQL queries, stored procedures, and data transformation logic.
- Build and maintain backend data processing applications using Java.
- Develop scalable APIs and microservices architectures.
- Work with batch and near real-time data processing frameworks to deliver reliable data solutions.
- Optimise data models, database performance, and query execution.
- Collaborate with data architects, analysts, and business stakeholders to translate requirements into scalable data solutions.
- Implement automated testing, monitoring, and data quality controls across the data platform.
Requirements
Essential Skills & Experience
• Java: 5+ years of professional experience with Java (Version 11 or higher preferred).
• Advanced SQL skills with experience in performance tuning, data modelling, and complex query development.
• Strong Java development experience, including object-oriented design and enterprise application development.
• Experience designing and developing ETL/ELT pipelines.
• Experience working with relational databases such as PostgreSQL, SQL Server, Oracle, or MySQL.
• Understanding of data warehousing concepts and dimensional modelling.
• Experience with version control systems such as Git.
• Knowledge of cloud-based data platforms and modern data engineering practices.
Desirable Skills
• Experience with Scala development.
• Experience with Apache Spark or other distributed data processing frameworks.
• Experience with Kafka, Event Hubs, or other streaming technologies.
• Exposure to cloud platforms such as Azure, AWS, or GCP.
• Experience with CI/CD pipelines and DevOps practices.
• Familiarity with data lake and lakehouse architectures.
• Experience in banking or financial services industry
Benefits
Benefits
By joining us you can expect
- Autonomy to develop and grow your skills and experience
- Be part of exciting project work that is making a difference in society
- Strong, inspiring and thought-provoking leadership
- A supportive and collaborative environment
As well as this, we offer:
- Development access to LinkedIn Learning, a management development programme and training
- Wellness 24/7 Confidential employee assistance programme
- Social - Breakfast Tuesdays, Thirsty Thursdays and Pizza on the last Thursday of each month as well as commitment to charitable causes
- Time off 25 days a year; plus the opportunity to purchase extra leave per year
- Pension Salary Exchange Scheme with 4% employer contribution and 5% employee contribution
- Life Assurance of 4 times base salary
- Private Medical Insurance which is non-contributory (spouse and dependants included)
- Worldwide Travel Insurance which is non-contributory (spouse and dependants included)
Our mission is to help safeguard public-facing services and apply digital thinking to make sure the future of our public services is centred around our citizens.At Methods we believe in working with a human touch which sets us apart from other consultancies, system integrators and software houses. We do not focus solely on profits or targets; we have a customer-centric value system and focus on doing what is right for our clients.We passionately support our clients in the success of their projects and work collaboratively in teams to share skill sets and solve problems. At Methods we have fun while working hard; we are not afraid of making mistakes and learning from them.
Our mission is to help safeguard public-facing services and apply digital thinking to make sure the future of our public services is centred around our citizens.
At Methods we believe in working with a human touch which sets us apart from other consultancies, system integrators and software houses. We do not focus solely on profits or targets; we have a customer-centric value system and focus on doing what is right for our clients.
We passionately support our clients in the success of their projects and work collaboratively in teams to share skill sets and solve problems. At Methods we have fun while working hard; we are not afraid of making mistakes and learning from them.
