Data Engineer

Job description

Job Description Purpose of the role To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. Accountabilities Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data. Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures. Development of processing and analysis algorithms fit for the intended data complexity and volumes. Collaboration with data scientist to build and deploy machine learning models. Analyst Expectations To perform prescribed activities in a timely manner and to a high standard consistently driving continuous improvement. Requires in-depth technical knowledge and experience in their assigned area of expertise Thorough understanding of the underlying principles and concepts within the area of expertise They lead and supervise a team, guiding and supporting professional development, allocating work requirements and coordinating team resources. If the position has leadership responsibilities, People Leaders are expected to demonstrate a clear set of leadership behaviours to create an environment for colleagues to thrive and deliver to a consistently excellent standard. The four LEAD behaviours are: L – Listen and be authentic, E – Energise and inspire, A – Align across the enterprise, D – Develop others. OR for an individual contributor, they develop technical expertise in work area, acting as an advisor where appropriate. Will have an impact on the work of related teams within the area. Partner with other functions and business areas. Takes responsibility for end results of a team’s operational processing and activities. Escalate breaches of policies / procedure appropriately. Take responsibility for embedding new policies/ procedures adopted due to risk mitigation. Advise and influence decision making within own area of expertise. Take ownership for managing risk and strengthening controls in relation to the work you own or contribute to. Deliver your work and areas of responsibility in line with relevant rules, regulation and codes of conduct. Maintain and continually build an understanding of how own sub-function integrates with function, alongside knowledge of the organisations products, services and processes within the function. Demonstrate understanding of how areas coordinate and contribute to the achievement of the objectives of the organisation sub-function. Make evaluative judgements based on the analysis of factual information, paying attention to detail. Resolve problems by identifying and selecting solutions through the application of acquired technical experience and will be guided by precedents. Guide and persuade team members and communicate complex / sensitive information. Act as contact point for stakeholders outside of the immediate function, while building a network of contacts outside team and external to the organisation. All colleagues will be expected to demonstrate the Barclays Values of Respect, Integrity, Service, Excellence and Stewardship – our moral compass, helping us do what we believe is right. They will also be expected to demonstrate the Barclays Mindset – to Empower, Challenge and Drive – the operating manual for how we behave. Join us as a Data Engineer at Barclays, responsible for supporting the successful delivery of Location Strategy projects to plan, budget, agreed quality and governance standards. You'll spearhead the evolution of our digital landscape, driving innovation and excellence. You will harness cutting-edge technology to revolutionize our digital offerings, ensuring unparalleled customer experiences. Senior Qlik Administrator / Designer Responsibilities Qlik Platform Administration & Support Install, configure, administer, and maintain Qlik Sense and QlikView environments, including single-node and multi-node deployments. Manage platform upgrades, migrations, patching, and lifecycle management of QlikView and Qlik Sense environments. Monitor server health, capacity, CPU utilization, memory consumption, and overall platform performance. Administer Qlik Management Console (QMC), user access, security rules, streams, licenses, tasks, and triggers. Troubleshoot and resolve platform issues related to application performance, data reload failures, security, access management, and system stability. Maintain server logs, platform backups, disaster recovery processes, and operational documentation. Synchronize content, applications, and users across Qlik environments. Collaborate with infrastructure and security teams to establish and maintain user management and security policies. Ensure platform availability, operational stability, and compliance with enterprise standards. Qlik Application Development & Dashboard Design Design, develop, and maintain enterprise-grade dashboards, reports, and analytical applications using QlikView and Qlik Sense. Work closely with business stakeholders to gather requirements and translate them into scalable analytics solutions. Develop optimized data models, ETL scripts, and reusable reporting frameworks. Create interactive visualizations, KPIs, scorecards, and executive dashboards to support decision-making. Perform application tuning and optimization to improve dashboard performance and user experience. Support application releases, migrations, and production deployments. Data Integration & Snowflake Administration Integrate Qlik applications with various enterprise data sources, including Snowflake, AWS S3, Oracle, SQL Server, MongoDB, and other databases. Manage bulk data loading and unloading activities using Snowflake COPY commands. Handle structured and semi-structured data formats such as JSON, CSV, ORC, and PARQUET. Develop and manage Snowpipe for continuous data ingestion from AWS S3. Create and maintain Snowflake stored procedures, cloning strategies, and data transformation processes. Utilize Snowflake capabilities such as COPY, LIST, PUT, GET, FLATTEN, and zero-copy cloning. Support data warehouse optimization and data integration initiatives across multiple source systems. Service Management & Stakeholder Engagement Support mission-critical BI platforms and ensure availability of reporting services for global business users. Manage day-to-day platform operations, incidents, service requests, problems, and change activities. Coordinate with development teams, vendor partners, infrastructure teams, and business stakeholders for onboarding, migration, releases, and platform enhancements. Conduct root cause analysis and implement permanent fixes for recurring issues. Participate in incident triage and support major incident management activities. Drive operational automation and continuous service improvement initiatives. Ensure adherence to enterprise governance, security, DevOps, and Agile delivery standards. Mandatory Skills Qlik Technologies Strong experience in QlikView and Qlik Sense Administration and Development. Hands-on expertise in installation, configuration, migration, upgrade, and support of Qlik environments. Experience administering QMC, security rules, task scheduling, streams, licenses, and user access management. Strong experience in dashboard development, data modeling, and Qlik scripting. Data & Database Technologies Experience working with Snowflake Data Warehouse. Strong understanding of AWS S3 integration with Snowflake and Qlik platforms. Hands-on experience handling JSON, CSV, PARQUET, and ORC data formats. Strong SQL and PL/SQL skills. Experience working with Oracle, SQL Server, MongoDB, and other relational/non-relational databases. Infrastructure & Platform Skills Good understanding of Windows Server environments and platform administration. Strong networking fundamentals including SSL Certificates, Load Balancers, DNS, IP routing, and security concepts. Experience with Linux/Unix operating systems. Familiarity with enterprise scheduler tools such as Tivoli, Autosys, or equivalent. Understanding of CI/CD pipelines, deployment automation, and DevOps practices. Service Management Experience supporting enterprise BI platforms in production environments. Strong troubleshooting and incident management experience. Knowledge of ITIL processes including Incident, Problem, Change, and Event Management. Excellent communication, stakeholder management, and documentation skills. Desirable Skills Experience with Qlik NPrinting administration and report distribution. Experience supporting SAP BusinessObjects (BO) and Tableau platforms. Knowledge of Qlik Cloud / Qlik Sense SaaS environments. Experience with AWS cloud services and cloud-native data architectures. Familiarity with Infrastructure as Code (IaC) and automation scripting using PowerShell, Python, or Shell scripting. Exposure to Agile, Lean Control Frameworks, and DevOps operating models. Experience working in large-scale enterprise environments supporting global business users. Relevant certifications in Qlik, Snowflake, AWS, or Data Engineering technologies. Preferred Experience 7+ years of experience in BI Platform Administration and Analytics Solutions. Proven experience in enterprise-scale Qlik platform support, migration, and modernization initiatives. Ability to manage both platform administration and dashboard development responsibilities. Experience working with global stakeholders, vendor teams, and cross-functional delivery organizations. You may be assessed on the key critical skills relevant for success in role, such as risk and controls, change and transformation, business acumen strategic thinking and digital and technology, as well as job-specific technical skills. This role is based in Chennai