AWS /Azure/ Databricks + AI + Agentic AI+ Python- Senior Associate

Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and data transformation solutions. At PwC, we connect people with diverse backgrounds and skill sets to solve important problems together and lead with purpose—for our clients, our communities and for the world at large. It is no surprise therefore that 429 of 500 Fortune global companies engage with PwC. Acceleration Centers (ACs) are PwC’s diverse, global talent hubs focused on enabling growth for the organization and value creation for our clients. The PwC Advisory Acceleration Center in Bangalore is part of our Advisory business in the US. The team is focused on developing a broader portfolio with solutions for Risk Consulting, Management Consulting, Technology Consulting, Strategy Consulting, Forensics as well as vertical specific solutions. PwC's high-performance culture is based on passion for excellence with focus on diversity and inclusion. You will collaborate with and receive support from a network of people to achieve your goals. We will also provide you with global leadership development frameworks and the latest in digital technologies to learn and excel in your career. At the core of our firm's philosophy is a simple construct: We care for our people. Globally PwC is ranked as the 3rd most attractive employer according to Universum. Our commitment to Responsible Business Leadership, Diversity & Inclusion, work-life flexibility, career coaching and learning & development makes our firm one of the best places to work, learn and excel. Apply to us if you believe PwC is the place to be. Now and in the future! JOB OVERVIEW At PwC - AC, as an AWS Developer, the candidate will interact with Offshore Manager/ Onsite Business Analyst to understand the requirements and the candidate is responsible for end-to-end implementation of Cloud data engineering solutions like Enterprise Data Lake, Data hub in AWS. Years of Experience Candidates with 4-9 years of hands-on experience Position Requirements: Must Have: Experience in architecting and delivering highly scalable, distributed, cloud-based enterprise data solutions Strong expertise in the end-to-end implementation of Cloud data engineering solutions like Enterprise Data Lake, Data hub in AWS, AI & Python Hands-on experience with Snowflake utilities, SnowSQL, SnowPipe,ETL data Pipelines, Big Data model techniques using Python / Java Experience in loading disparate data sets and translating complex functional and technical requirements into detailed design Should be aware of deploying Snowflake features such as data sharing, events and lake-house patterns Deep understanding of relational as well as NoSQL data stores, methods and approaches (star and snowflake, dimensional modeling) Strong AWS hands-on expertise with a programming background preferably Python/Scala Good knowledge of Big Data frameworks and related technologies Experience in Hadoop and Spark is mandatory Strong experience in AWS compute services like AWS EMR, Glue and Sagemaker and storage services like S3, Redshift & Dynamodb Good experience with any one of the AWS Streaming Services like AWS Kinesis, AWS SQS and AWS MSK Troubleshooting and Performance tuning experience in Spark framework Spark core, Sql and Spark Streaming Experience in one of the flow tools like Airflow, Nifi or Luigi Good knowledge of Application DevOps tools (Git, CI/CD Frameworks) Experience in Jenkins or Gitlab with rich experience in source code management like Code Pipeline, Code Build and Code Commit Experience with AWS CloudWatch, AWS Cloud Trail, AWS Account Config, AWS Config Rules Strong understanding of Cloud data migration processes, methods and project lifecycle Good analytical & problem-solving skills Good communication and presentation skills Desired Knowledge / Skills: Experience in building stream-processing systems, using solutions such as Storm or Spark Streaming Experience in Big Data ML toolkits, such as Mahout, SparkML, or H2O Knowledge in Python Worked in Offshore / Onsite Engagements Experience in one of the flow tools like Airflow, Nifi or Luigi Experience in AWS services like STEP & Lambda Professional and Educational Background: BE / / MCA / / M.E / / MBA Additional Information: Travel Requirements: Travel to client locations may be required as per project requirements. Line of Service: Advisory Horizontal: Technology Consulting Designation: Associate Location: Bangalore, India The Opportunity When you join PwC Acceleration Centers (ACs), you step into a pivotal role focused on actively supporting various Acceleration Center services, from Advisory to Assurance, Tax and Business Services. In our innovative hubs, you’ll engage in challenging projects and provide distinctive services to support client engagements through enhanced quality and innovation. You’ll also participate in dynamic and digitally enabled training that is designed to grow your technical and professional skills. As part of the Data Engineering team you will architect and deliver scalable, cloud-based enterprise data solutions. As a Senior Associate, you will leverage your knowledge in data engineering to navigate complexity and deliver elevated solutions while mentoring others and enhancing your technical skills. Responsibilities Design and implement scalable cloud-based data solutions Utilize data engineering knowledge to solve complex issues Mentor team members to foster technical growth Collaborate with stakeholders to secure project success Analyze data to inform strategic decisions Maintain exceptional standards in deliverables Adapt to evolving technologies and methodologies Contribute to continuous improvement initiatives What You Must Have Bachelor's Degree 4 years of experience Oral and written proficiency in English required What Sets You Apart 4-8 years of experience in cloud data solutions Experience in architecting scalable cloud-based data solutions Skilled in Snowflake utilities and ETL data pipelines Understanding of data security and access controls Familiarity with AWS compute and storage services Experience with Big Data frameworks like Hadoop and Spark Knowledge of application DevOps tools and CI/CD frameworks Experience in building stream-processing systems Worked in offshore and onsite engagements Travel Requirements Not Specified Job Posting End Date