Staff Engineer, Big Data

Job description

Company Description We are a Digital Product Engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at scale — across all devices and digital mediums, and our people exist everywhere in the world (15000+ experts across 26 countries, to be exact). Our work culture is dynamic and non-hierarchical. We are looking for great new colleagues. That is where you come in! Job Description Must have Skills : Apache Spark, Azure Data Factory, Databricks, Job Description : Lead Consultant - Azure Data Platform Engineering & Ops You will be responsible for architecting, implementing, and managing robust data solutions on the Microsoft Azure platform. Responsibilities: Technical Leadership: Lead and mentor a team of data engineers and operations specialists, providing technical guidance, fostering skill development, and promoting a culture of excellence. Azure Data Architecture: Collaborate with stakeholders to design scalable and efficient data architectures using Azure services such as Azure SQL Database, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Cosmos DB. Data Engineering: Oversee the development of data pipelines, ETL/ELT processes, and data integrations, ensuring data quality, optimal performance, and adherence to best practices. Platform Operations: Manage the day-to-day operation and maintenance of the Azure Data Platform, including monitoring, troubleshooting, and performance optimization. Automation and DevOps: Implement automation strategies and DevOps practices to streamline deployment, monitoring, and management of data solutions, ensuring efficient operations and rapid response to issues. Data Security and Compliance, Capacity Planning and Scalability, Collaboration and Communication, Performance Monitoring and Optimization Qualifications: Bachelor's or Master's degree in Computer Science, Information Technology, or a related field. Extensive experience in data engineering, data architecture, and cloud platform operations, with a focus on the Microsoft Azure ecosystem. In-depth knowledge of Azure services such as Azure SQL Database, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Cosmos DB. Proficiency in designing and optimizing data pipelines, ETL/ELT processes, and data integrations. Strong understanding of data governance, security best practices, and compliance standards in a cloud environment. Hands-on experience with automation, infrastructure as code (IaC), and DevOps principles. Excellent leadership and team management skills, with a proven ability to guide and inspire technical teams. Azure certifications such as Microsoft Certified: Azure Solutions Architect Expert or equivalent are highly desirable. Qualifications Additional Information