Senior AI Engineer Manager

Job description

SENIOR MANAGER, DATA ENGINEERING PLATFORM Ecolab | Data & AI Platform Engineering Location: [Bangalore/ Hybrid ] Reports To: Director, Data & AI Platform Engineering Team: Databricks AI & Data Platform / Snowflake Modern Data Platform ROLE SUMMARY Ecolab is seeking a Senior Manager, Data Engineering Platform to lead enterprise data platform capabilities that enable analytics, AI, and business decision-making. This role owns platform operations, integration, observability, monitoring, data quality, lineage, cataloging, security, and engineering enablement across Databricks, Snowflake, and Azure-based data platforms. The leader will deliver a secure, scalable, reliable, and cost-efficient foundation for ingestion, ETL/ELT, orchestration, governance, semantic and ontology capabilities, and production support across enterprise domains. KEY RESPONSIBILITIES Lead the enterprise data engineering platform operating model across Databricks, Snowflake, Azure Data Lake, ingestion, transformation, orchestration, governance, observability, monitoring, cataloging, lineage, and data quality. Own platform administration, including workspaces, clusters, SQL warehouses, Unity Catalog, Snowflake roles, resource monitors, workload isolation, and governance controls. Define observability and monitoring standards for pipelines, workflows, compute, storage, integrations, data freshness, data quality, lineage, performance, reliability, cost, SLAs, and SLOs. Drive automation through self-service provisioning, reusable templates, CI/CD, testing frameworks, release automation, and Infrastructure-as-Code. Define integration patterns across Databricks, Snowflake, Azure Data Factory, dbt, Kafka/Event Hubs, APIs, enterprise applications, databases, file sources, BI tools, and downstream platforms. Drive semantic and ontology layer capabilities with Data Engineering to enable consistent business definitions, reusable data products, governed consumption, and trusted analytics. Set ETL/ELT standards for batch, incremental, streaming, CDC, API-based, and event-driven pipelines using modern DataOps practices. Improve production readiness through data quality controls, lineage, metadata, cataloging, alerting, incident response, runbooks, root-cause analysis, and continuous improvement. Own data security and access governance, including Zero Trust, RBAC, ABAC, PBAC, data masking, encryption, secrets management, audit logging, policy enforcement, and compliance controls. Lead a high-performing platform engineering team through hiring, coaching, performance management, career development, workforce planning, and an inclusive engineering culture. Partner with Data Engineering, AI/ML Engineering, Security, Architecture, and business teams to align the platform roadmap with enterprise priorities. REQUIRED QUALIFICATIONS 10+ years of experience in data engineering, data platform engineering, cloud platform engineering, or enterprise platform operations, including 4+ years managing engineering teams. Hands-on experience administering Databricks and Snowflake environments, including Unity Catalog, workspace management, cluster policies, SQL warehouses, roles, resource monitors, and workload governance. Strong experience operating cloud-based data platforms on Microsoft Azure; AWS or Google Cloud exposure is a plus. Experience with CI/CD, Infrastructure-as-Code, Terraform or similar tools, platform automation, environment management, and release governance. Strong understanding of integration, ETL/ELT, CDC, streaming, orchestration, metadata, cataloging, lineage, data quality, monitoring, and DataOps practices using tools such as Azure Data Factory, Airflow, dbt, Kafka/Event Hubs, or similar platforms. Experience implementing observability, alerting, dashboards, SLA/SLO reporting, incident management, and production support for enterprise data platforms. Strong understanding of data security and access governance, including Zero Trust, RBAC, ABAC, PBAC, identity management, audit logging, encryption, data masking, secrets management, and data protection. PREFERRED QUALIFICATIONS Databricks and/or SnowPro certifications (Administrator, Data Engineer). Experience supporting multiple business verticals or a hub-and-spoke platform operating model. Exposure to LangGraph, MLflow, or other AI/ML platform tooling. Experience with BI, semantic layers, MLOps, LLMOps, data cataloging, lineage, observability, data quality, or monitoring tools integrated with Databricks and Snowflake. Experience with lakehouse architecture, medallion patterns, Delta Lake, data sharing, semantic layers, and reusable data products at enterprise scale. Knowledge of Spark and Snowflake performance tuning, warehouse sizing, cluster policies, auto-scaling, cost controls, and platform FinOps. Exposure to orchestration and workflow tools such as Azure Data Factory, Airflow, Databricks Workflows, dbt Cloud, or similar platforms. Experience with streaming and near-real-time patterns using Kafka, Azure Event Hubs, Spark Structured Streaming, or similar technologies. Familiarity with governance and cataloging platforms such as Microsoft Purview, Unity Catalog, Collibra, Alation, Atlan, OpenLineage, or similar tools. Experience with platform reliability practices, including SRE, health dashboards, automated alerting, incident response, capacity forecasting, resiliency testing, and disaster recovery.