Data Engineer

Job description

Job Details: Job Description: We are looking for a highly skilled Senior Data Engineer to join our Data & Analytics team and help the design and development of modern data platforms. This role focuses on building scalable, high-performance data solutions using tools such as Databricks,Microsoft Fabric, Azure Data Factory and PySpark. The ideal candidate will be passionate about data warehousing, data engineering, data architecture, automation, and DevOps practices, and will work closely with Business analysts, engineering team, Data Scientists to enable robust, real-time, and secure data operations. Expert in data engineering, ETL/ELT, and modern data platforms such as (Databricks,MS Fabric, Synapse etc.) Design, build, and optimize scalable data pipelines using Databricks, Azure Data Factory, and Microsoft Fabric. Develop ETL/ELT workflows using PySpark, SQL, and data orchestration frameworks. Architect and implement data Lakehouse and data warehouse solutions on Databricks/Microsoft Fabric. The role requires a strong understanding of Data Warehousing, Data Modeling, data engineering principles, cloud computing, and the Microsoft Fabric platform Strong in SQL development, including writing complex queries and stored procedures Collaborate with data scientists and analysts to ensure efficient data delivery and model readiness. Leverage CI/CD practices and infrastructure-as-code (IaC) to deploy and maintain data pipelines in production. Monitor and troubleshoot data pipelines, ensuring performance, reliability, and data quality. Enforce data governance, security, and compliance best practices across platforms. Qualifications: Bachelor’s or master’s degree in computer science, Information Systems, Engineering, or a related field. 4-8 years of experience in data engineering with strong knowledge of cloud data platforms. Proficiency in PySpark, Azure Data Factory, Databricks and SQL. Experience working with Microsoft Fabric or similar unified analytics platforms. Solid understanding of data lakehouse and data warehouse architectures. Solid understanding of Data modeling concepts. Experience with Delta Lake, Synapse Analytics, and other Azure analytics services. Familiarity with CI/CD pipelines, version control (e.g., Git), and deployment automation tools (e.g., Azure DevOps, GitHub Actions). Strong problem-solving skills and ability to work across technical and business teams. Good to have power bi and semantic model development experience. Job Type: Regular Shift: Shift 1 (India) Primary Location: Bengaluru, Karnataka, India Additional Locations: Posting Statement: All qualified applicants will receive consideration for employment without regard to race, color, religion, religious creed, sex, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military and veteran status, marital status, pregnancy, gender, gender expression, gender identity, sexual orientation, or any other characteristic protected by local law, regulation, or ordinance.