Data Engineer

Job description

The Data Engineer will build and operate scalable, reliable data pipelines (ingestion, transformation, orchestration) powering the knowledge base, analytics, and applications supporting MSX’s knowledge initiative, creating scalable, secure database information that power AI-driven automotive intelligence across global operations. Key Responsibilities Data Pipeline Architecture & Development – Design, implement, and monitor data pipelines/ETL/ELT. Manage connectors to source systems. Implement robust database systems for automotive knowledge storage integrating diverse data sources (SharePoint, TrackIt, external APIs). Implement data warehousing solutions enabling advanced analytics and AI applications. Performance Optimization & Scalability - Implement data quality checks, lineage, and data contracts. Optimize database performance for global access across 80+ countries - Automate orchestration and CI/CD. - Support backfill, remediation, and performance tuning. Integration & Security - Integrate with existing MSX systems and cloud platforms (Azure, GCP, AWS) - Implement robust security measures protecting proprietary automotive knowledge - Develop API interfaces enabling seamless knowledge access by AI agents and applications - Establish data governance frameworks ensuring compliance with global regulations. Secure and govern data access and secrets. Technical Collaboration - Partner with Knowledge Architect and Data Scientist on optimal data structure implementation - Support Knowledge Champions and Knowledge Acquisition Specialists with data collection tool development - Collaborate with development team on system integration requirements - Work with PM on milestones definition and risk assessment, work with PMO on technical milestone and risk tracking, Work with Privacy/DPO on. Required Qualifications Bachelor’s degree in Computer Science, Information Technology, or related field; 4–7+ years in data engineering; delivering production-grade pipelines; working under governance and privacy constraints; Expertise in SQL, database design, and optimization techniques. With orchestration tools (Airflow/Prefect); Experience with cloud platforms and services (Azure, AWS, GCP - Snowflake/BigQuery/Databricks) and distributed systems; Experience with Python/Scala. Proficiency in ETL tools and data integration technologies, streaming and batch, IaC basics, observability and versioning; Strong understanding of data security and compliance requirements. Preferred Qualifications Experience with automotive industry data systems or BPO environments; Background in AI/ML data infrastructure and knowledge management systems; Certification in cloud platforms or database technologies; Experience with multi-language data systems and global database management; Knowledge of automotive industry compliance and data regulations. - CCNL Applicabile: Contratto del Commercio Terziario e Distribuzione Servizi - Livello 2 With over 5,000 employees based in more than 80 countries across the globe, our teams provide industry leading expertise that spans: Consumer Engagement Parts, Accessories & Service Performance Actionable Insights Repair Optimization & Compliance Learning Solutions Distribution & Sales Performance Our proven track record means that we now partner with almost every car manufacturer on the market. The MSX Purpose To empower Movers and Makers to thrive in our ever-changing world The MSX Mission To harness our expertise in mobility, the creativity of our global teams, and the power of technology, to craft tailored, sustainable and innovative solutions. The MSX Vision To be the clients’ first choice, recognized for our operational excellence and commitment to driving change and innovation in the mobility industry. MSX is an equal opportunities employer and encourages applications from suitably qualified and eligible candidates regardless of sex, race, disability, neurodiversity or other personal characteristics and backgrounds, age, sexual orientation, gender reassignment, religion or belief, or marital and parental status. As users of the Disability Confident scheme, we interview all disabled applicants who meet the minimum criteria for the vacancy. MSX International Group is the leading global provider of outsourced business solutions for the automotive industry making business in more than 80 countries. MSXI’s deep industry expertise combined with advanced data analytics and custom software solutions improve the performance of automotive dealership networks by increasing revenue, reducing cost, and enhancing customer satisfaction.