Senior Platform Engineer with MLOps and Databricks

Job description

3Pillar is an AI transformation partner on a mission to help enterprises build the AI-native products and intelligent agents that will define the next era of business. With teams across North America, Europe, Latin America, and Asia, we work with the most ambitious companies in financial services, healthcare, media, and technology — helping them move faster, modernize boldly, and compete on their own terms. Our HelixAI platform and Helix Pods delivery model put our engineers at the center of real agentic transformation — doing work that is open, portable, and built to last. We are building the future of enterprise AI. 🌟 Accomplished Tech Visionary: At 3Pillar Global, we specialize in building impactful software products that power digital businesses. We are looking for a talented Senior AI ML Engineer who will not only write code but also deliver exceptional product capabilities for our clients. Your contributions will play a pivotal role in achieving our passion for client success, solidifying our position as a leading product development services company. ### Key Responsibilities - Design, implement, and maintain cloud-native platform to support AI and data workloads, with a focus on AI and data platforms such as Databricks and AWS Bedrock. - Build and manage scalable data pipelines to ingest, transform, and serve data for ML and analytics. - Develop infrastructure-as-code using tools like Cloudformation, AWS CDK to ensure repeatable and secure deployments. - Collaborate with AI engineers, data engineers, and platform teams to improve the performance, reliability, and cost-efficiency of AI models in production. - Drive best practices for observability, including monitoring, alerting, and logging for AI platforms. - Contribute to the design and evolution of our AI platform to support new ML frameworks, workflows, and data types. - Stay current with new tools and technologies to recommend improvements to architecture and operations. - Integrate AI models and large language models (LLMs) into production systems to enable use cases using architectures like retrieval-augmented generation (RAG). ### Minimum Qualifications - 7+ years of professional experience in software engineering and infrastructure engineering. - Extensive experience building and maintaining AI/ML infrastructure in production, including model, deployment, and lifecycle management. - Strong knowledge of AWS and infrastructure-as-code frameworks, ideally with CDK. - Expert-level coding skills in TypeScript and Python building robust APIs and backend services. - Production-level experience with Databricks MLFlow, including model registration, versioning, asset bundles, and model serving workflows. - Expert level understanding of containerization (Docker), and hands on experience with CI/CD pipelines, orchestration tools (e.g., ECS) is a plus. - Proven ability to design reliable, secure, and scalable infrastructure for both real-time and batch ML workloads. - Ability to articulate ideas clearly, present findings persuasively, and build rapport with clients and team members. - Strong collaboration skills and the ability to partner effectively with cross-functional teams. **Nice to have:** - Familiarity with emerging LLM frameworks such as DSPy for advanced prompt orchestration and programmatic LLM pipelines. - Understanding of LLM cost monitoring, latency optimization, and usage analytics in production environments. - Knowledge of vector databases / embeddings stores (e.g., OpenSearch) to support semantic search and RAG. ### What is it like working for 3Pillar Global? **What is it like working for 3Pillar Global?** At 3Pillar, we offer a world of opportunity: - Imagine a *flexible work environment* – whether it's the office, your home, or a blend of both. From interviews to onboarding, we embody a remote-first approach. - You will be part of a *global team*, learning from top talent around the world and across cultures, speaking English everyday. Our global workforce enables our team to leverage global resources to accomplish our work in efficient and effective teams. - We’re *big on your well-being* – as a company, we spend a whole trimester in our annual cycle focused on wellbeing. Whether it is taking advantage of fitness offerings, mental health plans (country-dependent), or simply leveraging generous time off, we want all of our team members operating at their best. - Our professional services model enables us to *accelerate career growth* and development opportunities - across projects, offerings, and industries. - *We are an equal opportunity employer.* It goes without saying that we live by values like Intrinsic Dignity and Open Collaboration to create cutting-edge technology AND reinforce our commitment to diversity - globally and locally. Join us and be a part of a global tech community! 🌍💼 Check out our [Linkedin](https://www.linkedin.com/company/3pillar-global) site and [Careers](https://www.3pillarglobal.com/company-culture/) page to learn more about what it’s like to be part of our #oneteam! #LiRemote