Software Engineer, II - Data Engineering

Job description

**About the Company** At Torc, we have always believed that autonomous vehicle technology will transform how we travel, move freight, and do business. A leader in autonomous driving since 2007, Torc has spent over a decade commercializing our solutions with experienced partners. [Now a part of the Daimler family](https://torc.ai/daimler-testing-automated-trucks-public/), we are focused solely on developing software for automated trucks to transform how the world moves freight. Join us and catapult your career with the company that helped pioneer autonomous technology, and the first AV software company with the vision to partner directly with a truck manufacturer. **Meet the Team** Torc’s Data Engineering team is a highly collaborative group focused on building secure, scalable systems that let customers work with data easily and confidently. We operate as a distributed, remote first team, ensuring everyone has equal access to information and collaboration. Our work includes frequent touchpoints—daily standups, planning sessions, and ad hoc discussions over Zoom or Slack. Because we own our services end-to-end, each engineer participates in a business hour on call rotation. We prioritize healthy work/life balance and sustainable development over heroic efforts. **What You’ll Do** We are seeking a Software Engineer with experience in implementing and maintaining Linux and cloud-based data management solutions who is ready to extend that experience. In this role you will be working closely with other engineers on the implementation of AWS-native data ingestion, ETL, and storage solutions that power data driven analytics, simulation, and ML training across the enterprise. - Create robust and resilient pipelines to process massive daily volumes of data created by vehicle fleets and simulation environments - Build and support scalable pipelines as part of Torc’s Data Factory to delivery data for ML training at scale - Scale Torc’s data lake through a distributed storage system, data crawling and discovery - Promote and protect the integrity of data through validation, versioning, data provenance, and governance - Support the expansion of Torc’s data lake through acquisition of additional data sets from internal and external sources - Contribute to the design, architecture and delivery of cloud-based solutions - Collaborate with teams specializing in perception, planning, control, mapping and vehicle testing to develop solutions that support product delivery - Support the implementation of emerging cloud-based capabilities that can extend our technology stack and improve our ability to build, deploy and test safety-critical software for self-driving vehicles - Participate in the team’s on-call rotation to support our deployed systems during business hours Here’s a list of some of the technologies we use to make all the above happen: - Managed services powered by AWS (Lambda, SFN, Batch, EventBridge, Athena, Glue) - Linux / Bash - Docker - Terraform - Python - React/Javascript - On-Call Tooling (Datadog, AWS Cloudwatch) - CI/CD Tooling (Jenkins, GitHub Actions) **What You’ll Need to Succeed** - Bachelor’s Degree in Computer Science, Robotics, Electrical Engineering or related technical field plus demonstrates competences and technical proficiencies typically acquired through 4+ years of experience or; - Master’s Degree in Computer Science, Robotics, Electrical Engineering or related technical field plus demonstrates competences and technical proficiencies typically acquired through 0-3+ years of experience. - Experience deploying, troubleshooting, monitoring and maintaining Linux systems - Experience building and maintaining workloads in public cloud environments - Knowledge of different database architectures, including but not limited to relational and NoSQL databases, vector stores, data warehousing and clustered, distributed data stores - Practical experience with Linux and general bash scripting - Practical experience with Docker and containerization - Implementation of workflow patterns using directed acyclic graphs (Apache Airflow, AWS Step Functions) - A strong commitment to test-driven development patterns, continuous integration and delivery, and infrastructure as code **Bonus Points** - Strong organizational, time management, and communication skills working with a team orientation and collaborative style - Experience with the Databricks platform, particularly for serving data, visualizations and jobs - Experience with scaling data for ML and AI workloads using Ray - Experience with pandas, numpy and other Python-based data analysis libraries and tooling - Deep knowledge of AWS serverless architectures (Lambda, Batch, ECS Fargate, Glue, Athena) - Experience with data storage and acquisition patterns for robotics and advanced driver assistance systems - Own end-to-end architecture and delivery of cloud-based solutions. **Perks of Being a Full-time Torc’r** Torc cares about our team members and we strive to provide benefits and resources to support their health, work/life balance, and future. Our culture is collaborative, energetic, and team focused. Torc offers: - A competitive compensation package that includes a bonus component and stock options - 100% paid medical, dental, and vision premiums for full-time employees - 401K plan with a 6% employer match - Flexibility in schedule and generous paid vacation (available immediately after start date) - AD+D and Life Insurance At Torc, we’re committed to building a diverse and inclusive workplace. We celebrate the uniqueness of our Torc’rs and do not discriminate based on race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, veteran status, or disabilities. Even if you don’t meet 100% of the qualifications listed for this opportunity, we encourage you to apply. Our compensation reflects the cost of labor across several geographic markets. Pay is based on a number of factors and may vary depending on job-related knowledge, skills, and experience. Torc's total compensation package will also include our corporate bonus and stock option plan. Dependent on the position offered, sign-on payments, relocation, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. Job ID: 102860 **Hiring Range for Job Opening** US Pay Range $139,000—$166,800 USD