Data Engineer

Job description

### **The Team** At Coderoad, we're more than just a software development company—we're your gateway to the global tech world. Whether you're looking to skill up or level up your career, we offer the challenges you’ve been searching for. We provide end-to-end software development services and give you the opportunity to work on exciting, real-world projects in a supportive environment. Whether it's staff augmentation, dedicated IT teams, or general software engineering, we have opportunities for everyone to challenge themselves and take their career to the next level! ### **How you’ll make an impact** - Create and maintain optimal data pipeline architecture. - Assemble large, complex data sets that meet functional / non-functional business requirements. - Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for high-intensive applications and greater scalability, etc. - Design and build robust ETL/ELT processes on GCP to ensure optimal extraction, transformation, and loading of data from a wide variety of sources. - Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics. - Integrate diverse data ecosystems by connecting with CDPs, ERPs, and various external systems. - Work with stakeholders including to assist with data-related technical issues and support their data infrastructure needs. - Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader. - Work with data and analytics experts to strive for greater functionality in our data systems. ### **What we’re looking for** Minimum requirements: - 4+ years as a Data Engineer experience building processes supporting data transformation, data structures, metadata, dependency, and workload management. - Cloud Expertise: Proven experience designing and implementing ETLs on Databricks and/or GCP - Analytics frameworks and languages, such as: Databricks, GCP, Python, Pyspark (Scala is a plus) - Familiar with big data tools: Apache Spark, Big Query, GCS, Cloud Composer, Unity Catalog - Pipeline Management: Experience with Big Data pipelines via Streams and/or Batches for high-intensive applications. - Experience with Relational DB MySQL . - Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. - Unstructured Data: Strong analytic skills related to working with unstructured datasets. - Advanced English B2-C1 (spoken and written) - Experience leading teams is nice to have. ### **What you’ll love** - 100% Remote - Contractor position available for Latin American candidates - Holidays Off - Paid Time Off - Health insurance assistance program. - Competitive Pay (USD) - Excellent teamwork and work environment - Training