Platform Data Engineer

Job description

ABOUT NEON REDWOOD Neon Redwood is a data services consulting company, working on cutting-edge AI and data-driven solutions. We are a team of passionate engineers and data experts, and we are currently looking for a Data Engineer to join our team and help us develop and expand our data infrastructure and analytics capabilities. THE ROLE We are seeking an experienced Data Engineer II with a strong background in data engineering and a passion for working with large-scale data sets. Help us develop and expand our data infrastructure and analytics capabilities. The ideal candidate will have at least 2 years of professional experience and a solid understanding of Python, BigQuery, and Google Cloud Platform (GCP) or similar technologies. This full-time role will involve working closely with our CTO and other team members to design, develop, and maintain data pipelines, ETL processes, and data warehousing solutions. RESPONSIBILITIES - Collaborate with the CTO and other team members to design, develop, and maintain data pipelines and ETL processes. - Write clean, efficient, and maintainable code in Python and other relevant technologies. - Implement and optimize data storage and processing solutions using BigQuery and Google Cloud Platform (GCP). - Ensure data quality and integrity through proper data validation and monitoring techniques. - Stay up-to-date with the latest industry trends and technologies to ensure our data infrastructure remains competitive. - Assist in the development and launch of new data-driven tools and products. - Mentor and guide junior engineers, fostering a culture of continuous learning and improvement. REQUIREMENTS - Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent work experience. - 2+ years of professional data engineering experience. - Proficiency in Python, BigQuery, and Google Cloud Platform (GCP) or equivalent technologies. - Experience with data pipeline and ETL process design and development. - Excellent problem-solving skills and the ability to work independently or as part of a team. - Strong communication, collaboration, and a passion to develop leadership skills. - Passion for working with large-scale data sets and staying current with industry trends. - Experience with Asana or similar project management tools. ADDITIONAL SKILLS (NICE TO HAVE) - Experience with other data processing technologies and platforms (e.g., Apache Beam, Dataflow, Hadoop, Spark). - Experience with data visualization tools and libraries (e.g., Looker, Sigma, D3.js). - Knowledge of machine learning and AI concepts. - Experience with real-time data processing and streaming technologies (e.g., Kafka, Pub/Sub).