Big Data Engineer

Job description

At Similarweb, we're revolutionizing the way businesses interact with the digital world by revealing to them everything that happens online. Our cutting-edge platform and unique data empower over 4,300 customers globally, including industry giants like Google, eBay, and Adidas, to make game-changing decisions that drive their digital strategies. In 2021, we went public on the New York Stock Exchange, and we haven’t stopped growing since! We're seeking exceptional individuals to join us to our R&D team. At Similarweb, you'll innovate fast, collaborate with brilliant minds, solve big problems, work with cutting-edge technologies and data at incredible scales, and make a tangible impact on the world's most innovative companies. **We’re looking for a Big Data Engineer** to develop and integrate systems that retrieve, process and analyze data from around the digital world, generating customer-facing data. This role will report to our Team Manager, R&D. **Why is this role so important at Similarweb?** Similarweb is a data-focused company, and data is the heart of our business. As a big data engineer developer, you will work at the very core of the company, designing and implementing complex high scale systems to retrieve and analyze data from millions of digital users. Your role as a big data engineer will give you the opportunity to use the most cutting-edge technologies and best practices to solve complex technical problems while demonstrating technical leadership. **So, what will you be doing all day?** Your role as part of the **R&D** teammeans your daily responsibilities may include: - Design and implement complex high scale systems using a large variety of technologies. - You will work in a data research team alongside other data engineers, data scientists and data analysts. Together you will tackle complex data challenges and bring new solutions and algorithms to production. - Contribute and improve the existing infrastructure of code and data pipelines, constantly exploring new technologies and eliminating bottlenecks. - You will experiment with various technologies in the domain of Machine Learning and big data processing. - You will work on a monitoring infrastructure for our data pipelines to ensure smooth and reliable data ingestion and calculation. **This is the perfect job for someone who:** - Passionate about data. - Holds a BSc degree in Computer Science\Engineering or a related technical field of study. - Has at least **4 years** of software or data engineering development experience in one or more of the following programming languages: **Python**, **Java**, or **Scala**. - Has strong programming skills and knowledge of **Data Structures**, **Design Patterns** and **Object Oriented Programming**. - Has good understanding and experience of **CI/CD** practices and **Git**. - Excellent communication skills with the ability to provide constant dialog between and within data teams. - Can easily prioritize tasks and work independently and with others. - Conveys a strong sense of ownership over the products of the team. - Is comfortable working in a fast-paced dynamic environment. **Advantage**: - Has experience with containerization technologies like **Docker** and **Kubernetes**. - Experience in designing and productization of complex big data pipelines. - Familiar with a cloud provider (**AWS** / **Azure** / **GCP**)**.** **Experience with Big Data technologies and common frameworks such as Spark, Airflow, Kafka, Parquet, Databricks, EMR, Kubernetes.** **About the R&D team** As part of our R&D team at Similarweb, you'll have the opportunity to work on challenging algorithmic problems with no play book solution, solve problems for real customers, and work alongside the best engineers and scientists in the industry. *\*\*At Similarweb, collaborating with our colleagues in-office creates a more connected, unified culture. Our best work is a product of our face-to-face collaboration, with the ability to work partially from home.\*\** **Why you’ll love being a Similarwebber:** **You’ll actually love the product you work with:** Our customers aren’t our only raving fans. When we asked our employees why they chose to come work at Similarweb, 99% of them said “the product.” Imagine how exciting your job is when you get to work with the most powerful digital intelligence platform in the world. **You’ll find a home for your big ideas:** We encourage an open dialogue and empower employees to bring their ideas to the table. You’ll find the resources you need to take initiative and create meaningful change within the organization. **We offer competitive perks & benefits:** We take your well-being seriously, and offer competitive compensation packages to all employees. We also put a strong emphasis on community, with regular team outings and happy hours. **You can grow your career in any direction you choose:** Interested in becoming a VP or want to transition into a different department? Whether it’s Career Week, personalized coaching, or our ongoing learning solutions, you’ll find all the tools and opportunities you need to develop your career right here. **Diversity isn’t just a buzzword:** People want to work in a place where they can be themselves. We strive to create a workplace that is reflective of the communities we serve, where everyone is empowered to bring their full, authentic selves to work. We are committed to inclusivity across race, gender, ethnicity, culture, sexual orientation, age, religion, spirituality, identity and experience. Our culture of equality and mutual respect also helps us better understand and serve our customers in a world that is becoming more global, more diverse, and more digital every day. We will handle your application and information related to your application in accordance with the Applicant Privacy Policy available [here](https://www.similarweb.com/corp/legal/applicant-privacy-policies/).