Senior Big Data Engineer (Cyber Security Solution)

  • Dnipro
  • Kharkiv
  • Kyiv
  • Lviv
  • Odesa
  • Sumy
  • Vinnytsia
  • Big Data

Are you a Senior Big Data Engineer willing to join a challenging startup? Would you like to protect the world from malvertising? Then welcome to the growing clean.io family.

Being our team member means being open minded, proactive and friendly, supportive, ready to accept the challenge, take responsibility and never stop learning. We need to be one step ahead of attackers, which means being smarter, quicker, and looking beyond the surface.

Customer

Clean.io is a novel cyber security solution that protects revenue and user experiences across all platforms.

Project

We are working with a highly dynamic AdTech ecosystem with a goal to protect the world from malvertising. Our data infrastructure team processes around 100GB of compressed data, 700M near real-time events daily on a scalable, highly available platform. As a member of the data & analytics team, you will work side by side with data engineers and data analysts to develop novel systems, algorithms, and processes to handle large amounts of data.

Meet your team!
  • Responsibilities

    • Share leadership responsibilities with the Tech Lead during development and support of the current platform
    • Designing, reviewing, implementing, testing, and optimizing ETL processes
    • Troubleshooting data and/or system issues
    • Performance optimizations on both system-level and application-level
    • Participating in knowledge sharing and mentoring processes within the team
    • Proactive participation in cross-team planning and support to ensure smooth bridging between sub-teams and efficient cross-team releases
  • Requirements

    • At least 5 years in commercial software development with Scala
    • Strong knowledge of GCP Big Data stack (DataProc, GCS, BigQuery, CloudSQL) or knowledge of the similar toolkit in AWS
    • Performance optimization experience
    • Solid ETL skills, knowledge of data parsing/enrichment/validation techniques, experience of working with different data types
    • At least Intermediate level of English

    Will be a Plus:

    • Practical experience with Apache Spark
    • Practical experience with Apache Avro and Presto
    • Experience and willingness to work in AdTech domain