Senior Big Data Engineer (AdTech Platform)

Bulgaria Czech Republic Europe Hungary Poland Remote (Ukraine) Romania Ukraine Big Data Data Science Engineering Scala Software Developer

Required skills

Scala / strong
Spark / strong
English / strong

As a Data Engineer, you will be an important part of the team that owns our data infrastructure. This is no small responsibility, since as an AdTech company, we think that data is our lifeblood, and there’s a lot of it.  

If you’re excited by and have experience ingesting, processing, storing, analyzing, and working in a Big Data environment, then you are very likely the one to enjoy this role too! 

Customer

Our client is a technology company building the next generation of advertising products and experiences for premium video. The mission is to provide the best advertising experience for consumers, the best monetization for premium publishers, and the best return for brand advertisers.  

Project

The team is committed to bar-raising platforms that serve and support advertising campaigns to maximize viewer, advertiser, and publisher benefit. We are using data engineering, data science, big data, and full-stack engineering using technologies such as Python/Ruby, Scala/Elixir, SQL, Angular/React, AWS (mostly DynamoDB and Kinesis), Databricks/EMR, Spark and Spark Streaming, Redshift/Athena and high traffic (10GB of streaming data is consumed per day), public APIs. There are hundreds of TBs of data in our data lake. 

Requirements

  • Bachelor’s in computer science or related field required
  • Strong knowledge of SQL required
  • Strong knowledge with Spark (using Scala)
  • Working knowledge of serialization formats and their trade-offs (columnar vs row-based)
  • Experience debugging and optimizing Spark jobs
  • Familiarity with database fundamentals, such as ACID, snowflake schema, normalized/denormalized data
  • Must be a strong written and verbal communicator

 

Will be a plus:

  • Familiarity with columnar database, key-value stores, document stores, stream processing, time series databases, data warehouses, and OLAP
  • Experience working with HDFS and S3
  • Familiarity with Data Science tooling in Spark
  • Experience in the advertising industry is a plus
  • Experience with real-time analytics

Responsibilities

  • Build and modify Spark jobs (in Scala) to perform various tasks, from reading Kinesis streams using Spark Streaming, to joining and aggregating huge data sets, to integrating with third party data sources 
  • Develop and launch new features to adapt to evolving business needs 
  • Be an active and engaged owner of our data infrastructure 
  • Be curious and seek to understand all aspects of our business 
  • Maintain high standards of code quality, and encourage the same by providing constructive code reviews to collaborators 
  • Troubleshoot and resolve issues, problems, and errors encountered across various 
  • systems 
  • Collaborate with Data Science, Product, Research, and Engineering teams to iterate on the roadmap 
  • Gather requirements when underspecified 

WHY US

  • Diversity of Domains & Businesses
  • Variety of technology
  • Health & Legal support
  • Active professional community
  • Continuous education and growing
  • Flexible schedule
  • Remote work
  • Outstanding offices (if you choose it)
  • Sports and community activities

Share this vacancy

apply now

apply now

    OR

    Drop your CV here, or
    Supports: DOC, DOCX, PDF, max size 5 Mb