Senior Data Engineer (AdTech)

Brazil Colombia Europe Europe (remote) Latin America Mexico Data Engineer Engineering Python Scala

Required skills

Scala / strong
Python / good
Spark / good
LLM / strong
English / strong

The Senior Data Engineer will collaborate with our team to build, enhance, and maintain high-performance data systems and machine learning models, ensuring their scalability and reliability.

Responsibilities include designing and maintaining high-throughput data pipelines, optimizing real-time and batch data processing using Scala, and integrating advanced data solutions to improve performance. The role involves working with large-scale distributed systems, handling terabytes of data per second and processing millions of writes per second.

Our team is at the forefront of AdTech innovation, enabling cutting-edge solutions for data-driven advertising. We value hard work and flexibility, offering an environment where engineers can experiment, innovate, and push technological boundaries.

Our client is a leading AdTech company specializing in high-performance data systems and machine learning models, processing terabytes of data per second and millions of writes per second.

It is a large-scale AdTech platform designed to process massive amounts of data in real time, optimizing data-driven advertising with advanced machine learning models. It ensures scalability and reliability, enabling businesses to maximize efficiency and performance while leveraging cutting-edge data solutions.

Requirements

  • 5+ years of experience as a Data Engineer
  • Advanced knowledge of different non-relational schema models (Column Family, Graph, Document, and Object)
  • Experience with advanced topologies and architecture design, such as Kappa and Lambda architectures
  • GCP Dataflow experience
  • Experience in Scala
  • Experience in Python
  • Strong background in working with Large Language Models (LLMs)
  • Experience with high-throughput systems
  • Strong communication skills and at least C1 level of English

 

Would be a plus

  • Experience in the AdTech industry

Personal Profile

  • Problem-solving mindset
  • Ability to work closely with cross-functional teams
  • Willingness to experiment with new technologies and approaches

Responsibilities

  • Work with Apache Spark batch and real-time streaming to process data at scale
  • Work with Scala microservices hosted on K8s (GKE) to support our products
  • Work with MlLib and TensorFlow on Vertex AI to solve prediction and simulation issues, as well as a variety of machine learning challenges
  • Deploy new models and engines for new ideas and analysis.

WHY US

  • Diversity of Domains & Businesses
  • Variety of technology
  • Health & Legal support
  • Active professional community
  • Continuous education and growing
  • Flexible schedule
  • Remote work
  • Outstanding offices (if you choose it)
  • Sports and community activities

REF3283Q

Share this vacancy

apply now

apply now

    OR

    Drop your CV here, or

    Supports: DOC, DOCX, PDF, max size 5 Mb

    Take a quiz

    Take a quiz

      Was it comfortable to apply the CV?


      How did you find us?




      Did you hear about us before visiting the site?