Middle/Senior Big Data Engineer (Big Data Competence Center)

  • Remote (Ukraine only)
  • Big Data

We are inviting you to join our growing Big Data Competence Center, which is on top of new business and new projects at Sigma.

Our Big Data Competence Center – is a place where we are collecting the best engineering & technology practices uniting them into one single place to provide the best technical excellence services for our clients.

  • Responsibilities

    • Contributing to new technologies investigations and complex solutions design
    • Coming up with well-designed technical solutions and robust code
    • Working and professionally communicating with customer’s team
    • Taking up responsibility for delivering major solution features
    • Participating in requirements gathering and clarification process
    • Developing core modules and functions
    • Performing code reviews, writing unit, and integration tests
  • Requirements

    • 4+ years development experience with Java, Scala, or Python
    • Solid knowledge of algorithms and data structures
    • Experience with AWS — Glue, Lambda, Step Functions, S3, etc.
    • Experience developing data pipelines based on one of the mainstream frameworks like Spark/Flink/Presto, etc.
    • Experience with developing data lakes and data warehouses based on one of the mainstream technologies like Hive/Snowflake/OLAP/Hudi, etc.
    • Knowledge in SQL and solid experience with NoSQL or RDBMS technologies
    • Experience with data integrations and different data formats like CSV, Protobuf, Parquet, Avro, ORC, etc.
    • Solid understanding of technical excellence and hands-on experience with code reviews, test development, and CI/CD

    Would be a plus:

    • Experience with Azure and GCP
    • Experience with developing Snowflake-driven data warehouses
    • Experience with developing Kinesis-driven streaming data pipelines