Senior Big Data Engineer (Competence Development)

  • Kharkiv
  • Kyiv
  • Lviv
  • Odesa
  • Big Data

Are you thrilled about designing the right architecture for a new client and kicking it off at full scale in production? Are you good at putting a strong team together and leading it towards a project’s success? Are you keen on sharing your knowledge and educating people around you? Then you are very likely to enjoy this role!

  • Responsibilities

    • Play a lead/supervision role for existing Big Data projects in various domains, designing and building large-scale data processing systems
    • Involve in consulting projects, such as technology audits
    • Engagement of new clients, running discovery phases, supporting sales activities
    • Sharing technical knowledge with team mates and customers
    • Involvement into projects with the possibility to learn new technologies and accumulate best practices
    • Designing and developing big data applications from scratch
    • Designing, reviewing, implementing, testing, and optimizing ETL processes
    • Performing data analysis
  • Requirements

    • Solid development experience with Java, Scala or Python
    • Data processing frameworks: Kafka Streams, Storm, Spark, Flink, etc.
    • Experience in Data Warehousing/RDBMS technologies and back-end reporting systems
    • Hadoop Ecosystem: YARN, HDFS, Zookeeper, etc.
    • DWH/RDBMS: Hive, PostgreSQL/MySQL, Cassandra, HBase, Elasticsearch, Redis, MongoDB, Presto, etc.
    • ETL, data parsing and integrations, have an experience of working with different data types (Parquet/ORC, CSV, etc.)
    • Understanding of distributed computing, microservices and Lambda Architecture principles
    • Cloud platforms: AWS, Azure or Google Cloud
    • Experience with building and maintaining continuous integration/delivery pipelines
    • Intermediate level of English or higher