Senior Data Engineer (Communication Management Solution)

Requirements

• At least 5 years of experience with AWS tools such as Glue, Athena, Redshift, S3, Lambda, CloudFormation  
• 5+ years experience with Python  
• Practical experience with Kafka  
• Experience with Spark (PySpark) 
• Good knowledge of SQL  
• Familiarity with running and optimizing AWS Redshift DB  
• Deep understanding of database development and data modeling  
• Good knowledge of data engineering, e.g., dimensional modeling, ETL, reporting tools, data governance, data warehousing based on AWS infrastructure  
• Experience with BI visualization tools (Tableau is the preferred one)  
• Upper-Intermediate level of spoken and written English  

Nice to have:

• Knowledge of Machine Learning and Data Science fields (Unsupervised and Supervised Learning, outlier detection)  
• Experience in developing and deploying machine learning models 

Responsibilities

• Providing technical leadership to the team of data engineers implementing architectures based on AWS Cloud platforms (Glue, Lambda, S3, Redshift, etc.) 
• Building Warehouse based on Redshift, Redshift Spectrum, and S3 services 
• Designing, developing, deploying, optimizing, and maintaining data architecture and pipelines that adhere to defined ETL and data lake principles  
• Discovering, understanding, and organizing disparate data sources and structuring them into clean data models with clear and understandable schemas 
• Proposing solutions for real-time and batch data processing 
• Interacting with developers and business stakeholders and the problems needing to be solved using Data Engineering methods