Data Engineer (Spark, Scala, Python, Cassandra, Elasticsearch, AWS, Airflow, SQL)

Key Skills

• 
  
Domain Expertise
• 2+ years of experience as a software/data engineer 
• Bachelor’s degree in Computer Science, MIS, or Engineering


Technical Skills
• Experience in software development using programming languages & tools/services: Java or Scala, Big Data, Hadoop, Spark, Spark SQL, Presto \ Hive, Cloud (preferably AWS), Docker, RDBMS (such as Postgres and/or Oracle), Linux, Shell scripting, GitLab, Airflow, Cassandra & Elasticsearch.
• Experience in big data processing tools/languages using Apache Spark Scala.
• Experience with orchestration tools: Apache Airflow or similar tools.
• Strong knowledge on Unix/Linux OS, commands, shell scripting, python, JSON, YAML.
• Agile scrum experience in application development is required. 
• Strong knowledge  in AWS S3, PostgreSQL or MySQL.
• Strong knowledge  in  AWS Compute: EC2, EMR, AWS Lambda.
• Strong knowledge in Gitlab /Bitbucket .
• AWS Certification is a plus
• "Big data" systems and analysis
• Experience with data warehouses or data lakes

Mindset and attributes

• Strong communication skills with ability to communicate complex technical concepts and align organization on decisions.
• Sound problem-solving skills with the ability to quickly process complex information and present it clearly and simply.
• Utilizes team collaboration to create innovative solutions efficiently.