Big Data Engineer

It's fun to work in a company where people truly BELIEVE in what they are doing!

We're committed to bringing passion and customer focus to the business.

JOB DESCRIPTION: 

The BigData Engineers have expertise in building horizontally scalable applications using distributed technologies like NoSQL Dbs/Hadoop/Spark and others and we execute projects on-premise and cloud based systems. The AI-Engineers and MLOps Engineers work on scaling AI-systems and in building end-to-end productionized MLOps pipelines. 

RESPONSIBILITIES: 

Mandatory Skills – Hadoop, Hive, Cloudera, Spark, SQL

•    Big Data, Hadoop, SCALA, Spark, Data mining, Hive, Impala
•    Strong understanding and experience in distributed computing frameworks   particularly Apache Hadoop, YARN   MapReduce   HDFS   and associated technologies one or more of Hive  Oozie Impala   etc
•    Expert level proficiency in Spark, Pyspark or Scala
•    Experience in at least one of Java   or Python   preferred
•    Hands on experience with Apache Spark and its components’   Streaming   SQL   MLLib   is a strong advantage.
•    Experience working within a Linux computing environment   and use of command line tools including knowledge of Shell Python scripting for automating common tasks.
•    Ability to work in a team in an agile setting   understanding of Git or any version control tools.
•    Kafka and Spark Streaming is a plus.
•    Hadoop (Hive / Impala / Kudu, HDFS, Map Reduce, Others),Java, Spark, Python
 

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!