Principal Machine Learning Engineer - Spark, ETL, Pre-Processing, Pipeline, Machine Learning - REF7856R

 

Responsibilities:

At the Premier Cloud Security Provider, we are working with the massive scale of network data, security data, and enterprise data every day. We are seeking out engineers with a passion to build out tools and platforms, process and analyze data at scale, and solve real-world business problems.

As a software engineer for our Machine Learning platform, you have three main responsibilities:

1. You will architect, build and maintain large-scale distributed systems to support the whole pipeline including data collection, feature engineering, model training, model evaluation, model deployment, and real-time serving.
2. You will apply analytical and math/statistics skills to stay on top of data and to ensure results are coherent and reliable.
3. You will solve complex real-world business problems (e.g., threat detection, automation, and business intelligence) by working closely with various stakeholders including data scientists, product management, and product engineering teams.

You may not have any prior data science and ML background but you need to have a desire in building up knowledge in this area. For example, we expect you to have tremendous curiosity in how the data can and will be utilized by the data scientist in order to have a very effective collaboration with data scientists.

Required Skills:

- 15+ years of prior work experience as a Software Engineer or ML platform engineer

- Very strong algorithm and programming skills in building out data collection/processing infrastructure, Machine Learning model training, and serving platforms

- Very strong Python and SQL scripting skills

- 10+ year of experience using distributed data processing such as Spark, BigQuery or Apache Beam

- 10+ year of experience with event messaging such as Kafka, RabbitMQ, etc

- 10+ years of experience working with Docker, Kubernetes

- Ability to learn, evaluate and adopt new technologies

- BS Degree in Computer Science or related field

 

Desirable Skills:

- Experience with Go, C++, or Javascript

- Experience with setting up SQL/NoSql database such as Postgres, MongoDB, Redis, and table schema

- 5+ year of experience with ML automation platforms such as Kubeflow, Airflow or MLFlow

- Experience with data serialization techniques and data stores for persisting events

- Experience with Google cloud (or other public cloud)

- Experience with building quality software by writing robust interfaces, considering design principles, and applying sound testing practices

- Ability to lead and execute projects from start to finish

- Knowledge of NLP/Text mining techniques and related open-source tools

- Familiarity with networking and networking security

- Excellent interpersonal, technical, and communication skills

- Advanced degree in Machine Learning, Computer Science, Electrical Engineering, Physics, Statistics, Applied Math or other quantitative fields from a reputed university (Ph.D. a plus)

 

 

#LI - AN4