Description
View all jobs
REQUIRED QUALIFICATIONS
PREFERRED QUALIFICATIONS
Big Data Engineer
San Francisco, CADue to COVID-19, applicants will be interviewed remotely.
Learn how candidates are getting hired during COVID.
https://match-relevant.com/your-story
Do you know Big Data?
As a Senior Big Data Engineer you will work with web services, messaging and Big Data technologies.
Learn how candidates are getting hired during COVID.
https://match-relevant.com/your-story
Do you know Big Data?
As a Senior Big Data Engineer you will work with web services, messaging and Big Data technologies.
RESPONSIBILITIES
- Design and build Big Data Platform that is fault-tolerant and scalable.
- Participate in API-based integration and back-end based build-out of data architecture and pipeline.
- Develop, refine and scale data management and analytics procedures, systems, workflows, best practices and other issues.
- Development of data-driven products.
- Visualize and communicate data clearly for use both internally and externally.
- Collaborate with our engineers to produce excellent products for Plum clients as well as streamline internal processes.
REQUIRED QUALIFICATIONS
- 3+ years experience in building scalable, high-performance, reliable, highly available and large distributed systems with high degree of autonomy.
- Experience in working with big data technologies such as Spark, Hadoop ecosystems, Kafka, Zookeeper, Elasticsearch, Yarn, MapReduce, Storm, HBase and Cassandra.
- Experience in SQL based technologies such as MySQL and have solid understanding of NoSQL solutions such as MongoDB and DynamoDB.
- Understanding of data flows, data architecture and processing of structured and unstructured data.
- Experience with AWS cloud services such as EC2, RDS, S3, EMR and Redshift.
- Experience with data mining concepts, machine learning algorithms and basic statistics.
- Understanding of Social API integration (Facebook, Twitter, Google).
- Proficiency in high level language such as Java, Scala or Python.
- Strong knowledge of Linux / UNIX systems.
- An entrepreneurial spirit as well as passion for solving difficult challenges through innovation and creativity, with a strong focus on results.
- Bachelor’s degree in Mathematics, Statistics, Engineering, Computer Science or related discipline.
- Legal authorization to work in the U.S. is required. We will not sponsor individuals for employment visas for this job.
PREFERRED QUALIFICATIONS
- Knowledge of Text Mining and NLP techniques.
- Experience with Graph database like Neo4j or Titan and web crawler such as Apache Nutch.
- Experience with HTML/Javascript/XPath and other web technologies.
Jobs from our Partners
Hadoop Tech Lead
Pittsburgh, PA
US
Other Jobs from Match Relevant
Lead Network Engineer
San Jose, CA
Android Engineer
Irvine, CA
Python Developer
Boston, MA
Python Django Developer
Remote
New York, NY
Similar Jobs
Big Data Engineer
San Francisco, CA
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
50,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 216 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
Cancel anytime / Money-back guarantee