Senior Big Data Engineer (Scala/Java, Spark)

Description

Our customer is one of the world's largest technology companies based in Silicon Valley with operations all over the world. On this project, we are working with bleeding-edge big data technologies to develop a high-performance data analytics platform, which handles petabytes of data. We are looking for an enthusiastic and technology-proficient Senior Big Data Developer, who is eager to participate in design and implementation of a top-notch big data solution that will be deployed at a massive scale.

Responsibilities:

• Participate in the design and development of a big data analytics application
• Design, support and continuously enhance the project code base, continuous integration pipeline, etc.
• Write complex ETL processes and frameworks for analytics and data management
• Implement large-scale near real-time streaming data processing pipelines
• Work with a team of industry experts on cutting-edge big data technologies to develop solutions for deployment at massive scale

Requirements:

• Strong knowledge of Scala/Java, over 4 years of experience 
• Implementing Data Lakes, Data Warehousing or analytics systems is an advantage
• Good understanding of distributed computing technologies, approaches, and patterns
• In-depth knowledge of Hadoop and Spark, experience with data mining and stream processing technologies (Kafka, Spark Streaming, Akka Streams)
• Understanding of the best practices in data quality and quality engineering
• Ability to quickly learn new tools and technologies

Will be a plus:

• Knowledge of Unix-based operating systems (bash/ssh/ps/grep etc.)
• Experience with Github-based development processes
• Experience with JVM build systems (SBT, Maven, Gradle)

• Opportunity to work on bleeding-edge projects
• Work with a highly motivated and dedicated team
• Competitive salary
• Medical insurance
• Benefits program
• Corporate social events
• Flexible working hours
• Opportunity to relocate to another country where the company's offices are present.

About us: 

Grid Dynamics is the engineering services company known for transformative, mission-critical cloud solutions for retail, finance and technology sectors. We architected some of the busiest e-commerce services on the Internet and have never had an outage during the peak season. Founded in 2006 and headquartered in San Ramon, California with offices throughout the US and Eastern Europe, we focus on big data analytics, scalable omnichannel services, DevOps, and cloud enablement.