Required Skills:
- 5+ years' experience working in a similar Senior Software Engineer role within a data platform/data engineering team
- Extensive experience with Big Data and distributed systems.
- Experience with stream processing using Spark.
- Ability to design large-scale distributed systems.
- Prior experience in building data platforms using Big Data stack (Kafka, Hadoop, Spark, Flink, Hive ..) on the public cloud.
- Excellent programming skills in Java.
- Understanding of distributed systems concepts and principles (consistency and availability, liveness and safety, durability, reliability, fault-tolerance, consensus algorithms).
- Deep understanding of Algorithms, Data Structures, and Performance Optimization Techniques.
- Eager to learn new things and passionate about technology!.
- Comfortable working with Kubernetes, AWS, Docker, and Terraform.
What you would do:
- Hands-on coding and implementation of high-performance Spark applications, leveraging your deep understanding of distributed computing and data processing.
- Designing and optimizing Spark applications.
- Design cloud-native data platform and analytics SaaS services
- Own architecture and provide technical leadership to multiple teams
- Hands-on coding>60% of the time
- Design and build large-scale real-time stream processing systems
- Design and develop micro-services and analytics SaaS solutions
- Own scalability, availability, and data security
- Own, tackle & resolve code defects
- Mentor junior developers in standards and best practices!
What you would need to succeed:
- Extensive experience working on a public cloud-like AWS
- Prior experience and passion for building a large-scale multi-tenant cloud-native data platform
- Emphasize team wins over individual success
- Strong technical interpersonal skills
- Excellent software development skills in one or more of the following languages: Java/Scala
- Extensive experience with Big Data and distributed systems.
- Expertise in Spark or Flink, Kafka, and Hadoop ecosystem
- Ability to design large-scale distributed systems
- Have developed in more than one language and ready to pivot to any language/framework
- Understand microservices architecture patterns pattern like Service Discovery/API Gateway/Domain Driven Design etc
- Experience with containers technology
- Ability to work in an agile fast-paced environment
- BS or MS degree (Computer Science or Math)
- AWS (EMR, S3, Glue, Kinesis)
- Debezium
- ELK
- Experience in building SaaS/PaaS on AWS/GCP/Azure.
- AI/ML
Other Jobs from Guidewire Software
Senior Software Engineer (Spark) - Cloud Data Platform
Project Manager, GSC
Project Manager, GSC
Site Reliability Engineer
Project Manager, GSC
Similar Jobs
Senior Software Engineer (Spark) - Cloud Data Platform
Senior Backend Engineer, Growth Alliance (m/f/x)
Senior ML Engineer
Econometric Data Scientist
Copy of Data Engineer III
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 401 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got about 70,000 jobs from 5,000 vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 5,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say