Senior Data Engineer, India

As a Senior Data Engineer, you will design, build, and manage components of our highly available real-time and batch data pipelines handling petabytes of data. Our pipeline platform is designed to ingest and process billions of events per day, and make the resulting aggregations and insights available within minutes in our analytical data stores. Data Analytics is at the core of our business, and we’re constantly innovating to make our systems more performant, timely, cost-effective, and capable while maintaining high reliability. You will build on top of our core data infrastructure and pipelines using technologies and tools tailored for massive data sets including Flink, Spark, Kafka, Iceberg and Druid while working in the AWS cloud environment.  

If you are interested in building systems that can consume and explore billions of data points a day, work with petabytes of data, and want to push what is possible with data, this is the place for you!

As a Senior Data Engineer, you’ll get to:

• Architect, build, and own real-time and batch data aggregation systems to deliver quality analytical reports for our internal and external customers.
• Collaborate with Data Scientists, Backend Engineers, Data & Infrastructure Operations, and Products Managers to deliver new features and capabilities for customers.
• Develop clean, safe, testable, and cost-efficient solutions.
• Make well-informed decisions with deep knowledge of both the internal and external impacts on teams and projects. Foresee shortcomings ahead of time and be able to drive to resolution.

You’ll be a good fit if you have:

• Bachelors in CS or equivalent.
• 6+ years of Software Engineering or Data Engineering experience with a recent focus on big data. 
• Strong development skills in Java or Scala and Python.
• Solid background in the fundamentals of computer science, distributed systems, large scale data processing as well as database schema design and data warehousing.
• Practical experience managing AWS or Google Cloud environments.
• Experience in containerized deployment or Kubernetes is a big plus!
• Good understanding of a broad spectrum of NoSQL, traditional RDBMS, and analytical/columnar data stores including Postgres, Druid, Vertica, Redshift, Hadoop, Hive, Cassandra, Aerospike, and Redis.
• Ability to build systems that balance scalability, availability, and latency.
• Strong ability to advocate for the continual deployment and automation tools, monitoring, and self-healing systems that can help improve the lives of our engineers.
• Great communication skills and you are a team player who has a proven track record of building strong relationships with management, co-workers, and customers.
• A desire to learn and grow, push yourself and your team, share lessons with others and provide constructive and continuous feedback, and be receptive to feedback from.
  
  This role will be based at our Bengaluru, KA office and follows a Hybrid schedule that will be aligned with our Return to Office guidelines.