echojobs.io
Login

Upstox

Senior Data Engineer/ Lead Data Engineer

Bengaluru, India
DynamoDB Terraform Python Scala Spark AWS SQL Streaming Hadoop
Search for More Jobs
Description
The Upstox Story: Upstox is one of India's leading Fin-Tech companies with a mission to simplify trading & investing to make it easily accessible to the masses. We aim to enable everyone, from new investors to seasoned traders, to invest across multiple categories with our state-of-the-art trade & investment platform and commission-free pricing. We offer numerous asset categories to invest in, like Stocks, IPOs, Mutual Funds, and more.
By focusing on our customers’ needs and equipping them with personalised yet powerful tools, we witnessed a steep growth of 800% in our customer base from 25 Thousand in 2017 to 2 Lakh in 2019. With 1500% growth in 2020, currently, over 10 million customers trust us with their investment decisions, thus setting us on the course to become an industry-leader in the country. 
Our mission is simple - to break down the complexities of investing and make it more effortless, accessible, affordable, and easy for the masses to adopt. This key principle when infused with intuitive design and leading-edge technology will help us empower every Indian to take control of their investments.
RKSV Securities was founded by Ravi Kumar and Shrinivas Viswanath in 2009 and was soon graced by Kavitha Subramanian as the third co-founder in 2016. Backed by Ratan Tata, Upstox had raised $4 million in Series A funding in early 2016 that was led by Kalaari Capital. The Series B funding round scaled multifold and witnessed an investment of $25 million by US-based investment firm - Tiger Global Management in September 2019. 
We have a team of highly skilled technology and finance professionals, and are currently looking for highly motivated field experts to be part of our high-energy team. 

Here is what you need to know about this role: Senior Data Engineer / Lead Data Engineer

Who you will work with: The Data Engineering team at Upstox is responsible for architecting, developing and maintaining a Lake House (Data Lake + Data Warehouse) which serves as a single source of truth for organization-wide data. The team is also responsible for governing the data assets, generating business & customer insights and securely & optimally exposing it to downstream systems, services and end Users. 

What you will do: 
1. Create and maintain scalable Big-data ETL pipelines that feed organization-wide data into Upstox Data Platform(UDP).
2. Create and maintain modular and scalable Big-data processors that can be leveraged to get business & customer insights, operational efficiency and other key business performance metrics.
3. Create and maintain scalable connectors that expose the data securely for consumption by downstream systems and services in near real-time.
4. Collaborate with Devops & Infra team to build the infrastructure required for optimal extraction, transformation and loading of data from a wide variety of data sources.
5. Collaborate with Devops team to monitor and maintain the data platform components and ensure internal uptime SLAs are met.
6. Collaborate with the DBA & BI team to set up data quality control processes.    

You should apply if you have: 
1. Must have: Hands-on working experience with Python / Scala, Spark(or similar frameworks), Airflow, Apache HUDI/Delta/Iceberg (OpenTableFormat), AWS Athena, Big-data ETL pipelines, Hadoop (or similar distributed systems), advanced SQL,SQL query tuning.
2. Good to have: Working knowledge of streaming frameworks (Spark Streaming / Apache Flink or similar frameworks), workflow management tools / platforms (Apache Airflow / NiFior similar solutions),DBT (data build tool) dimensional data modelling, cloud native solutions (preferably on AWS).
3. Brownie Points: Understanding of AWS Services -Redshift, DynamoDB, Lambda, Glue, Athena, Lake Formation, IAM, SQS & SNS, creating CloudFormation / Terraform templates, understanding of Devops & SRE.
4. At least 7 years of experience in a Data Engineering role with exposure to dealing with large volumes of data.
5. Bachelor's / Master's degree in the field of Computer Science or equivalent.
6. Resilience and determination to deliver with high standards.
7. A Well-organized approach to problem solving and exhibit attention to detail.
8. A strong desire to work in a fast-paced dynamic environment.
9. Technical expertise to deliver scalable enterprise-grade solutions and own it end to end.
10. Strong communication skills and demonstrate effective collaboration with multiple stakeholders.

Location: Bengaluru
Upstox
Upstox
Financial Services FinTech Trading Platform

0 applies

3 views

Other Jobs from Upstox

SDE III - IOS Developer

Bengaluru, India

Software Development Engineer - II (Android)

Bengaluru, India Mumbai, India

Similar Jobs

Data Driven Software Developer

Remote Fort Meade, MD

Lead Software Engineer

Bengaluru, India

Senior Data Engineer

Bengaluru, India

Data and Feature Engineer

Remote Austin, TX

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 401 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

To try it out

For active job seekers

For those who are passive looking

Cancel anytime

Frequently Asked Questions

  • We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
  • We've got about 70,000 jobs from 5,000 vetted companies. No fake or sleazy jobs here!
  • We aggregate jobs from 5,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
  • We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
  • Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
  • Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
  • Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅

What Fellow Engineers Say