echojobs.io
Login

Algoworks

Senior Data Engineer

Noida, India
SQL Snowflake Azure EDI XML Python
Search for More Jobs
Description

Senior Data Engineer

Location: Noida, India

Department: Product Engineering - Cloud and Digital

Experience: • 5–10 years

Skills: Microsoft Azure, Snowflake

Senior Data Engineer (Supply Chain)
Role Overview
We are hiring Senior Data Engineers to build scalable data pipelines for supply chain transaction data. The role involves ingesting raw EDI/XML data, transforming it into structured datasets, and enabling reporting and analytics.
This is a hands-on engineering role focused on execution and delivery.
Key Responsibilities
    • Build batch ingestion pipelines for transaction data from multiple systems
    • Develop transformations for structured analytics datasets
    • Implement Bronze (raw), Silver (cleaned), and Gold (reporting) layers
    • Handle schema variations across trading partners and systems
    • Optimize queries and pipeline performance
    • Collaborate with QA and BI teams to ensure data accuracy
    • Use AI tools (Cursor, Copilot) to accelerate development of ELT pipelines and SQL queries
    • Leverage AI for handling schema variations across trading partners and data sources
    • Use AI-assisted debugging and optimization for pipeline performance
    • Generate and refine transformation logic using AI, followed by manual validation
Required Experience
    • 5–10 years in data engineering
    • Strong SQL and experience with Snowflake / Azure data services / data warehouses
    • Experience working with large-scale transactional data
    • Experience handling EDI, XML, or semi-structured data formats
    • Understanding of batch processing and pipeline orchestration
    • Hands-on experience using AI tools for SQL development, pipeline creation, and debugging
    • Ability to validate AI-generated code for correctness, performance, and scalability
    • Experience using AI tools in data engineering workflows (ELT, batch pipelines)

Preferred Background
    • Experience in supply chain, logistics, or financial transaction systems
    • Familiarity with data quality checks and validation frameworks


Algoworks
Algoworks

0 applies

0 views

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 452 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

To try it out

For active job seekers

For those who are passive looking

Cancel anytime

Frequently Asked Questions

  • We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
  • We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
  • We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
  • We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
  • Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
  • Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
  • Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅

What Fellow Engineers Say