Brillio

Senior Data Engineer

Bangalore, Karnataka
SQL Python Data Warehousing Snowflake PL/SQL T-SQL dbt Pandas NumPy Airflow AWS GCP Azure S3
Description

Senior Data Engineer - R01561387

Team: AI & Data Engineering : Data Engineering

Location: Bangalore, Karnataka, India

Commitment: Employee

Workplace Type: hybrid

Senior Data Engineer

Primary Skills

  • DataStream, ETL Fundamentals, SQL, SQL (Basic + Advanced), Python, Data Warehousing, Time Travel and Fail Safe, Snowpipe, SnowSQL, Modern Data Platform Fundamentals, PLSQL, T-SQL, Stored Procedures

Specialization

  • Snowflake Engineering: Data Engineer

Job requirements

  • Job Summary

    We are seeking a Senior Data Engineer with strong expertise in DBT, Python, and SQL to design, develop, and optimize scalable data pipelines and ETL processes. The ideal candidate will have hands-on experience working with modern data stacks, particularly Snowflake, and will play a key role in building reliable analytics and reporting solutions on cloud platforms.

    This role demands strong problem-solving skills, deep understanding of data warehousing concepts, and the ability to collaborate closely with business stakeholders to translate requirements into robust technical solutions.


    Key Responsibilities

  • Design, develop, and maintain DBT models, transformations, tests, and optimized SQL code for analytics and reporting use cases.
  • Build and enhance scalable ETL/ELT pipelines using DBT and complementary data engineering tools.
  • Write complex, high-performance SQL queries to process, analyze, and transform large datasets.
  • Develop clean, efficient, and scalable code in Python, with strong hands-on experience using Pandas and NumPy.
  • Optimize data pipelines for performance, scalability, and cost efficiency, especially in cloud-based data warehouses.
  • Troubleshoot and resolve ETL failures, performance bottlenecks, and data quality issues.
  • Develop and maintain scripts using Unix Shell scripting, Python, and related tools for data extraction, transformation, and loading.
  • Write, tune, and support Snowflake SQL and contribute to Snowflake implementation and optimization initiatives.
  • Work with workflow orchestration tools such as Apache Airflow (or similar platforms) to manage and monitor data pipelines.
  • Integrate data solutions with user-facing applications where required.
  • Collaborate with business, analytics, and technical stakeholders to gather requirements and deliver reliable, interpretable data solutions.
  • Implement data validation, testing, and quality checks within DBT workflows to ensure accuracy and reliability.

  • Required Skills & Qualifications

  • 6+ years of overall IT experience, with strong focus on data engineering.
  • Proven hands-on experience with DBT (Data Build Tool) including model development, transformations, and testing.
  • Strong programming expertise in Python (mandatory).
  • Advanced proficiency in SQL, including writing and optimizing complex queries on large datasets.
  • Hands-on experience designing, building, and maintaining ETL/ELT pipelines.
  • Experience with Unix/Linux shell scripting.
  • Solid understanding of data warehousing concepts, dimensional modeling, and best practices.

  • Preferred / Good-to-Have Skills

  • Experience with Snowflake implementation, performance tuning, and cost optimization.
  • Knowledge or hands-on exposure to Salesforce CDP.
  • Experience using Airflow or other orchestration frameworks.
  • Exposure to cloud platforms such as AWS, GCP, or Azure.
  • Experience working with cloud storage solutions like Amazon S3, Google Cloud Storage (GCS), or Azure Blob Storage.

  • Ideal Candidate Profile

  • Strong analytical and problem-solving skills
  • Comfortable working in fast-paced, data-driven environments
  • Ability to own data pipelines end-to-end
  • Strong collaboration and communication skills

Brillio
Brillio

0 applies

0 views

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 452 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

To try it out

For active job seekers

For those who are passive looking

Cancel anytime

Frequently Asked Questions

  • We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
  • We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
  • We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
  • We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
  • Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
  • Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
  • Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅

What Fellow Engineers Say