Brillio

Senior Databricks Engineer

Chennai, Tamil Nadu
ETL SQL Python Data Warehousing PL/SQL T-SQL Stored Procedures Databricks PySpark Azure AWS Kafka GCP BigQuery
Description

Senior Databricks Engineer - R01558783

Team: AI & Data Engineering : Data Engineering

Location: Chennai, Tamil Nadu, India

Commitment: Employee

Workplace Type: hybrid

Senior Data Engineer (Data Bricks)

Primary Skills

  • ETL Fundamentals, SQL, SQL (Basic + Advanced), Python, Data Warehousing, PLSQL, T-SQL, Stored Procedures
  • Modern Data Platform Fundamentals, Data Modelling Fundamentals, Data Ware Housing
  • Databricks
  • Cloud

Specialization

  • Databricks Engineering: Senior Data Engineer

Job requirements

  • Role Overview:
  • We are seeking a highly skilled Databricks Engineer to design, develop, and optimize data pipelines and analytics solutions. The ideal candidate will have strong expertise in Databricks, PySpark, and SQL, with experience in building scalable data solutions across cloud platforms.
  •  
  • Key Responsibilities:
  • •        Design and implement data pipelines and ETL processes using Databricks and PySpark.
  • •        Develop and optimize SQL queries for data transformation and analytics.
  • •        Collaborate with data architects, analysts, and business stakeholders to deliver high-quality data solutions.
  • •        Ensure data quality, governance, and compliance across all processes.
  • •        Integrate data from multiple sources and manage large-scale datasets efficiently.
  • •        Troubleshoot and optimize performance for data workflows and queries.
  •  
  • Primary Skills (Must-Have):
  • •        Databricks (including Delta Lake and ML capabilities)
  • •        PySpark for distributed data processing
  • •        SQL for data manipulation and analytics
  •  
  • Good-to-Have Skills:
  • •        Azure Services: ADF, Synapse, Purview, Fabric
  • •        AWS Services: Glue, Lambda, Step Functions
  • •        Workflow Orchestration: Airflow
  • •        Data Transformation & Integration: DBT, Fivetran, Informatica
  • •        Streaming & Messaging: Kafka
  • •        BI & Visualization: Power BI
  • •        Data Governance Tools: Collibra, Alation
  • •        GCP: BigQuery
  •  
  • Qualifications:
  • •        Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field.
  • •        Proven experience in building and managing data pipelines in cloud environments.
  • •        Strong problem-solving and analytical skills.
  • •        Excellent communication and collaboration abilities.
  •  
  • Nice to Have:
  • •        Experience with multi-cloud environments (Azure, AWS, GCP).
  • •        Familiarity with modern data stack and data governance frameworks.
  •   Promoting Women Professionals
Brillio
Brillio

0 applies

0 views

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 452 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

To try it out

For active job seekers

For those who are passive looking

Cancel anytime

Frequently Asked Questions

  • We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
  • We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
  • We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
  • We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
  • Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
  • Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
  • Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅

What Fellow Engineers Say