Description
ELT Engineer
Location: New York, NY
Position Summary:The ETL Engineer is responsible for designing, developing, and maintaining data pipelines that extract, transform, and load data into analytics platforms, including SQL Server and ClickHouse for real-time and high-performance querying. This role ensures data integrity, scalability, and performance for BI, reporting, and advanced analytics.
Job Responsibilities:
- ETL Pipeline Development
- Design and implement ETL workflows using SQL Server Integration Services, Azure Data Factory, Databricks, and ClickHouse.
- Develop transformations for structured and semi-structured data; optimize for speed and reliability.
- ClickHouse Integration
- Build and maintain ingestion pipelines for ClickHouse using batch and streaming methods.
- Optimize ClickHouse schemas, partitions, and materialized views for query performance.
- Data Integration
- Connect multiple sources (SQL Server, APIs, cloud storage, Kafka/Event Hubs) into centralized data platforms.
- Performance & Optimization
- Monitor SSIS ETL jobs and SQL Server and ClickHouse queries; tune for low latency and high throughput.
- Implement compression, sharding, and replication strategies in ClickHouse.
- Data Quality & Governance
- Apply validation checks, error handling, and lineage tracking.
- Ensure compliance with security and governance standards.
- Collaboration
- Work with data engineers, analysts, and BI teams to deliver reliable datasets.
- Support real-time analytics and dashboards powered by PowerBI and ClickHouse.
- Documentation
- Maintain clear documentation for ETL processes, SQL Server and ClickHouse schemas, and operational playbooks.
- Strong experience with ETL tools (Azure Data Factory, SSIS, Databricks).
- Proficiency in SQL and relational database concepts.
- Familiarity with ClickHouse (schema design, ingestion, optimization).
- Familiarity with cloud platforms (Azure preferred).
- Programming skills in Python or Scala for data processing.
- Experience with streaming data (Kafka, Azure Event Hubs).
- Familiarity with big data frameworks.
- Understanding of DevOps practices for data pipelines.
- Exposure to BI tools (Power BI, Tableau) integrated with ClickHouse.
- Bachelor’s degree in Computer Science, Data Engineering, or related field.
- 3+ years of experience in ETL development and data integration.
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say