Data Engineer
Team: Engineering and Product Management
Location: Remote
Commitment: Full Time
Workplace Type: remote
Salary:
We are seeking a seasoned Data Engineer with a minimum of 2 - 5 years of experience to join our team. The ideal candidate will possess a deep understanding of large-scale data processing systems, with a focus on designing and building both batch and streaming data pipelines. You will play a vital role in managing our data and ensuring its accessibility, security, and accuracy.
About the job:
- Design, develop, and deploy large scale data processing pipelines, both batch and streaming, using technologies such as Dataflow, Apache Beam, Spark, Akka, Pub/Sub.
- Expertise with multiple data storage technologies such as Bigtable/HBase, BigQuery, Spanner, CloudSQL/Postgres.
- Work with stakeholders to understand business problems, develop use-cases, and translate them into pragmatic and effective technical solutions.
- Design and develop appropriate schema for data based on understanding of the domain problem.
- Manage data lineage and ensure data security with appropriate tools and methodologies.
- Collaborate with data scientists, architects, and other stakeholders to ensure alignment between technical and business strategy.
- Continuously monitor, refine and report on the performance of data management systems.
- Mentor junior data engineers, reviewing their outputs and directing their professional development.
About you:
- 2 - 4 years of experience in data engineering, particularly in designing and developing data pipelines.
- Proven expertise with technologies such as Dataflow, Apache Beam, Spark, Akka, Pub/Sub.
- Experience with various data storage technologies including Bigtable/HBase, BigQuery, Spanner, CloudSQL/Postgres.
- Ability to design data schemas based on an understanding of the domain problem.
- Experience with data security and data lineage methodologies and tools is preferred.
- Familiarity with agile development methodologies.
- Exceptional communication skills, able to explain complex technical concepts in clear, plain English.
- BSc degree in Computer Science, Engineering or a related field, or equivalent work experience.
Nice to have:
- Experience with data migration projects
- Knowledge of dbt, Airflow, or similar orchestration tools
- Experience in multi-cloud environments
- Familiarity with data modeling and analytics use cases
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say
