Data Engineer
Location: Lviv, Lviv Oblast, ua, Remote
Company Description
Seeking a Data Engineer to lead a small team and modernize a simple data platform into a cloud-based self-service analytics project.
Sigma Software provides top-quality software development, graphic design, testing, and support services. Systems developed to deliver customer benefits in automotive, telecommunications, aviation, advertising, gaming, banking, real estate, and healthcare industries
It is an Internal Sigma Software project that combines 2 goals: automating reporting and exposing a self-service data analytics system for the company. You will be responsible for designing and modeling data into DWH and Data Marts using Spark and MS SQL, exposing this data to, and collaborating with, BI engineers making reports in Apache Superset as well as other roles consuming such data, moving on-premises solutions to the cloud
Job Description
The goal is to create an efficient system for collecting, processing, analyzing, and visualizing large amounts of data from various sources
- Lay down the foundation and model the data
- Develop a platform for building and maintaining data pipelines that collect data from different sources
- Create Data Warehouse
- Analyze and prepare domain descriptions in collaboration with Business analytics
- Create Data Marts
- Design a permission model with flexible control over vertical and horizontal access to data
Qualifications
- Conceptual knowledge of data analytics fundamentals, e.g., dimensional modeling, ETL/ELT, reporting tools, data governance, data warehousing, structured and unstructured data
- Strong SQL knowledge and experience with RDBMS, confident knowledge of database fundamentals
- Experience in database development and data modeling, ideally with Databricks/Spark
- Experience with Python
- Experience with Azure
- Working knowledge of serialization formats and their trade-offs (columnar vs. row-based)
- Experience debugging and optimizing Spark jobs
- Strong written and verbal communication skills
- At least an Upper-Intermediate level of English
- BS in Computer Science or a related field
WOULD BE A PLUS
- Experience with a Business Intelligence tool
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say