Senior Data Engineer (Data Usage)
Department: Data Platform
Employment Type: Full Time
Location: Almaty, Almaty Special District, Kazakhstan, Hybrid
Our tech stack
Languages: Python, SQL
Frameworks: Spark, Apache Beam
Storage and analytics: BigQuery, GCS, S3, Trio, other GCP and AWS stack
components Integration: Apache Kafka, Google Pub/Sub, Debezium
ETL: Airflow 2
Infrastructure: Kubernetes, Terraform
Development: GitHub, GitHub Actions, Jira
Key Responsibilities
- Foster a culture of working with data across the organization, ensuring data-driven decision-making
- Create and maintain a unified system for processing, storing, and validating data, ensuring data integrity and accessibility
- Design and build processes for processing and enriching data, participating in all stages of the data pipeline from data capture to consumer presentation
- Develop and maintain infrastructure for big data storage and processing using tools like Kubernetes (K8S) and Terraform
- Create and optimize APIs (REST, gRPC) for high-load data access services, enabling efficient data retrieval
- Write integration and unit tests, develop automation tools for data validation and alerting
- Сontribute to system design and architecture with the development team
Skills, Knowledge and Expertise
- Advanced proficiency in Python 3.7+ with strong experience in developing ETL processes using PySpark
- Proven experience in developing data flows using Airflow2
- High level of expertise in SQL, including complex queries and optimization
- Extensive knowledge and industrial experience with Kubernetes (K8S)
- Strong understanding of data processing algorithms and principles, with experience in Spark/Flink
- Solid understanding of general programming concepts, including design patterns, OOP, modularity, and pure architecture
- Demonstrated ability to take ownership of technologies or services and proactively contribute ideas to the team
Conditions
- Stable salary, official employment;
- Health insurance;
- Hybrid work mode and flexile schedule;
- Relocation package offered for candidates from other regions;
- Access to professional counseling services including psychological, financial, and legal support;
- Discount club membership;
- Diverse internal training programs;
- Partially or fully payed additional training courses;
- All necessary work equipment.
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say