You Will..
- Design, build, and maintain scalable data pipelines to transform raw data into analytics-ready datasets.
- Ensure optimal performance, reliability, and efficiency of the data pipelines.
- Integrate machine learning models into data pipelines to enhance analytics capabilities.
- Collaborate with data scientists to deploy and monitor ML models in production.
- Ensure the scalability and reliability of ML workflows and infrastructure.
- Develop and optimize ML models for predictive analytics and data-driven decision-making.
- Monitor the data infrastructure for performance bottlenecks and implement optimizations as necessary.
- Collaborate with other engineering teams to ensure seamless data integration with high availability.
What we look for...
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- 3+ years of experience as a data engineer, and 8+ years of software engineering experience (including data engineering).
- Expertise in using Amazon SageMaker for building, training, and deploying machine learning models.
- Knowledge of AWS Lambda for serverless execution of code, especially for model inference and lightweight processing tasks.
- Familiarity with AWS Glue or similar ETL tools (Extract, Transform, Load)
- Familiarity with Snowflake, RDS, Cassandra database services for structured data storage and querying. Proficiency in using Amazon S3 for data storage and retrieval, especially for large datasets used in machine learning.
- Knowledge of AWS EC2 for scalable computing resources and ECS for containerized application deployment, useful for training and deploying models. Understanding of AWS Identity and Access Management (IAM) for managing permissions and security.
- Familiarity with Amazon Kinesis for real-time data streaming and processing.
- Skills in preprocessing and transforming raw data into a format suitable for machine learning using DBT
- Experience with CI/CD tools and practices for automating the deployment and monitoring of machine learning models.
- Knowledge of AWS CloudWatch and AWS CloudTrail for monitoring model performance and logging events.
- Proficiency in using AWS CloudFormation or Terraform to manage and provision AWS resources programmatically.
- Strong programming skills in Python
- Proficiency in SQL for querying databases and manipulating structured data.
- Understanding of security best practices in AWS, including data encryption and network security.
- Knowledge of AWS cost management and optimization strategies to ensure efficient use of resources.
- Experience in developing and deploying APIs for model inference and interaction with other systems using AWS API Gateway and AWS Lambda.
Other Jobs from Kiddom
Senior Software Engineer, Frontend
Systems Engineering Manager
Staff Software Engineer, Frontend
Senior Software Engineer, Full Stack
Senior Software Engineer, Backend
Similar Jobs
Senior Data Engineer
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got about 70,000 jobs from 5,000 vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 5,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say