What you'll do:
- Collaborate closely with cross-functional teams, including data scientists, analysts, and other engineers, to ensure seamless integration of data solutions into our products and services.
- Produce quality code and documentation.
- Design, develop, and maintain scalable and efficient data pipelines to extract, transform, and load (ETL) data from diverse sources into our data platform.
- Utilize your expertise in data management to architect and implement data models that support both analytical and operational use cases.
- Work on data orchestration tasks, ensuring the smooth flow of data across various systems and components of our data ecosystem.
- Troubleshoot and optimize data pipelines for performance, reliability, and scalability.
- Contribute to the continuous improvement of our data engineering processes and tools, and actively participate in code reviews and design discussions.
- Maintain the confidentiality, integrity, and availability of our systems and processes in compliance with our internal policies on information security and privacy.
- Responsible for the development and deployment of secure code.
About you:
- Black Crow AI is looking for a bright and ambitious Software Engineer to bring a fresh perspective to our team.
- Minimum of 3 years of professional experience as a Software Engineer, with a focus on data engineering, data platforms, and/or ML platform.
- Proficiency in at least one programming language (e.g., Python, Java, Scala) commonly used in data engineering tasks.
- Demonstrated experience with all aspects of delivering working software, including analysis, design, automated testing, continuous integration, and continuous deployment.
- Proven ability to build and deploy large-scale data pipelines supporting mission-critical production use cases.
- Experience working with cloud-based data solutions, such as AWS, GCP, or Azure.
- Experience with working on ETL and pipelines.
- Hands-on experience with data management and modeling techniques, ensuring data integrity and quality.
- Familiarity with data orchestration tools and frameworks (e.g., Apache Airflow, Luigi, Prefect).
- Experience with data warehousing solutions and proficient SQL knowledge (e.g. Snowflake, Amazon Redshift, Google BigQuery)
- Excellent problem-solving skills and the ability to work in a collaborative team environment.
- Bachelor’s degree in computer science, software engineering, or any other engineering field.
- You can work Eastern time hours.
Nice to have:
- Experience with Terraform
- Experience with dbt
- Experience with open-source ETL frameworks like Singer, Meltano
- Experience with machine learning and machine learning frameworks/libraries (e.g. Apache Spark ML, Sci-kit learn, AWS SageMaker, etc)
- Experience developing, monitoring, and maintaining distributed systems & frameworks
- Expertise with AWS specifically (e.g. AWS Lambda, Kinesis, API Gateway, ECS, etc.)
16 applies
325 views
Similar Jobs
Data Architect- Manager
Senior Staff Engineer - AI ML Platform
Data Engineer- Manager
Staff Engineer - Data Reliability Engineering (REMOTE)
Senior Software Engineer - AIML Platform
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 401 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got about 70,000 jobs from 5,000 vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 5,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say