We’re on a mission to make Algolia a data-driven organization, and we’re looking for a Senior Data Engineer to join our Data team and help us get there.
Important: This position is only open to candidates located in France, the UK, Romania, and the US, even for full-remote roles. Applications from other locations will not be considered.
Note: A minimum of 4 years of experience as a Data Engineer is required. Experience with Python, Airflow, and Spark is mandatory.
Our Data team aims at helping other teams make better decisions by providing relevant data while ensuring its integrity and consistency. This team has a significant impact as we work closely with business analysts on our Operations, Marketing, Product, and Infrastructure teams to help them discover meaningful trends.
Our data team is composed of a Data Engineering team (building pipelines and scaling the Lake & Warehouse), an Analytics Engineering team (building standardized data models), and Data Analysts.
As a member of the Data Engineering team, your daily responsibilities will include:
- Developing data pipelines and ETL workflows mainly with Python, Airflow (AWS MWAA), Spark (AWS Glue, EMR), and other AWS services managed with Terraform.
- Improving and maintaining our data warehouse (AWS Redshift).
- Supporting the Analytics Engineering team to build data models with dbt to be used by Analysts on business reports.
- Interacting with Engineering and Business teams to understand requirements.
We maintain an open-minded approach and eagerly embrace experimentation with new technologies to achieve our goals, and we try to continuously challenge our choices on that topic. You will have the opportunity to make some decisions going in that direction.
As a senior joining the team, your goal will also be to mentor junior engineers and help them grow to be successful at Algolia.
With Algolia’s rapid growth, there will be many data-related challenges that will need to be tackled! Are you ready for the challenge?
Key responsibilities:
- Design, build, enrich, and scale up our data pipelines.
- Work with engineers, data analysts, and business analysts to capture and model data.
- Monitor data integrity and growth.
- Help improve our data lake and data warehouse architecture to increase performance, simplicity, and autonomy of the users.
- Help analysts industrialize reports and dashboards to improve company productivity.
- Ensure every product is released with a data-driven approach.
You might be a good fit if you have:
- Strong experience designing and building data pipelines.
- Experience orchestrating pipelines with Airflow.
- Professional knowledge of Python.
- Strong experience working with cloud platforms and architecting them.
- Strong experience with data warehouses.
- Experience with infrastructure topics specific to data engineering.
- Interest in Big Data challenges (~600Tb of data, +14Tb per week, ~700M files, +1.2M per week, ~300 dbt models, ~70 Airflow DAGs).
- Interest in understanding the data and business requirements.
- Excellent spoken and written English skills.
- A humble, curious, proactive mindset, and a balance between creativity, resourcefulness, and pragmatism.
Nice to have:
- Experience using and managing AWS Redshift.
- Experience with a parallel data processing framework such as Apache Spark.
- Experience analyzing data quality using dbt.
- Experience at our current stage and beyond ($50-200M ARR range, high growth, lots of change, and building internal infrastructure).
REMOTE STRATEGY:
Algolia’s flexible workplace model is designed to empower all Algolians to fulfill our mission to power search and discovery with ease. We place an emphasis on an individual’s impact, contribution, and output, over their physical location. Algolia is a high-trust environment and our team members have the autonomy to choose where they want to work and when. We know community comes in many forms and strive to create opportunities for intentional in-person connection in our offices and virtually for our remote colleagues around the world.
We have a global presence with physical offices in San Francisco, NYC, Paris, London, Sydney and Bucharest.
ABOUT US:
Algolia prides itself on being a pioneer and market leader offering an AI Search solution that empowers 17,000+ businesses to compose customer experiences at internet scale that predict what their users want with blazing fast search and web browse experience. Algolia powers more than 30 billion search requests a week – four times more than Microsoft Bing, Yahoo, Baidu, Yandex and DuckDuckGo combined.
Algolia is part of a cadre of innovative new companies that are driving the next generation of software development, creating APIs that make developers’ lives easier; solutions that are better than building from scratch and better than having to tweak monolithic SaaS solutions.
In 2021, the company closed $150 million in series D funding and quadrupled its post-money valuation of $2.25 billion. Being well capitalized enables Algolia to continue to invest in its market leading platform, to better serve its thousands of customers–including Under Armor, Petsmart, Stripe, Gymshark, and Walgreens, to name just a few.
WHO WE'RE LOOKING FOR:
We’re looking for talented, passionate people to build the world’s best search & discovery technology. As an ownership-driven company, we seek team members who thrive within an environment based on autonomy and diversity. We're committed to building an inclusive and diverse workplace. We care about each other and the world around us, and embrace talented people regardless of their race, age, ancestry, religion, sex, gender identity, sexual orientation, marital status, color, veteran status, disability and socioeconomic background.
READY TO APPLY?
If you share our values and our enthusiasm for building the world’s best search & discovery technology, we’d love to review your application!
Other Jobs from Algolia
Software Engineer, Backend (Go)
Senior Security Engineer
Architect, Analytics Engineering
Junior Developer Support Engineer
Senior Software Engineer - Search Infrastructure
Manager, Site Reliability Engineering
Similar Jobs
Data Engineer, AWS Fintech
Data Engineer II, AWS Fintech
Data Engineer I, AWS Fintech
Lead Data Scientist
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 389 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- Salaries for the engineering jobs on our site range from $100K-$200K. On average, senior engineer positions on our EchoJobs are about $160K.
- The EchoJobs positions have been sourced and vetted from the top companies to work for in the US as a software engineer, including LinkedIn and other reputable job sites. We also have syndicated jobs from companies that have just raised funding, as well as those that have great unique products and culture. From all of these sources, our founder, Morgan, has also resourced the company's authenticity in terms of their website, public appearance, and more.
- Yes, our users asked us for just this, so now our search filters allow you to search for your top jobs via location, as well as by onsite, remote, or both. Approximately 30% of our jobs are remote, so you’ve got the best options for you!
- We have not yet implemented this option, but are considering doing so in the future. For the moment, you would need to cancel your subscription, and resubscribe when you wanted to come back.
- We add new jobs to EchoJobs every day! We scan our sources for the newest jobs, verify them, and post them to EchoJobs within minutes. We add about 2,000-3,000 new jobs for you each day!
- From starting your job search to getting hired, the entire job search process can take us software engineers anywhere between 3-6 months. However, at EchoJobs, we’re striving to shorten this duration by finding the best, newest jobs for you, so you can do less job searching, and more applying.
- We’d recommend checking EchoJobs daily, as we add new jobs to the site each day. Additionally, if you got a chance to read our previous email on “what makes EchoJobs different from any other job search tools,” we also recommended that you set a job alert based on your job filters, so if you get emails on those new jobs, you could be checking more than once per day.
- If you decide to continue with us after the 1-month trial, we definitely recommend this, as we all know it usually takes 3-6 months to find a quality job as a software engineer these days. So to best support you, we just adjusted our membership options at EchoJobs to monthly, 3 months, or 12 months (this option is more for passive job seekers looking a little bit for the future if they want to come back to work or make a job switch potentially. This lets you see what’s out there in case an even better fit job becomes available.)
- EchoJobs is truly the only job site of its kind. We want to be THE spot for you to find the best job for you, and haven’t encountered any other company doing this. Other job sites are in niches besides software engineering or focus on a small portion of engineering jobs (like a specific coding language). In the words of Morgan, our founder, “I think what makes EchoJobs different is the amount of jobs, frequency that we add new jobs (we add 2,000-3,000 new jobs daily!), and the powerful search engines to find exactly the job you want more easily and efficiently. We can provide you with the most jobs that are vetted by us, we’ll continually find more new jobs for you, and we make it easier for you to apply and get hired.
What Fellow Engineers Say