echojobs.io
Login

OTA Insight

Staff Engineer Web Scraping R&D

Remote
Node.js TypeScript Python R GCP Kubernetes Rust
Search for More Jobs Talk to a recruiter now 💪
Description

At Lighthouse (formerly OTA Insight), we’re on a mission to reimagine commercial strategy for the hospitality industry. Our commercial platform simplifies data, transforming complexity into confidence with actionable market insights, business intelligence, and pricing tools that maximize revenue.

We successfully raised 80 million in series B funding, we welcomed four companies to our organization and want to grow over 100 million in ARR in 2024. With more than 650 teammates illuminating the way, representing 34 nationalities living in 35 different countries of which 175 in Belgium alone, we are a fun, collaborative and committed team that works hard to achieve amazing results. Ready to take off and join this rocketship in revolutionizing the hospitality sector? 🚀

What you will do:

We are in search of a Staff Engineer Web Scraping R&D with a deep fascination for the inner workings of the internet and a desire to impart this passion to our team. You will play a critical role in our data extraction process, ensuring that we can extract and process billions of data points every day.

Where you will have impact:

  • Drive the research and development of advanced techniques for web data extraction and processing at scale, a task made more challenging due to the high volume of our operations. You will build upon our ongoing projects, leveraging your expertise in reverse engineering and browser technologies to push the boundaries of our capabilities.
  • Be at the forefront of tackling web scraping challenges such as emulating user agents, scraping on multiple platforms, utilizing proxy services in a cost-efficient manner, scraping from specific locations, and effectively distributing our scraping load.
  • Actively collaborate with diverse engineering teams to address challenges and advance initiatives related to data extraction and infrastructure.
  • Serve as a subject matter expert, providing mentorship and support to team members while fostering an environment of continuous learning and development.

About our team:

Our team is at the helm of our sophisticated data extraction infrastructure. Tasked with the responsibility of acquiring pricing data from over 200 unique data sources, we process nearly 200 million requests each day. The data we collect is the lifeblood of our products. We are committed to ensuring its reliable and timely delivery, thereby powering our diverse product portfolio.

Who you are:

  • Master’s or Bachelor’s degree in a STEM field
  • 5+ years experience in at least one of the following:
  • Networking protocols
  • Browser development
  • Reverse engineering websites and/or mobile applications
  • Strong problem-solving and analytical skills, with the ability to identify and troubleshoot complex technical issues
  • Excellent communication and collaboration skills, with the ability to work effectively in a team environment
  • Fluent in English

Technologies you’ll work with:

Google Cloud, Kubernetes, Rust, NodeJS, TypeScript, Scrapy, Python, Prometheus, Grafana 

 (feel free to ask us why these are the best fit for us)

What’s in it for you:

  • Flexible working environment: Work from home or at one of our global offices.
  • Flexible time off: Autonomy to manage your work-life balance.
  • Collaborative team: High-bar, friendly, creative, and passionate colleagues.
  • Career development: Workshops, frameworks, tools, training, and processes to realize your full potential.
  • Impactful work: Shape products relied on by 85,000+ users worldwide.
  • Competitive compensation: Proactively maintained to value your work.
  • Referral bonuses: Earn rewards for bringing in new talent.

Thank you for considering a career with Lighthouse. We are committed to fostering a diverse and inclusive workplace that values equal opportunity for all. We welcome candidates from all backgrounds, regardless of age, gender, race, religion, sexual orientation, and disability. Our commitment to equality is not just a policy; it's part of our culture.

If you share our passion for innovation and teamwork, we invite you to join us in shaping the future of the hospitality industry. At Lighthouse, our guiding light is to be an equal opportunity employer, and we encourage individuals from all walks of life to apply.

We value the unique perspective and talents that you bring, and we're excited to see how your light can shine within our team. We can't wait to meet you and explore how we can grow and succeed together, illuminating the path towards a brighter future for the industry.

OTA Insight
OTA Insight
Analytics Business Intelligence Hospitality Hotel Information Technology SaaS Software

0 applies

4 views

Other Jobs from OTA Insight

Customer Operations Data Analyst

Kuala Lumpur, Malaysia

Similar Jobs

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 389 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

To try it out

For active job seekers

For those who are passive looking

Cancel anytime

Frequently Asked Questions

  • We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
  • Salaries for the engineering jobs on our site range from $100K-$200K. On average, senior engineer positions on our EchoJobs are about $160K.
  • The EchoJobs positions have been sourced and vetted from the top companies to work for in the US as a software engineer, including LinkedIn and other reputable job sites. We also have syndicated jobs from companies that have just raised funding, as well as those that have great unique products and culture. From all of these sources, our founder, Morgan, has also resourced the company's authenticity in terms of their website, public appearance, and more.
  • Yes, our users asked us for just this, so now our search filters allow you to search for your top jobs via location, as well as by onsite, remote, or both. Approximately 30% of our jobs are remote, so you’ve got the best options for you!
  • We have not yet implemented this option, but are considering doing so in the future. For the moment, you would need to cancel your subscription, and resubscribe when you wanted to come back.
  • We add new jobs to EchoJobs every day! We scan our sources for the newest jobs, verify them, and post them to EchoJobs within minutes. We add about 2,000-3,000 new jobs for you each day!
  • From starting your job search to getting hired, the entire job search process can take us software engineers anywhere between 3-6 months. However, at EchoJobs, we’re striving to shorten this duration by finding the best, newest jobs for you, so you can do less job searching, and more applying.
  • We’d recommend checking EchoJobs daily, as we add new jobs to the site each day. Additionally, if you got a chance to read our previous email on “what makes EchoJobs different from any other job search tools,” we also recommended that you set a job alert based on your job filters, so if you get emails on those new jobs, you could be checking more than once per day.
  • If you decide to continue with us after the 1-month trial, we definitely recommend this, as we all know it usually takes 3-6 months to find a quality job as a software engineer these days. So to best support you, we just adjusted our membership options at EchoJobs to monthly, 3 months, or 12 months (this option is more for passive job seekers looking a little bit for the future if they want to come back to work or make a job switch potentially. This lets you see what’s out there in case an even better fit job becomes available.)
  • EchoJobs is truly the only job site of its kind. We want to be THE spot for you to find the best job for you, and haven’t encountered any other company doing this. Other job sites are in niches besides software engineering or focus on a small portion of engineering jobs (like a specific coding language). In the words of Morgan, our founder, “I think what makes EchoJobs different is the amount of jobs, frequency that we add new jobs (we add 2,000-3,000 new jobs daily!), and the powerful search engines to find exactly the job you want more easily and efficiently. We can provide you with the most jobs that are vetted by us, we’ll continually find more new jobs for you, and we make it easier for you to apply and get hired.

What Fellow Engineers Say