Senior Data Engineer
Location: San Francisco, CA, us
Company Description
Punch is a full service digital agency based out of New York, Silicon Valley, LA, Boston, Stockholm and Phuket, Thailand. Here at Punch, we take pride in tackling our clients’ most challenging tasks. Founded by a group of former Google Engineers and now with over 75 staff, Punch is now leading the way in creating new cutting-edge technology.
We are building a more technical world.Go ahead and check out some of our work here: www.punch-agency.com
Job Description
We are seeking an extremely talented senior/lead data engineer to design & implement highly reliable & scalable Audience Management Big Data Platform (500+ Terabytes).
Responsibilities:
- Build, enhance and scale our existing Big Data Platform to process 500+ Terabytes of data from various 3rd party providers.
- Technically own the complete data pipeline module including data ingestion, validation, transformation & storage in the data platform.
- Design and write clean, robust, server-side code using Spark & Scala.
- Perform R & D to evaluate new technologies, generate different ideas & patentable IP to communicate value for company
- Work closely with team members & mentor them technically
- Partner with product managers to support product roadmap & business needs
Required Skills:
- 10 - 15 years experience in software development primarily in Big Data domain using Spark & Hadoop eco system.
- 5+ Years of experience in Spark & Scala (Skill Level: 8 or more out of 10)
- Bachelors degree in Computer Science or equivalent.
- 5+ years experience designing, building and launching extremely efficient & reliable data pipelines to move data (both large and small amounts) using modern data architecture/tools.
- Strong background (5+ years) in ETL processing for large amount of data (250+ Terabytes)
- Multiple years of experience working with 250+ Terabytes of data for ETL using Spark & Scala
- 3+ years experience working in Agile environment (SCRUM)
Nice To Have Skills:
- Experience in digital marketing (Good Domain knowledge on digital marketing Industry)
- Experience working with AWS (S3, EMR, EC2, RDS)
Job Type: Full-time
Required education:
- Bachelor's
Required experience:
- designing, building: 5 years
Job Type: Full-time
Required education:
- Bachelor's
Required experience:
- designing, building: 5 years
Qualifications
Required Skills:
- 10 - 15 years experience in software development primarily in Big Data domain using Spark & Hadoop eco system.
- 5+ Years of experience in Spark & Scala (Skill Level: 8 or more out of 10)
- Bachelors degree in Computer Science or equivalent.
- 5+ years experience designing, building and launching extremely efficient & reliable data pipelines to move data (both large and small amounts) using modern data architecture/tools.
- Strong background (5+ years) in ETL processing for large amount of data (250+ Terabytes)
- Multiple years of experience working with 250+ Terabytes of data for ETL using Spark & Scala
- 3+ years experience working in Agile environment (SCRUM)
Nice To Have Skills:
- Experience in digital marketing (Good Domain knowledge on digital marketing Industry)
- Experience working with AWS (S3, EMR, EC2, RDS)
Additional Information
We are a team of former Google Engineers and Designers based in Silicon Valley, New York and Phuket, Thailand.
All of our core engineers are paid in the $150,000 range or greater and we also provide our engineers the opportunity to work, all expenses paid, from our Phuket, Thailand office one month a year as a creative outlet to work and enjoy life to the fullest.
In this role you will work with some of the most exciting projects in the industry today with a team of fast moving engineers and designers who have a passion for building disruptive products.
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say