Lead Software Engineer – Big Data
We are looking for lead or principal software engineers to join our Data Cloud team. Our Data Cloud team is
responsible for the Zeta Identity Graph platform, which captures billions of behavioural, demographic,
environmental, and transactional signals, for people-based marketing. As part of this team, the data engineer will be
designing and growing our existing data infrastructure to democratize data access, enable complex data analyses,
and automate optimization workflows for business and marketing operations.
Job Description:
Essential Responsibilities:
As a Lead or Principal Data Engineer, your responsibilities will include:
• Building, refining, tuning, and maintaining our real-time and batch data infrastructure
• Daily use technologies such as HDFS, Spark, Snowflake, Hive, HBase, Scylla, Django, FastAPI, etc.
• Maintaining data quality and accuracy across production data systems
• Working with Data Engineers to optimize data models and workflows
• Working with Data Analysts to develop ETL processes for analysis and reporting
• Working with Product Managers to design and build data products
• Working with our DevOps team to scale and optimize our data infrastructure
• Participate in architecture discussions, influence the road map, take ownership and responsibility over new
projects
• Participating in 24/7 on-call rotation (be available by phone or email in case something goes wrong)
Desired Characteristics:
• Minimum 7 years of software engineering experience.
• Proven long term experience and enthusiasm for distributed data processing at scale, eagerness to learn
new things.
• Expertise in designing and architecting distributed low latency and scalable solutions in either cloud and onpremises environment.
• Exposure to the whole software development lifecycle from inception to production and monitoring
• Fluency in Python or solid experience in Scala, Java
• Proficient with relational databases and Advanced SQL
• Expert in usage of services like Spark, HDFS, Hive, HBase
• Experience in adequate usage of any scheduler such as Apache Airflow, Apache Luigi, Chronos etc.
• Experience in adequate usage of cloud services (AWS) at scale
• Experience in agile software development processes
• Excellent interpersonal and communication skills
Nice to have:
• Experience with large scale / multi-tenant distributed systems
• Experience with columnar / NoSQL databases – Vertica, Snowflake, HBase, Scylla, Couchbase
• Experience in real team streaming frameworks – Flink, Storm
• Experience with web frameworks such as Flask, Django
Company Summary
Zeta Global is a data-powered marketing technology company with a heritage of innovation and industry leadership.
Founded in 2007 by entrepreneur David A. Steinberg and John Sculley, former CEO of Apple Inc and Pepsi-Cola, the
Company combines the industry’s 3rd largest proprietary data set (2.4B+ identities) with Artificial Intelligence to
unlock consumer intent, personalize experiences and help our clients drive business growth.
Our technology runs on the Zeta Marketing Platform, which powers ‘end to end’ marketing programs for some of the
world’s leading brands. With expertise encompassing all digital marketing channels – Email, Display, Social, Search
and Mobile – Zeta orchestrates acquisition and engagement programs that deliver results that are scalable,
repeatable and sustainable.
Zeta Global is an Equal Opportunity/Affirmative Action employer and does not discriminate on the basis of race,
gender, ancestry, color, religion, sex, age, marital status, sexual orientation, gender identity, national origin, medical
condition, disability, veterans status, or any other basis protected by law.
Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with
arrest and conviction records.
Zeta Global Recognized in Enterprise Marketing Software and Cross-Channel Campaign Management Reports by
Independent Research Firm
Other Jobs from Zeta Global
Data Analyst
Senior UI Developer, Data Cloud Applications
Senior Manager, Data Cloud Applications
Staff Software Engineer
Cloud Security Engineer
Staff Software Engineer
Similar Jobs
Staff Full Stack Engineer
Lead Software Engineer
Senior Software Engineer - Big Data
Staff Full Stack Engineer
Principal Software Engineer
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 401 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got about 70,000 jobs from 5,000 vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 5,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say