Senior Data Engineer
Location: Mexico City, Mexico City, Mexico
Workplace: hybrid
Employment Type: full
Description
About Arkham
Arkham is a Data & AI Platform—a suite of powerful tools designed to help you unify your data and use the best Machine Learning and Generative AI models to solve your most complex operational challenges.
Today, industry leaders like Circle K, Mexico Infrastructure Partners, and Televisa Editorial rely on our platform to simplify access to data and insights, automate complex processes, and optimize operations. With our platform and implementation service, our customers save time, reduce costs, and build a strong foundation for lasting Data and AI transformation.
About the Role
We are looking for a Senior Data Engineer to own our high-performance Data Platform based on the Lakehouse architecture. In this role, you will work with cutting-edge technologies such as Apache Spark, Trino, and Delta Lake, ensuring data governance and interoperability across platforms. You'll play a key role in shaping our data infrastructure, working across the entire data lifecycle—from ingestion to transformation and activation.
Requirements
Key Responsibilities
- Lead the next phase of our Data Platform – Develop and enhance Arkham’s Data Platform, following Lakehouse architecture principles and ensuring data governance.
- Data Ingestion Pipelines – Design and implement pipelines to extract data from structured, semi-structured, and unstructured sources.
- Data Pipeline Orchestration – Create, monitor, and optimize multiple data extraction and transformation pipelines.
- Data Catalog Integration – Ensure interoperability between data catalogs and various query engines.
- Cluster Management & Observability – Oversee cluster performance and implement observability solutions to maintain optimal execution of data pipelines.
End-to-End Data Lifecycle Management – Maintain high data quality and usability across integration, transformation, and activation stages.
Qualifications
- Experience: 5+ years in data engineering, data architecture, or a related field.
- Technical Expertise: Proficiency in Apache Spark, Delta Lake, and Trino.
- Programming Skills: Strong experience with Python for scripting and automation.
- Cloud Knowledge: Hands-on experience with AWS services, including Glue, S3, and EMR.
- Big Data: Understanding of distributed data systems and query engines.
Problem-Solving: Excellent analytical and debugging skills.
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say