Real job — pulled straight from Carnegie Affiliates’s careers page · Verified May 24, 2026 · No reposts.
Job description
Carnegie Affiliates is hiring a Data Engineer — a full-time, based in New York, NY role. Apply directly on Carnegie Affiliates's careers page below.
DATA ENGINEER
Location: New York, NY, us
Company Description
Major Corporation
Job Description
Responsibilities:
- Design and develop high-throughput, low-latency data processing pipelines to quickly ingest and make data available on the platform across various distributed data stores
- Analyze large datasets to identify opportunities to tune and improve the system
- Experiment with various Hadoop frameworks like Hive, Pig and Scalding to identify the optimal approach for extracting valuable insights from massive datasets
Tool We Used:
- Scala
- Hadoop (Hive, Pig, Scalding, Spark)
- Kafka
- MySQL, Redis, Vertica, Aerospike
Qualifications
Requirements:
- Bachelors or Masters in Computer Science or related field
- 3+ years of experience ingesting, processing, storing and querying large datasets
- Professional Hadoop ecosystem experience, including storage optimization and job performance tuning
- Expertise in Java, Python or similar language(s). Functional programming experience is a plus
- Passion for code correctness and intuition about which values in data are to be expected in a business context
Additional Information
All your information will be kept confidential according to EEO guidelines.
Get Data Engineer jobs like this→
New roles from thousands of companies land hourly, straight from their careers pages. Get the freshest matches by email so you never miss one.
Email me new jobsSimilar jobs
Frequently asked questions
What skills are required for Data Engineer at Carnegie Affiliates?
The required skills for Data Engineer at Carnegie Affiliates include: Scala, Hadoop, Hive, Spark, Kafka, MySQL, Redis, Java, Python.
What is the seniority level for Data Engineer at Carnegie Affiliates?
Data Engineer at Carnegie Affiliates is a Mid Level level position.
How do I apply for Data Engineer at Carnegie Affiliates?
You can view the full description and apply for Data Engineer at Carnegie Affiliates on EchoJobs: https://echojobs.io/job/carnegie-affiliates-data-engineer-da527.