Big Data Hadoop
Location: Atlanta, GA, us
Company Description
Arete Technologies, Inc. offers set of innovative Consulting and Outsourcing services, bridging the gap between requirements and outputs of various dexterous and facile companies worldwide. The thrust of providing global deliverables with focus on providing paramount and unsurpassed services combined with cost saving solutions to the clients
We understand the business requirements in the present day corporate scenario and aspire to provide world-class services enabling the organization to burgeon and flourish while keeping the work-life balance intact. The Global delivery mechanism followed at Arete Technologies, Inc. saddles proficient schemas and unconventional channels to provide one-stop solutions for all your workforce needs.
our Team is an exquisite amalgamation of vast experiences of over 30 years in IT Consulting and Staffing industry. Connoisseurs in the field of staff augmentation for IT, we operate on 24 by 7 model with an aim of providing affordable and adept professionals with an assurance of satisfaction for both Consultants and Clients.
We are pre-eminent service providers in the field of staff augmentation, IT Consultancy, Software development, Web Development providing unexcelled services and focusing on both the employers and employees.
Job Description
Job Details
Apache NiFi, Kafka, Flume, Sqoop, Apache Atlas, Hive, HDFS, HBase and Spark (Hortonworks HDP and HDF preferred).
§ Lead Big Data engineering team with specialization on data ingestion (from 100+ source systems in batch and near real-time), egestion and governance.
§ Participate in collaborative software and system design and development of the new NCR Data Lake on Hortonworks HDP and HDF distributions.
§ Manage own learning and contribute to technical skill building of the team.
§ Inspire and cultivate the engineering mindset and systems thinking.
§ Gain deep technical expertise in the data movement patterns, practices and tools.
§ Play active role in Big Data Communities of Practice.
§ Put the minimal system needed into production.
Required Qualifications
§ Bachelor’s degree or higher in Computer Science or a related field.
§ Good understanding of distributed computing and big data architectures.
§ Passion for software engineering and craftsman-like coding prowess.
§ Proven experience in developing Big Data solutions in Hadoop Ecosystem using Apache NiFi, Kafka, Flume, Sqoop, Apache Atlas, Hive, HDFS, HBase and Spark (Hortonworks HDP and HDF preferred).
§ Experience with at least one of the leading CDC (Change Data Capture) tools like Informatica PowerCenter.
§ Development experience with at least one NoSQL database. HBase or Cassandra preferred.
§ Polyglot development (4-5 years+): Capable of developing in Java and Scala with good understanding of functional programming, SOLID principles and, concurrency models and modularization.
§ DevOps: Appreciates the CI and CD model and always builds to ease consumption and monitoring of the system. Experience with Maven (or Gradle or SBT) and Git preferred.
§ Experience in Agile development including Scrum and other lean techniques.
§ Should believe in You Build! You Ship! And You Run! Philosophy.
§ Personal qualities such as creativity, tenacity, curiosity, and passion for deep technical excellence.
Desired Qualifications
§ Experience with Big Data migrations/transformations programs in the Data Warehousing and/or Business Intelligence areas.
§ Experience with ETL tools like Talend, Pentaho, Attunity etc.
§ Knowledge of Teradata, Netezza etc.
§ Good grounding in NoSQL data stores such as Cassandra, Neo4j etc.
§ Strong knowledge on computer algorithms.
§ Experience with workload orchestration and automation tools like Oozie, Control-M etc.
§ Experience in building self-contained applications using Docker, Vagrant. Chef.
Additional Information
All your information will be kept confidential according to EEO guidelines.
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say