Big Data Architect
Location: Boston, MA, us
Company Description
Ideavat provides I.T staffing solutions, enabling companies & jobseekers engage successfully.
With over 20 man years of contingent staffing experience, the management & execution team is committed to provide customized staffing solutions to employers/hiring managers, helping them identify key talents. Emergent technology staffing (UI/UX developers & designers, Mobility & Cloud Engineers, Big Data/Hadoop developers & architects…& more) remains our primary focus!
Job Description
The emergence of big data is creating opportunities to develop data platforms that turn big data into big insights with tremendous value. This role is critical in enabling these capabilities and providing business partners with the tools to make their decision making process more efficient and with greater speed. This role will develop long-term technology and data strategies and shorter-term development and delivery plans to enable customers to Insight. The candidate must be extremely results driven, customer focused, technologically savvy, and skilled at working in an agile development environment.
Key Responsibilities:
- Develop the architecture for our Big Data & Analytics Platform to optimize the ingestion and management of varied sources of high volume data
- Define analytic architecture that leverages the Big Data Platform to enable advanced analysis capabilities
- Participate in the end to end delivery of business use-cases including data architecture to deliver results
- Design and build efficient yet cost-effective Big Data applications to help business partners answer their business questions
- Deliver as part of an agile team the ongoing platform architecture, build and maintenance
- Architect the data security, compliance and privacy methodology
- Provide leadership to data management and governance methodologies for the team
- Evaluate and present proposed architectures to enable platform with highest level of performance, garner leadership support and enable implementation
- Stay up to date on the relevant technologies, plug into user groups, understand trends and opportunities
Required Demonstrable Skills:
- Deep expertise is working with data – all kinds, clean, dirty, unstructured, semi-structured
- Have hands-on experience with Cloudera Hadoop Administration (e.g. configuration management, monitoring, debugging, and performance tuning)
- Strong experience with large cloud-compute infrastructure solutions such as Amazon Web Services, Google, Azure
- Experience managing the full lifecycle of a Hadoop Solution
- Experience creating the requirements analysis, the platform selection, design of the technical architecture, design of the application design and development, testing, and deployment of the proposed solution
- Experience with the major big data solutions like Hadoop, MapReduce, Hive, HBASE, MongoDB, Cassandra, Spark, Impala, Oozie, Mahout, Flume, ZooKeeper, Sqoop, etc.
- Firm understanding of major programming/scripting languages like Java, Python, R, etc.
- Extensive knowledge of UNIX/Linux
- Strong knowledge of SQL
- Experience in working with ETL tools such as Informatica, Talend and/or Pentaho.
- Experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS and/or knowledge on NoSQL platforms
- Experience in Hadoop Platform Security and Hadoop Data Governance topics
- Experience in technical computing (optimization, statistics and machine learning)
- Experience with analytics visualization software such as Tableau
Qualifications
- Minimum of BS in Computer Science or similar field
- Must have at least 8-10 years’ experience in information management and application development
Qualifications
Cloudera Hadoop Administration,cloud,AWS,Hadoop, MapReduce, Hive, HBASE, MongoDB, Cassandra, Spark
Additional Information
All your information will be kept confidential according to EEO guidelines.
There are more than 50,000 engineering jobs:
Subscribe to membership and unlock all jobs
Engineering Jobs
60,000+ jobs from 4,500+ well-funded companies
Updated Daily
New jobs are added every day as companies post them
Refined Search
Use filters like skill, location, etc to narrow results
Become a member
🥳🥳🥳 452 happy customers and counting...
Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.
To try it out
For active job seekers
For those who are passive looking
Cancel anytime
Frequently Asked Questions
- We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
- We've got over 200,000 jobs from 15,000+ vetted companies. No fake or sleazy jobs here!
- We aggregate jobs from 15,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
- We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
- Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
- Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
- Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅
What Fellow Engineers Say