Big Data Engineer Consultant I

At Allstate, great things happen when our people work together to protect families and their belongings from life’s uncertainties. And for more than 90 years our innovative drive has kept us a step ahead of our customers’ evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing sophistication, telematics, and, more recently, device and identity protection. 

Job Description

As a Big Data Engineer, you will be responsible for the design, implementation, Security and on- going support of Scality data storage. You will partner with Data Scientists as well as product stakeholders to create an advanced analytics eco-system.

• Obtain an overall understanding of data and processes
• Partner with the Product Owner on requirements and brainstorm implementation options
• Participate in planning session to determine technical designs and estimates
• Develop and deliver solutions using Big Data/Spark tools and technologies
• Collaborate effectively with other teams (internal and external) in a very dynamic agile environment
• Learn new tools and implement continuous improvements in support of the Product’s strategic vision

Key Responsibilities

• Partners closely with team members on Big Data solutions for our data science community and analytic users

• Partners with 360F teams on Big Data efforts

• Executes moderately complex functional work tracks for the team

• Contributes to the development of moderately complex prototypes and department applications that integrate big data and advanced analytics to make business decisions

• Develops innovative solutions to Big Data issues and challenges within the team

• Contributes to the development of moderately complex technical solutions using Big Data techniques in data & analytics processes

• Leverages and uses Big Data best practices / lessons learned to develop technical solutions

• Understands the Big Data related problems and requirements to identify the correct technical approach

• Uses new areas of Big Data technologies, (ingestion, processing, distribution) and research delivery methods that can solve business problems

Key Skills

Experience in Spark, Scala, Python, SQL, Unix, Kubernetes, Airflow. Preferable if experience in PowerBI and MS Fabric. Additionally, need to support oncall jobs during India day time on rotation basis.

Education

• 4 year Bachelors Degree (Preferred)

Experience

• 2 or more years of experience (Preferred)

Supervisory Responsibilities

• This job does not have supervisory duties.

Education & Experience (in lieu)

• In lieu of the above education requirements, an equivalent combination of education and experience may be considered.

Primary Skills

Big Data Engineering, Big Data Systems, Big Data Technologies, Data Science, Influencing Others

Shift Time

Shift B (India)

Recruiter Info

Annapurna Jha

ajhat@allstate.com

About Allstate

Joining our team isn’t just a job — it’s an opportunity. One that takes your skills and pushes them to the next level. One that encourages you to challenge the status quo. And one where you can impact the future for the greater good.  

You’ll do all this in a flexible environment that embraces connection and belonging. And with the recognition of several inclusivity and diversity awards, we’ve proven that Allstate empowers everyone to lead, drive change and give back where they work and live. 

Good Hands. Greater Together.

The Allstate Corporation is one of the largest publicly held insurance providers in the United States. Ranked No. 84 in the 2023 Fortune 500 list of the largest United States corporations by total revenue, The Allstate Corporation owns and operates 18 companies in the United States, Canada, Northern Ireland, and India. Allstate India Private Limited, also known as Allstate India, is a subsidiary of The Allstate Corporation. The India talent center was set up in 2012 and operates under the corporation's Good Hands promise. As it innovates operations and technology, Allstate India has evolved beyond its technology functions to be the critical strategic business services arm of the corporation. With offices in Bengaluru and Pune, the company offers expertise to the parent organization’s business areas including technology and innovation, accounting and imaging services, policy administration, transformation solution design and support services, transformation of property liability service design, global operations and integration, and training and transition.

Learn more about Allstate India here.