Senior Data Engineer II

• LexisNexis USA
• Sr. Data Engineer II 
• 33 West Monroe Street, Chicago IL 60603

JOB DESCRIPTION:

• Ensure the collection, processing and accuracy of linkages from multiple entity sets together. Leverage the latest in AWS technologies to build a linking collection system. Build and maintain a large-scale data pipeline using the AWS cloud platform with graph, relational and non-relational databases all build with auto-scaling to meet demand needs. Build and maintain a data pipeline to identify common entities and manage the mappings. Build APIs to surface the mappings to other downstream systems. Build metrics to show the current state and status of the system. Develop innovative strategies and processes for ingesting, transforming, managing and fixing data in bulk. Handle changing priorities for fixing and loading data from various data owners. Manage and monitor various data feeds through the system and handle issues as they arise. Write queries, functions, and ETL jobs. Monitor progress and completion of all jobs and take corrective action as needed. Consult on feature design, implementation and relevant metrics like reliability, queue length, and cost. Perform capacity monitoring and short and long-term capacity planning. Perform other duties as needed.

REQUIREMENTS:

• Master’s degree or foreign equivalent in Computer Science, Computer Engineering, Information Systems, or a related field required.
• 3 years of experience in job offered or related occupations required.

• Also required is: 3 years of experience: utilizing AWS, including AWS VPC and related AWS networking, AWS Athena, AWS QuikSight, AWS IAM Single Sign-On, AWS Lambda, AWS Glue, AWS Cloudformation, and Terraform; utilizing SQL databases; using development tools and services such as Git, Jira, and associated agile processes; using Hadoop or Spark, and performing ETL with a variety of sources and destinations including RDMS and HDFS; utilizing tools such as Apache Hive, Apache Impala, Cloudera, and Sqoop; and programming with Python and shell scripting.
• Employee reports to LexisNexis USA office in Chicago, IL, but may telecommute from any location within the U.S.
• Experience can be concurrent.

SALARY RANGE:

• $130,800 to $163,500/year

#LI-DNI

#IND-DNS

#ICT

LexisNexis, a division of RELX, is an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law. We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form: https://forms.office.com/r/eVgFxjLmAK , or please contact 1-855-833-5120.

Please read our Candidate Privacy Policy.