Software Engineer - Python Developer

FactSet’s Data Solutions Engineering (DSE) group is looking for a Software Engineer to join a growing team responsible for building and maintaining our next-generation client-facing data and API platforms. Using a variety of technologies to deliver performant solutions, this team will play a significant role in FactSet’s Digital Transformation by empowering our sophisticated user base that includes quantitative analysts, data scientists, and application developers.

At a high level, the candidate must be a hands-on data engineer & AWS cloud expert with the ability to lead projects, work directly with clients to understand their requirements, and design and develop comprehensive data solutions. Strong communication skills and the ability to collaborate effectively with diverse teams are essential.

Data Pipeline Development: Design, implement, and manage robust data pipelines using Python, PySpark, and SQL to efficiently extract, transform, and load data from diverse sources (batch and streaming).
AWS Expertise: Demonstrate expertise in core AWS services such as AWS DMS, AWS Glue, AWS Step Functions, Amazon S3, Amazon Redshift, Amazon RDS, Amazon EMR, AWS IAM, and AWS Lambda to build scalable and reliable data solutions, also important for Terraform.
Cloud Infrastructure: Design, deploy, and manage AWS cloud infrastructure using tools like AWS CloudFormation and Terraform, ensuring high availability, scalability, and security. Apply best practices in infrastructure as code (IaC) to automate the deployment and scaling of data pipelines.
Data Modeling: Develop and maintain efficient data models to support analytical and reporting needs, ensuring data is structured to optimize performance and accessibility.

Job Requirement:

• Bachelor's in Computer Science, Engineering or equivalent

• 3-5  years of Software development experience

• Experience working with Python

• Experience in automating CI/CD

• Experience with unit test frameworks

• Experience in AWS cloud

• Experience in Snowflake

• Experience working with any relational database

• Experience working in Linux environments

• Experience working with Cloud infrastructure (AWS, Azure etc.)

• Experience working with Snowflake or related technologies

• Experience building and maintaining distributed systems

• Motivated self-starter with creative thinking

• Strong desire to learn

• Attention to detail along with the ability to see the big picture

• Self-disciplined and motivated work ethic

Job Responsibilities:

• Design, develop, and maintain highly scalable data pipelines/workflows and APIs

• Writing, debugging, and profiling multithreaded systems

• Develop new infrastructure to enhance the capabilities of our market/real-time data delivery

• Ensure reliability and scalability of various critical systems.

• Active participation in our Agile/Scrum team.

• Collaborate with stakeholders to develop specifications and features.

Nice to have:
Database Management: Administer databases using AWS services like Amazon RDS or Amazon Redshift, with a focus on schema design, performance optimization, and monitoring to ensure high performance and reliability.
Data Warehousing: Utilize Amazon Redshift or Snowflake to create high-performing analytical databases that empower data-driven decision-making across the organization.
ETL Best Practices: Implement industry best practices for ETL processes, including data validation, error handling, and data quality checks, ensuring data integrity and consistency.
Performance Optimization: Continuously optimize query performance through tuning and leveraging AWS's scalability capabilities to meet the demands of large-scale data processing.
Monitoring and Logging: Establish robust monitoring and logging mechanisms using AWS CloudWatch, Amazon CloudTrail, or comparable tools to ensure pipeline reliability and detect issues proactively.