Software Engineer (Developer, OpenSearch)

Location: Chantilly, VA

BT-391 - Software Engineer (Developer, OpenSearch)
Location: Chantilly, VA (fully on-site, no remote option)

• Work with a team to write new cloud-based applications and tools and recommend new technologies and methodologies to improve system performance and usability.
• Design, develop, test, debug, and deploy new software tools that extend or replace existing capabilities to parse raw data for analysis.
• Collaborate cross-functionally with data scientists, analysts, project managers and other engineers and technical SMEs.
• Deploy new software into an AWS-based data ingest pipeline.
• Write software that interacts with multiple data types and stores data into S3 buckets that is queried by processes running Athena or OpenSearch.
• As an OpenSearch expert, drive the design of indexing strategies, query optimizations, and maintain overall architectural ownership of the OpenSearch data layer.
• Troubleshoot complex problems and provide support to mission areas for software systems and application issues.
• Maintain good documentation for new software written and new procedures to be followed.
• Provide recommendations for continuous improvement.
• Work alongside other engineers on the team to sustain and advance our organization’s capabilities.

• Demonstrated hands-on experience with Python, Git, and unit testing frameworks.
• Demonstrated hands-on experience with building APIs and services using REST.
• Demonstrated hands-on experience with OpenSearch or Elasticsearch.
• Demonstrated hands-on experience with AWS CDK 1 and/or 2 or Terraform.
• Demonstrated hands-on experience applying object-oriented design principles and patterns to architect scalable, maintainable, and testable software systems in production environments. Demonstrated hands-on experience designing and developing applications using core AWS services, including EC2, S3, IAM, and VPC

• Demonstrated hands-on experience building event-driven or serverless architectures using AWS services such as Lambda, API Gateway, and SQS or SNS
• Demonstrated hands-on experience implementing data pipelines or analytics workflows using AWS-native services (Glue, Athena, EMR, S3)
• Demonstrated experience optimizing AWS costs using best practices such as right-sizing, storage tiering, and workload-aware architecture decisions.
• Demonstrated hands-on experience with PRESTO, Trino, or Apache Spark
• Demonstrated hands-on experience with reverse proxy solutions e.g NGINX
• Demonstrated hands on experience working with DynamoDB, RDS, or HIVE.
• Demonstrated hands-on experience with Parquet and/or ORC file formats.
• Demonstrated hands-on experience working with Hadoop, Apache Spark and their related ecosystems.
• Demonstrated hands-on experience building and managing ETL pipelines using orchestration frameworks like Dagster, Airflow, or NiFi.
• Demonstrated hands-on DevOps experience to include creation and deployment of container-based applications
• Demonstrated hands-on experience working with cloud formation for automation.
• Demonstrated hands-on experience building and deploying software within a CI/CD pipeline.
• Demonstrated hands-on experience with Linux-based systems and shell scripting.

• Bachelor's degree in Computer Science, Information Technology, or other related technical discipline, or equivalent combination of education, technical certifications, training, and work/military experience.