Principal AWS Database Engineer

What You’ll Do/Responsibilities:

We’re looking for a talented and intensely curious Senior AWS Database Engineer who is nimble and focused with a startup mentality.  In this newly created role you will be the liaison between data engineers, data scientists and analytics engineers.  You will work to create cutting-edge architecture that provides the increased performance, scalability and concurrency for Data Science and Analytics workflows.

• Design and implement multi-terabyte Data Warehouse and Data Lake infrastructure in support of large scale Data Analytics and Data Science applications.
• Optimize and tune Redshift cluster, queries and workflows to support multiple analytics and visualization platforms.
• Design and implement workflows for Analytics and Data Science use cases, including Python ETL, AWS Lambda, AWS Step Functions, and Database Python UDFs.
• Implement Redshift Workload Management (WML) to prioritize workloads and manage concurrency issues.
• Architect and implement working solutions that leverage Redshift Spectrum, Redshift Serveless 
• Establish controls needed to comply with company cybersecurity and data loss prevention policies, standards, and industry best practices.
• Provide timely support in response to performance issues.
• Design and implement monitoring and alerting system for AWS Redshift cluster performance and uptime.
• Design and implement Redshift Disaster Recovery Plan.

Who You Are/Required Qualifications:

• Excellent in optimizing and testing Python ETL code that includes AWS Boto3 SDK
• Expert AWS Redshift performance and tuning including the following:
• SQL Performance tuning and optimization
• Concurrency scaling and monitoring
• Data distribution monitoring and optimization
• Stored Procedures, Materialized view, User Defined Functions - Optimization & Tuning
• Workload Manager, queue Management
• Disaster recovery design/implementation - snapshots & recovery points
• Large scale Data Warehouse & Data Lake workloads optimization based on Spark, Lambda Functions, S3, Glue
• Parameter Group management
• Data Governance & Security - Data Encryption, Redshift User Roles & Groups, Role Based Data Access Controls (row level data security), IAM integration, AWS Security Groups, AWS Cloud Watch event monitoring
• Expert in performance and scalability of large data sets
• Postgres, AWS RDS, AWS Aurora, MySQL, SQL Server, Oracle, AWS DynamoDB, AWS Glue Metastor, MongoDB, Redis, AWS ElastiCache or AWS OpenSearch
• Advanced knowledge and experience in the design and implementation of Data Warehouse, Data Lake - with Data Mesh as a plus
• Advanced knowledge and experience in maintenance of Metadata repositories such as AWS Glue Catalog, Glue crawler for data stored in:  S3, AWS Redshift,  AWS RDS for access thru Redshift Spectrum

Valued Skills:

• Bachelor's degree in technology, engineering, or related field
• Experienced in Metadata classification, lineage, and discovery based on AWS technologies or equivalent open source frameworks
• Experienced in use of AWS IAM, AWS Security Groups, AWS Web Application Firewall
• Experienced in use of Redshift Spectrum and Redshift Serverless Architecture
• Strong communications skills, both written and verbal
• Strong analytical and trouble-shooting skills

Why Spotter:

• Medical insurance covered up to 100%
• Dental & vision insurance
• 401(k) matching
• Stock options
• Complimentary gym access
• Autonomy and upward mobility
• Diverse, equitable, and inclusive culture, where your voice matters.

In compliance with local law, we are disclosing the compensation, or a range thereof, for roles that will be performed in Culver City. Actual salaries will vary and may be above or below the range based on various factors including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The overall market range for roles in this area of Spotter are typically: $100-$500K salary per year.  The range listed is just one component of Spotter’s total compensation package for employees. Other rewards may include annual discretionary bonus and equity.