Sr. Lead Engineer - Database (Contract)

Duties and Responsibilities

• 
  
Design and Architecture:
• Lead the design and architecture of robust, scalable, and high-performance database solutions, with a particular emphasis on time-series data, OLAP, and OLTP databases.
• Evaluate and recommend appropriate SQL and NoSQL database technologies (e.g., PostgreSQL, TimeScale, Cassandra, Apache Druid, Apache Pinot) based on project requirements.
• Design and implement data models that efficiently support a wide range of queries and data operations.
Database Development and Optimization:
• Develop, optimize, and maintain complex SQL queries, stored procedures, and indexing strategies to improve database performance.
• Implement and manage time-series databases to handle high-frequency data ingestion and query processing.
• Optimize OLAP/OLTP databases for performance, scalability, and reliability, ensuring minimal latency for transactional and analytical workloads.
• Monitor and tune databases to ensure optimal performance, including query optimization, indexing, and storage management.
Data Management and Integration:
• Work with cloud backend engineering teams to design ETL pipelines that move and transform data efficiently across different storage systems.
• Implement data partitioning, sharding, and replication strategies to ensure high availability and scalability.
• Ensure data integrity, consistency, and security across all database systems.
Collaboration and Leadership:
• Collaborate with cross-functional teams, including AI Engineers, software engineers, and product managers, to understand data requirements and deliver database solutions that meet business needs.
• Provide technical leadership and mentorship to junior engineers, guiding them in best practices for database design, development, and management.
• Drive continuous improvement initiatives in database technologies, tools, and processes.
Research and Innovation:
• Stay up to date with the latest advancements in database technologies, particularly in time-series and OLAP/OLTP systems.
• Experiment with and evaluate new database technologies and tools to enhance our data architecture and infrastructure.
• Contribute to the development of internal tools and frameworks to support database development and operations.

Qualifications and Experience

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• 10+ years of experience in database engineering, with a strong focus on both SQL and NoSQL databases.
• Proven expertise in designing and managing time-series databases (e.g., TimescaleDB, Apache Druid, Apache Pinot, etc) and OLAP/OLTP systems with high scale
• Advanced proficiency in SQL, including query optimization, indexing, and stored procedure development.
• Strong experience with NoSQL databases (e.g., MongoDB, Cassandra, Scylla, etc) and their respective data modeling techniques.
• Deep understanding of time-series data concepts, architecture, and performance tuning.
• Experience with OLAP technologies and tools such as Apache Druid, ClickHouse, or similar.
• Familiarity with cloud-based database services (e.g., AWS RDS, Google Cloud BigQuery) and infrastructure as code (IaC) tools (e.g., Terraform, CloudFormation).
• Strong programming skills (e.g., Golang, Java, Scala, etc).
• Excellent problem-solving and analytical skills, with a keen attention to detail.
• Strong communication and collaboration skills, with the ability to work effectively in cross-functional teams.
• Leadership qualities with a proven ability to mentor and guide junior team members.

Desired Skills and Experience

• Experience with streaming data platforms (e.g., Apache Kafka) and integrating them with time-series databases.
• Knowledge of containerization and orchestration technologies (e.g., Docker, Kubernetes) as they pertain to database deployment.
• Experience with real-time analytics and data warehousing solutions.