Data Engineer - I

Location: Bangalore

Work Policy: Hybrid (Startup Environment)

About the Role
Saltmine is looking for an enthusiastic Data Platform Engineer to join our growing team. In this role, you will work closely with senior engineers to build and maintain our data platform, supporting data processing and analytics across the company. You will have the opportunity to contribute to key data projects, learn cutting-edge technologies, and help solve real-world data challenges. This is an exciting role for someone eager to develop their data domain skills in a cloud-native, fast-paced startup environment.

Key Responsibilities
• Data Platform Support and Development: Assist in the design, development, and maintenance of a scalable data platform that supports both batch and real-time data processing.

• Data Pipeline Development:Collaborate with senior engineers to develop and manage ETL/ELT pipelines, ensuring the timely and accurate ingestion, transformation, and distribution of data across the company.

• Real-Time Data Processing:Contribute to the implementation of real-time data processing solutions using tools like Apache Kafka and Apache Flink, ensuring low-latency, high-throughput data streams.

• Data Storage Management:Support the optimization of data lakes and warehouses to ensure efficient data storage, retrieval, and cost-effective management.

• Monitoring and Troubleshooting:Assist in implementing monitoring solutions and frameworks to ensure data accuracy and system reliability. Help identify and resolve performance issues in data pipelines.

• Collaboration:Work with data scientists, analysts, and product teams to understand business needs and help deliver scalable data solutions that meet those requirements. • Learning and Growth:Take ownership of assigned tasks, proactively seeking mentorship from senior engineers, and continuously improving your skills in data engineering.

Tech Stack
• Cloud: AWS (S3, Redshift, Glue, Lambda, EC2, EMR, IAM)

• Batch Processing: Apache Spark, Athena, Presto

• Data Streaming: Apache Kafka, Apache Flink

• Data Storage: AWS S3, Redshift, Hudi/Iceberg/Delta Lake

• Orchestration: Apache Airflow or similar tools

• Programming Languages: Python, Java, Scala

• Infrastructure as Code: Terraform, Ansible

• ⁠Database: Postgres, Redshift, MongoDB

• Version Control: Git, GitHub/GitLab

Required Qualifications
• 2+ years of hands-on experience in data engineering/ data platform engineering or a related field.

• Experience developing and maintaining data pipelines (ETL/ELT) in cloud environments (AWS preferred).

• Familiarity with distributed data processing frameworks (e.g., Apache Spark) and real-time streaming technologies (Kafka, Flink).

• Familiarity with modern data lake architecture and various table formats like Apache Hudi, Iceberg, delta lake. 

• Hands-on programming experience in Python and/or Java, with the ability to write efficient, maintainable code.

• Hands-on SQL and/or NoSQL experience.

• Familiarity with cloud infrastructure management tools such as Terraform or Ansible.

• Strong problem-solving skills with a focus on incremental delivery and adaptability to evolving project needs.

• Good communication skills and a willingness to learn and collaborate with cross-functional teams.

Preferred Qualifications
• Experience with Infrastructure as Code (Terraform, Ansible) for managing cloud environments.

• Familiarity with DataOps and CI/CD pipelines in data engineering.

• Knowledge of Kubernetes is a plus.

• Previous experience in a startup or fast-paced environment is a plus.