Apollo

Senior Professional- Data Technical Engineer, Data Management & Reporting

Mumbai, India
Kubernetes API PostgreSQL Docker Python Spark Microservices AWS Azure GCP Java Kafka MySQL
Description

Position Overview

  • Harness modern application best practices with code quality, test Coverages, Agile Development, DevOps, and Observability and support.
  • Design, develop, and deploy microservices using Java and Python to facilitate data processing, transformation, and integration.
  • Create APIs and endpoints to interact with data sources, databases, and other services within the data ecosystem.
  • Data Pipeline Design and Implementation:
  • Design and implement data pipelines to ingest, process, and deliver data from diverse sources into our data lake or data warehouse.
  • Ensure data quality, consistency, and reliability throughout the data pipeline.
  • Develop data transformation workflows to clean, enrich, and aggregate data as per business requirements.
  • Implement Extract, Transform, Load (ETL) processes to integrate data from various sources and systems.
  • Identify performance bottlenecks and optimize data processing workflows to improve overall system efficiency.
  • Develop and execute unit tests, integration tests, and end-to-end tests to ensure the reliability and accuracy of data pipelines and microservices.
  • Set up monitoring and logging systems to proactively identify and resolve issues in data processing workflows.
  • Investigate and troubleshoot data-related problems, providing timely resolutions.
  • Collaboration and Communication:
  • Work closely with data scientists, analysts, and other stakeholders to understand their data requirements and provide data solutions accordingly.
  • Collaborate with the development and operations teams to deploy and manage microservices effectively.
  • Implement OAuth Okta integration for communication between API producers and consumers.

Qualifications & Experience

  • 12+ Years of experience with Bachelor's / Masters degree in Computer Science, Engineering, or a related field.
  • Solid experience in developing microservices using Java and Python.
  • Proficiency in data processing frameworks and libraries, such as Apache Spark, Kafka, or Flink.
  • Strong understanding of data modeling, data structures, and algorithms.
  • Experience with ETL tools and methodologies.
  • Familiarity with data warehousing concepts and databases (e.g., PostgreSQL, MySQL, etc.).
  • Knowledge of cloud-based data services and platforms (AWS, Azure, GCP) is a plus.
  • Understanding of DevOps practices and containerization technologies (Docker, Kubernetes) is advantageous.
  • Excellent problem-solving and analytical skills with a keen eye for detail.
  • Strong communication skills and ability to work collaboratively in a team-oriented environment.
  • Significant experience of designing, deploying, and supporting production cloud environments like Azure and Kubernetes
  • Experience with Azure DevOps CI/CD Tools to build and deploy Java/API packages and API deployment automation.
  • Hands-on experience in designing and developing high volume REST using API Protocols and Data Formats.
  • Deep Understanding of Databases, API Frameworks, Governance Frameworks, and expertise in hosting and managing platform environments like: Spark, Flink, Kafka, SpringBoot, BI Tools like Tableau, Alteryx, Governance Tools like Callibra, Soda, Amazon DeeQu

Additional Qualifications

  • Financial proven experience: Capital markets/Private Equity and/or securities processing
  • Familiar in NoSQL\NewSQL databases
  • Strong documentation capability and adherence to testing and release management standards
  • Design, development, modification and testing of databases designed to support Data Warehousing and BI business teams
  • Familiarity with SDLC methodologies, defect tracking (JIRA, Azure DevOps, ServiceNow etc.)
  • Monitor and fine-tune microservices for optimal performance and scalability.
  • Implement data security best practices and ensure data privacy compliance in all data engineering processes.
  • Collaborate with the security and compliance teams to uphold data governance standards.

Soft Skills:

  • Candidate must have an analytical and logical thought process for developing project solutions
  • Strong interpersonal and communication skills; works well in a team environment
  • Ability to deliver under competing priorities and pressures.
  • Excellent organizational skills in the areas of code structuring & partitioning, commenting and documentation for team alignment and modifications

Apollo provides equal employment opportunities regardless of age, disability, gender reassignment, marital or civil partner status, pregnancy or maternity, race, colour, nationality, ethnic or national origin, religion or belief, veteran status, gender/sex or sexual orientation, or any other criterion or circumstance protected by applicable law, ordinance, or regulation. The above criteria are intended to be used as a guide only – candidates who do not meet all the above criteria may still be considered if they are deemed to have relevant experience/ equivalent levels of skill or knowledge to fulfil the requirements of the role. Any job offer will be conditional upon and subject to satisfactory reference and background screening checks, all necessary corporate and regulatory approvals or certifications as required from time to time, and entering into definitive contractual documentation satisfactory to Apollo.

Apollo
Apollo
Asset Management Credit Financial Services Property Management Real Estate

0 applies

2 views

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

πŸ₯³πŸ₯³πŸ₯³ 401 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

To try it out

For active job seekers

For those who are passive looking

Cancel anytime

Frequently Asked Questions

  • We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
  • We've got about 70,000 jobs from 5,000 vetted companies. No fake or sleazy jobs here!
  • We aggregate jobs from 5,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
  • We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. πŸ› οΈ
  • Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. πŸš€
  • Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
  • Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. πŸ“…

What Fellow Engineers Say