Ankura

Senior Software Engineer, Ailevate

Remote New York, NY
USD 65k - 155k
FastAPI Kubernetes PostgreSQL GCP TensorFlow PyTorch SQL Elasticsearch Docker API Flask Python Microservices Azure AWS
Description

Ankura is a team of excellence founded on innovation and growth.

Practice Overview:

AI is more than just chatbots—it is the foundation for autonomous intelligence, decision-making, and scalable automation. At Ailevate, an Ankura company, we are pioneering the next evolution of Agentic AI, where autonomous AI Agents leverage Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), and real-time data processing to drive impact across industries.

Our platform is built for businesses that need scalable, privacy-first AI solutions to enhance efficiency, automation, and decision-making. Join us in shaping the future of AI beyond chatbots, where LLM-powered Agents solve complex problems, streamline workflows, and optimize analytics-driven insights.

Role Overview:

The ideal candidate selected for this role will ideally be working US eastern time hours. As a Senior Software Engineer (Python), you will be a core contributor to our Agentic AI Platform, designing and scaling microservices that power LLM-driven AI Agents. You will collaborate with AI researchers, data engineers, and cloud infrastructure teams to deploy AI models, optimize inference, and eventually fine-tune LLMs for industry-specific applications.  Your work will directly impact how AI-driven agents extract insights, process structured and unstructured data, and enhance real-time analytics.

This is a great opportunity to work on cutting-edge AI applications beyond chatbots, developing LLM-powered AI Agents that solve real industry problems.  This is a fully remote position with a highly talented AI-first team. The selected candidate will have ownership and impact to help shape a next-generation AI platform with real-world applications. Ankura offers competitive compensation and a strong work culture that values both innovation and work-life balance. Based on the selected candidates’ experience and qualifications, this role will be filled at either the Senior Associate or Director level within Ankura’s structure.

Responsibilities:

·Develop, optimize, and scale backend services using Python and FastAPI.

·Design and implement microservices for LLM-powered AI Agents, focusing on real-time processing, inference, and decision-making.

·Integrate LLM APIs (OpenAI, Anthropic, vLLM, etc.) to power AI-driven insights and automation.

·Enhance our Retrieval-Augmented Generation (RAG) pipeline, enabling AI Agents to retrieve, process, and synthesize knowledge.

·Implement messaging and event-driven workflows using RabbitMQ.

·Fine-tune and optimize LLMs using TensorFlow and PyTorch as the platform evolves.

·Deploy and manage AI workloads on Kubernetes, ensuring scalability and high availability.

·Collaborate with infrastructure and DevOps teams to streamline CI/CD pipelines and cloud-based deployments.

·Write well-structured, maintainable, and testable code following best practices.

·Mentor junior engineers and contribute to technical decision-making.

Requirements:

·5+ years of Python software development experience.

·Strong experience with FastAPI (or Flask) for building scalable APIs.

·Experience with LLMs, NLP, and AI-driven applications.

·Experience integrating LLM APIs such as OpenAI, Anthropic, or vLLM.

·Proficiency in microservices architecture and distributed systems.

·Familiarity with frameworks such as TensorFlow and PyTorch and model optimization techniques.

·Experience with SQL and NoSQL databases such as Elasticsearch or PostgreSQL.

·Cloud experience with Azure, AWS, or GCP, along with CI/CD automation.

·Proficiency in containerization with Docker and orchestration using Kubernetes.

·Experience with event-driven architectures using RabbitMQ or similar message brokers.

·Strong problem-solving and debugging skills with a focus on performance optimization.

  • Preferred to have experience fine-tuning LLMs and optimizing inference workloads.

  • Preferred to have familiarity with Neo4j, graph databases, or knowledge graphs.

  • Preferred to have experience contributing to open-source AI or LLM projects.

  • Preferred to have understanding of vector databases such as Elasticsearch, Weaviate, or Pinecone.

  • Preferred to have experience in healthcare, fintech, or other highly regulated industries.

For individuals assigned and/or hired to work in California, Colorado, or New York, Ankura is required to include a reasonable estimate of the compensation range for this role. This compensation range is specific to the said markets and considers a broad range of factors including but not limited to skill sets, experience and training, licensure and certifications, and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled.  The range does not include additional benefits outside of salary. At Ankura, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each role. A reasonable estimate of the current base pay range is between $65,000 to $155,000; this range is not a promise of a particular wage.
 

#LI-MJ1

#LI-Remote 

*

Ankura is an Affirmative Action and Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or protected veteran status and will not be discriminated against based on disability. Equal Employment Opportunity Posters, if you have a disability and believe you need a reasonable accommodation to search for a job opening, submit an online application, or participate in an interview/assessment, please email accommodations@ankura.com or call toll-free +1.312-583-2122. This email and phone number are created exclusively to assist disabled job seekers whose disability prevents them from being able to apply online. Only messages left for this purpose will be returned. Messages left for other purposes, such as following up on an application or technical issues unrelated to a disability, will not receive a response.

There are more than 50,000 engineering jobs:

Subscribe to membership and unlock all jobs

Engineering Jobs

60,000+ jobs from 4,500+ well-funded companies

Updated Daily

New jobs are added every day as companies post them

Refined Search

Use filters like skill, location, etc to narrow results

Become a member

🥳🥳🥳 452 happy customers and counting...

Overall, over 80% of customers chose to renew their subscriptions after the initial sign-up.

To try it out

For active job seekers

For those who are passive looking

Cancel anytime

Frequently Asked Questions

  • We prioritize job seekers as our customers, unlike bigger job sites, by charging a small fee to provide them with curated access to the best companies and up-to-date jobs. This focus allows us to deliver a more personalized and effective job search experience.
  • We've got about 70,000 jobs from 5,000 vetted companies. No fake or sleazy jobs here!
  • We aggregate jobs from 5,000+ companies' career pages, so you can be sure that you're getting the most up-to-date and relevant jobs.
  • We're the only job board *for* software engineers, *by* software engineers… in case you needed a reminder! We add thousands of new jobs daily and offer powerful search filters just for you. 🛠️
  • Every single hour! We add 2,000-3,000 new jobs daily, so you'll always have fresh opportunities. 🚀
  • Typically, job searches take 3-6 months. EchoJobs helps you spend more time applying and less time hunting. 🎯
  • Check daily! We're always updating with new jobs. Set up job alerts for even quicker access. 📅

What Fellow Engineers Say

Sid avatar
Sid
Very nice portal for searching jobs in this rough market.
Mar 6, 2025
Michael Duran avatar
Michael Duran
Software Engineer
I've been using this job search site for a while now, and it’s honestly one of the best out there! The clean and easy-to-navigate UI makes the whole job-hunting process so much smoother. Plus, the job postings are always up-to-date, so I never feel like I’m wasting time. The cherry on top is the owner—super kind and always quick to respond. Definitely recommend checking it out if you're on the job hunt!
Aug 21, 2024
Sai avatar
Sai
It’s really great website for finding jobs based on skills it’s really helpful give a go
Aug 21, 2024
Adinadh avatar
Adinadh
What I like most about Echo Jobs is how easy it is to use. The platform helps me quickly find jobs that match my skills and interests, thanks to its great recommendations and filters. Yes, I would definitely recommend Echo Jobs to a friend. It makes job searching simple and efficient, making it a great tool for anyone looking for a new job.
Jul 23, 2024
As a student navigating the job market, I've found LinkedIn increasingly frustrating due to numerous fake postings by consultancies. In contrast, this job posting website has been a game-changer for me. It offers genuine opportunities and a straightforward application process, making it much easier to find and apply for real jobs. Highly recommend it to fellow students seeking reliable job listings!
Jul 16, 2024
Cliff Gor avatar
Echo Jobs has been exceptional in my job hunt where it provides one platform to job hunt and I don't have to open 10 websites just to look for a job. It has also helped me focus much on the job skill and the location filtering out the onsite jobs and remote ones. The only feature that I would request is to display fully remote jobs that are not restricted to a country since the one available shows ie, Remote, US yet. But if it could show remote only, that would be helpful not only to me but to other people applying for full remote and not tied to only US candidates
Apr 22, 2024
I found EchoJobs in 2022, and I love it. It has a lot of remote jobs. It's exclusive to software and technology jobs (helpful for devs like me). What I like the most are its filters and its API. If you're a tech professional seeking remote work, I highly recommend giving it a try to EchoJobs.
Mar 4, 2024
Would definitely recommend it! Excellent product, dedicated founder, Jobs are easier to find. Congrats 🎉 to the entire team!
Mar 3, 2024
Brandon Banks avatar
Brandon Banks
Echo Jobs is really impressive. It provides a great user experience with an ability to quickly search through the many job postings. There is an impressive amount of jobs here and it is quickly updated. The details in the each job posting is helpful when determining if it is worth pursuing. I would highly recommend using Echo Jobs to find the next step in your career.
Mar 2, 2024
Tyler Young avatar
Tyler Young
tylerayoung.com
Best wishes with EchoJobs—it's become my favorite job board overnight!
Dec 16, 2023
Simply put, it's the most up to date tech jobs aggregator I’ve found. I'm like... "I don't have to check 10+ jobs boards daily just to see if there's a new job listing? sign me up!" The filters are also quite helpful! The UI is very clean and straightforward. Love it!
Oct 5, 2023