DEV Community

Cover image for Top 10 Open-Source RAG Frameworks you need!! 🧌

Top 10 Open-Source RAG Frameworks you need!! 🧌

Rohan Sharma on March 12, 2025

The capabilities of Large Language Models (LLMs) are enhanced by Retrieval-Augmented Generation (RAG). Thus, RAG comes up with a super powerful tec...
Collapse
Β 
rohan_sharma profile image
Rohan Sharma β€’ β€’ Edited

Let me know if you want a blog on a specific framework!!
Thank you for reading!

Follow me on GH: github.com/RS-labhub

Collapse
Β 
k0msenapati profile image
K Om Senapati β€’

Langchain

Collapse
Β 
fyodorio profile image
Fyodor β€’

Basically, everyone is trying to build their own RAG pipeline for their specific use case and then market them as a side gig... And I believe this abundance create analysis paralysis and as a result β€” creating another new RAG tool instead of selecting existing one πŸ˜…

In fact, I worked with llamaindex and in result needed to (re)implement some of their TS APIs because they were lacking at the moment. So all in all, implementing your own dedicated and specialized RAG tool is not such a bad idea actually (and not such a big deal too, depending on use case).

Collapse
Β 
srbhr profile image
πš‚πšŠπšžπš›πšŠπš‹πš‘ πšπšŠπš’ β€’

Basically, everyone is trying to build their own RAG pipeline for their specific use case and then market them as a side gig

LangChain and GPTIndex started this way when ChatGPT was released first. And now they've grown bigger.

Collapse
Β 
rohan_sharma profile image
Rohan Sharma β€’

+1

Collapse
Β 
rohan_sharma profile image
Rohan Sharma β€’

You're right.

depending on use case

This factor decides a lot! But it's still great to use the pre-built tools to save time. If they are missing a specific feature, do contribute to that as they are open-source. πŸ˜‰

Collapse
Β 
srbhr profile image
πš‚πšŠπšžπš›πšŠπš‹πš‘ πšπšŠπš’ β€’

Nice and detailed article. However, LlamaIndex and JinaAI are not RAG frameworks. They serve their purpose in a RAG or AI project pipeline/stack.

Collapse
Β 
rohan_sharma profile image
Rohan Sharma β€’

yes, but they help developers build production RAG pipelines. And this is much needed! So, I put them in the RAG framework. However, they are ultimately a RAG framework.

Collapse
Β 
gbwadown profile image
gbwadown β€’

This post provides an excellent introduction to RAG (Retrieval-Augmented Generation) frameworks and highlights their importance in enhancing LLM capabilities. The simplified explanation using a toy analogy makes it accessible even for beginners, while the step-by-step breakdown of RAG’s workflow effectively demonstrates its functionality.

The list of top open-source RAG frameworks is a valuable resource, starting with LLMWare.ai, which stands out due to its enterprise-friendly features like LLM orchestration, document processing, vector database integration, and custom fine-tuning. Its scalability and security make it particularly appealing for businesses looking to deploy AI-powered applications.

Collapse
Β 
rohan_sharma profile image
Rohan Sharma β€’

Thank you, Hassan!

Also, LLMWare.ai is one of the best RAG Frameworks. You can try it and let me know the feedback.

Collapse
Β 
akashjana profile image
Akash Jana β€’

Great post! I don't how many times i will return to reread it to check them out..

Collapse
Β 
rohan_sharma profile image
Rohan Sharma β€’

save it for later.. Ehehe πŸ˜‰

Collapse
Β 
anmolbaranwal profile image
Anmol Baranwal β€’

Awesome work man. I can see some really new ones here. πŸ”₯ That table recap is nice too.

Collapse
Β 
rohan_sharma profile image
Rohan Sharma β€’

Thank you, Anmol. (and thank you for always helping me)

I thought a summarized table would be great as this blog was a little longer to read. I'm glad that you liked it! πŸ™ˆ

Collapse
Β 
saksham65 profile image
saksham65 β€’

Thanks for including us!
Just to clarify, β€œLLM-App” is actually a set of ready-to-run AI pipelines built on top of Pathway’s core engine (rather than a standalone framework). It’s Docker-friendly, uses YAML-based configuration to define sources and pipeline logic, and stays continuously in sync with SharePoint, S3, databases, etc. We also have built-in indexing (vector/hybrid/full-text) for real-time search and RAG use cases.

If you’re curious about how it compares to other RAG solutions, feel free to check our in-depth comparison at pathway.com/rag-frameworks. Let us know if you have any questionsβ€”we’re always happy to help!

Collapse
Β 
rohan_sharma profile image
Rohan Sharma β€’

Thank you Saksham for sharing this with us. But every framework is different and there are pros and cons in all of them. πŸ˜‰

Collapse
Β 
k0msenapati profile image
K Om Senapati β€’

Wow mentioned so many projects

Very long listicle

Collapse
Β 
rohan_sharma profile image
Rohan Sharma β€’

Yusss. A detailed one!

Collapse
Β 
shelar1423 profile image
Digvijay Shelar β€’

Amazing listicle !

Collapse
Β 
rohan_sharma profile image
Rohan Sharma β€’

I'm glad you liked it!

Collapse
Β 
danshalev7 profile image
Dan Shalev β€’
Collapse
Β 
rohan_sharma profile image
Rohan Sharma β€’

Graph Rag.. That's cool!!

Collapse
Β 
faaizyahya profile image
Β­Β­ β€’

thanks bro

Collapse
Β 
rohan_sharma profile image
Rohan Sharma β€’

My pleasure!!!

Collapse
Β 
thenikhilraj profile image
Nikhil Raj β€’

Amazing!

Collapse
Β 
rohan_sharma profile image
Rohan Sharma β€’

I hope you had a great read!

Collapse
Β 
julieana_andrade_1273e95d profile image
Julieana Andrade β€’

very good

Collapse
Β 
rohan_sharma profile image
Rohan Sharma β€’

Yuss. Thanks!!!

Collapse
Β 
navneet_kakkar profile image
navneet kakkar β€’

Hi where will you categorise the interfaces like open webui

Collapse
Β 
rohan_sharma profile image
Rohan Sharma β€’

Open WebUI is a user-friendly, self-hosted web interface designed for interacting with Large Language Models (LLMs)

It's not a RAG framework!