mostsimilar-for-RAG-normalization
Linux CLI tools to compare text files and find nearest neighbours across large directories using TF‑IDF or SimHash, with optional dedup workflows, useful in RAG pipelines to remove duplicate documents that have different MD5/SHA-256/SHA-512 hashes but same/similar contents. C++/C performance.
- 1
- C
- MIT
- 9 mo ago