Skip to content

feat(LlamaRankingContext): add an option to chunk large documents - #645

Merged
giladgd merged 19 commits into
masterfrom
gilad/downloaderFixes
Sep 12, 2026
Merged

feat(LlamaRankingContext): add an option to chunk large documents#645
giladgd merged 19 commits into
masterfrom
gilad/downloaderFixes

Conversation

@giladgd

@giladgd giladgd commented Sep 8, 2026

Copy link
Copy Markdown
Member

Description of change

  • feat(LlamaRankingContext): add an option to chunk large documents
  • feat(LlamaModel): lazyMode support
  • feat: get model and context memory usage
  • feat: native jinja implementation fallback
  • fix: reading gguf files that have no tensors
  • fix: reading network gguf file retry conditions
  • fix: add missing supported quant file name
  • fix: check arch features directly from llama.cpp
  • fix: align the Vulkan device reading more with llama.cpp
  • fix: Metal 4 tensor API issues on M5 mac machines
  • fix: various bugs

Resolves #644

Pull-Request Checklist

  • Code is up-to-date with the master branch
  • npm run format to apply eslint formatting
  • npm run test passes with this change
  • This pull request links relevant issues as Fixes #0000
  • There are new or updated unit tests validating the change
  • Documentation has been updated to reflect this change
  • The new commits and pull request title follow conventions explained in pull request guidelines (PRs that do not follow this convention will not be merged)

@giladgd
giladgd requested a review from ido-pluto September 8, 2026 04:56
@giladgd giladgd self-assigned this Sep 8, 2026
@giladgd giladgd changed the title feat(LlamaRankingContext): add an option to chunk large documents feat(LlamaRankingContext): add an option to chunk large documents Sep 8, 2026

@ido-pluto ido-pluto left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@giladgd
giladgd merged commit a5532a9 into master Sep 12, 2026
17 checks passed
@giladgd
giladgd deleted the gilad/downloaderFixes branch September 12, 2026 02:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

2 participants