Skip to content

fix: handle validation errors of files and content providers individually#308

Merged
kyteinsky merged 5 commits into
masterfrom
fix/do-not-fail-batch-for-one-item
Jun 9, 2026
Merged

fix: handle validation errors of files and content providers individually#308
kyteinsky merged 5 commits into
masterfrom
fix/do-not-fail-batch-for-one-item

Conversation

@kyteinsky

@kyteinsky kyteinsky commented Jun 2, 2026

Copy link
Copy Markdown
Contributor

fixes #307

…ally

Signed-off-by: kyteinsky <kyteinsky@gmail.com>
@kyteinsky kyteinsky force-pushed the fix/do-not-fail-batch-for-one-item branch from 5722c46 to 6551e96 Compare June 2, 2026 14:25
kyteinsky added 2 commits June 8, 2026 16:19
Signed-off-by: kyteinsky <kyteinsky@gmail.com>
Signed-off-by: kyteinsky <kyteinsky@gmail.com>
@kyteinsky kyteinsky force-pushed the fix/do-not-fail-batch-for-one-item branch from aa70385 to e7d1f71 Compare June 8, 2026 10:50
- empty files are not counted in eligible files

Signed-off-by: kyteinsky <kyteinsky@gmail.com>
@kyteinsky kyteinsky force-pushed the fix/do-not-fail-batch-for-one-item branch from e7d1f71 to e6870f8 Compare June 8, 2026 10:50
Signed-off-by: kyteinsky <kyteinsky@gmail.com>
@kyteinsky kyteinsky merged commit 5b4c99d into master Jun 9, 2026
14 checks passed
@kyteinsky kyteinsky deleted the fix/do-not-fail-batch-for-one-item branch June 9, 2026 06:53
@kyteinsky kyteinsky mentioned this pull request Jun 24, 2026
1 task
kyteinsky added a commit that referenced this pull request Jun 24, 2026
## 5.4.0 - 2026-06-24

### Highlights
- The indexing direction has been reversed now. Instead of the
context_chat PHP app sending documents to the context_chat_backend
ExApp, the ExApp downloads the documents from the server according to a
list obtained from the PHP app. This also means that the `occ
context_chat:scan` command serves no purpose and has been removed.
Indexing should be smoother and run continuously now.
- Kubernetes support to scale the CPU computation
- Separate docker images for CPU, CUDA and ROCM (uses Vulkan) instead of
one heavy CUDA/CPU image
- CUDA 12.8 is shipped in the CUDA image so the host drivers should be
updated to this at the minimum.

### Added
- add network embedding batching (#276) @fcharlaix-opendsi
- add kubernetes support and reverse content/indexing flow (#284)
@kyteinsky @marcelklehr
- add gh workflows for docker builds and do separate cpu, cuda and rocm
(vulkan) images (#295) @kyteinsky

### Changed
- update readme according to the latest changes (#300) @kyteinsky
- bump llama_cpp_python to 0.3.23 (#301) @kyteinsky
- move task types to the backend (#321) @kyteinsky
- adjust comment in Dockerfile regarding RTX5090 support (#316)
@kyteinsky

### Fixed
- improve loadSources error handling (#288) @kyteinsky
- fix(pgvector): add chunking to prevent long list of args in queries
(#290) @kyteinsky
- fix(pgvector): make doc deletion query faster (#289) @kyteinsky
- drop latin-1 decode in source title and userIds (#306) @kyteinsky
- handle validation errors of files and content providers individually
(#308) @kyteinsky
- prevent race condition in vectordb tables creation (#308) @kyteinsky
- pass actual error in the error object (#308) @kyteinsky
- add container hostname to /etc/hosts to silence sudo warning (#311)
@sanzakicesarr

## 🤖 AI (if applicable)

- [ ] The content of this PR was partly or fully generated using AI

Signed-off-by: kyteinsky <kyteinsky@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

index of a batch of documents fails if even one document has empty content

2 participants