Skip to content

feat(java): align inverted index options - #8829

Merged
Xuanwo merged 4 commits into
lance-format:mainfrom
ddupg:feat/ddu-362-java-inverted-index-parity
Sep 5, 2026
Merged

feat(java): align inverted index options#8829
Xuanwo merged 4 commits into
lance-format:mainfrom
ddupg:feat/ddu-362-java-inverted-index-parity

Conversation

@ddupg

@ddupg ddupg commented Aug 27, 2026

Copy link
Copy Markdown
Contributor

Summary

  • align Java tokenizer support with PyLance and the existing Java API documentation by enabling Jieba and Lindera in the Java JNI artifact, with a lightweight Jieba indexing and search test
  • expose the remaining Rust inverted-index build options through the Java builder
  • preserve source compatibility for the ineffective skipMerge option while deprecating it and stopping serialization of the unsupported field

Test plan

  • ./mvnw test (before rebasing onto the latest main)
  • cargo fmt --manifest-path java/lance-jni/Cargo.toml --all -- --check
  • cargo clippy --tests --manifest-path java/lance-jni/Cargo.toml
  • ./mvnw -Dtest=InvertedIndexParamsTest test after the final test cleanup

@github-actions github-actions Bot added A-java Java bindings + JNI A-deps Dependency updates enhancement New feature or request labels Aug 27, 2026
@ddupg
ddupg force-pushed the feat/ddu-362-java-inverted-index-parity branch from 0cbdb5b to 8d25b60 Compare August 27, 2026 14:31
@ddupg
ddupg marked this pull request as ready for review August 28, 2026 03:34
@ddupg
ddupg force-pushed the feat/ddu-362-java-inverted-index-parity branch from 5cb2513 to acb47ed Compare August 28, 2026 03:34
lance-gatekeeper[bot]

This comment was marked as outdated.

@lance-gatekeeper lance-gatekeeper Bot added K-changes Latest Gatekeeper recommendation requests changes. and removed K-changes Latest Gatekeeper recommendation requests changes. labels Aug 28, 2026
Expose the Rust inverted-index configuration in Java and enable the model-backed tokenizers already documented by the binding.
@ddupg
ddupg force-pushed the feat/ddu-362-java-inverted-index-parity branch from acb47ed to b1a0f5a Compare September 4, 2026 07:42
@lance-gatekeeper lance-gatekeeper Bot removed the K-changes Latest Gatekeeper recommendation requests changes. label Sep 4, 2026
lance-gatekeeper[bot]

This comment was marked as outdated.

@lance-gatekeeper lance-gatekeeper Bot added the K-approved Latest Gatekeeper recommendation permits acceptance. label Sep 4, 2026

@lance-gatekeeper lance-gatekeeper Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Gate recommendation: approve.

The merge from main leaves the reviewed pull-request patch unchanged, and code-analyzer index creation still works end to end on the current head.

@Xuanwo
Xuanwo merged commit 7d53161 into lance-format:main Sep 5, 2026
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

A-deps Dependency updates A-java Java bindings + JNI enhancement New feature or request K-approved Latest Gatekeeper recommendation permits acceptance.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants