Currently, when set np=28, clip of vit-base-p32 takes over 1h to compute similarities for 558k dataset, and tens of hours for vit-large-p14-336.



Perhaps the following can help:
- loading on GPU (implemented)
using batched computing (not easy to implement, as batching is closely related to the internal logic of operators)
Currently, when set np=28, clip of vit-base-p32 takes over 1h to compute similarities for 558k dataset, and tens of hours for vit-large-p14-336.
Perhaps the following can help:
using batched computing (not easy to implement, as batching is closely related to the internal logic of operators)