Use GPU for inference

[gimseng]

Hi, I'd like to use BERT-NER for inference, mainly to recognise ORG. I have been able to do so with CPU, now I'd like to know two things:

1. Would GPU speed up inference ?

2. Does BERT-NER automatically use CPU? I tried it on Google Colab and I don't see any changes in inference time. Please advice how, thanks !