Set up dedicated devices / Tensorflow serving / Use an ExApp as backend

[arch-user-france1]

Make an app that can be installed on other devices and a setting that if a device that has such app and is configured (and online) gets the model & pictures so it can process byself. My Server doesn't have a good GPU so I would like to run it on my fast er computer with a NVIDIA GeForce GTX 1660 super (or if a rasperry pi is online send it some data so it is a bit faster etc.)

[marcelklehr]

This is a good idea, but it will take some time until I can get to it.

[arch-user-france1]

I love this project

It is very fun and the people begin clicking on cats (as this is the most accurate) and look how their cats looked past 2 years
When my cloud works well I possibly stop billing OneDrive and pay you 1$/month (Well I get 50CHF/Month)

[stavros-k]

One advantage is that you don't have to overload a nextcloud container with extra packages.
Also it can be scaled up a lot, like in a kubernetes cluster, you can spawn multiple workers to do the processing. (maybe not so much for a home lab, but in a bigger installations would be awesome).

[arch-user-france1]

Maybe I can do a little beta

Maybe a bit of bash script that lets the classifier work through SSH (rsync)

[arch-user-france1]

I'm actually thinking about it because I don't want to use a bash script
It sucks

How do you use the node/tensorflow? I see that you use - instead of a file path. Is it a huge performance decreasment to spawn a tensorflow for every file?

I should look into the code...

[marcelklehr]

The classifier scripts accept input either via cli args or as JSON via stdin.

[marcelklehr]

Ideally we would have a Tensorflow serving container and allow people to connect to it with recognize.

[UmbrellaCodr]

+1, as I don't have support for glibc, having another docker image with all the supported libraries makes a lot more sense.

[gotagitaccnt]

Any updates on this? Would really appreciate this feature to be implemented or maybe some pointers how to start

[guystreeter]

I can run the rest of Nextcloud on a 1GB VM.
A 4GB VM costs almost 4 times a much per month.
I would like to to batch-process recognition on another machine that I only spin up for a day once in a while. (Or do the recognition runs on my home machine with its NVIDIA GPU)

[ddarek2000]

Great Idea. Up-Vote

[szaimen]

I think this would also be a good idea e.g. for AIO since libtensorflow does not seem to run in an alpine container but could then run from another container which could use debian as base.

[guystreeter]

Setting up GPU access for a container is complicated. Anyone running Nextcloud in a container would probably want to send image analysis requests to a service running on the native OS.