I see that the walltime measurement is still considered beta, and is advertised together with your custom hosted runners (https://docs.codspeed.io/instruments/walltime/)
Because the instrumentation based measurement is unbearably slow for us, I tried to use --codspeed-mode=walltime instead.
This works in CI, and has a much faster runtime, but somehow does not properly upload those reports, and the rest of codspeed seems to be unusable for the following reasons:
See also codecov/shared#520 (comment) for some more details of why I wanted to switch to walltime measurement.
I see that the walltime measurement is still considered beta, and is advertised together with your custom hosted runners (https://docs.codspeed.io/instruments/walltime/)
Because the instrumentation based measurement is unbearably slow for us, I tried to use
--codspeed-mode=walltimeinstead.This works in CI, and has a much faster runtime, but somehow does not properly upload those reports, and the rest of codspeed seems to be unusable for the following reasons:
See also codecov/shared#520 (comment) for some more details of why I wanted to switch to walltime measurement.