Skip to content
Skill Eval

Implement automated eval test suite for Angular Skills #20

Sign in to view logs

Implement automated eval test suite for Angular Skills

Implement automated eval test suite for Angular Skills #20

Triggered via pull request March 11, 2026 08:50
@kdinevkdinev
synchronize #17007
copilot/implement-automated-eval-test-suite
Status Failure
Total duration 4m 38s
Artifacts 3

skill-eval.yml

on: pull_request
validate_graders
12s
validate_graders
agent_eval_copilot
17s
agent_eval_copilot
agent_eval_gemini
4m 26s
agent_eval_gemini
post_summary
7s
post_summary
Fit to window
Zoom out
Zoom in

Annotations

2 errors and 4 warnings
agent_eval_copilot
Process completed with exit code 1.
agent_eval_gemini
Process completed with exit code 1.
validate_graders
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/setup-node@v4, actions/upload-artifact@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
agent_eval_copilot
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/setup-node@v4, actions/upload-artifact@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
agent_eval_gemini
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/checkout@v4, actions/setup-node@v4, actions/upload-artifact@v4. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
post_summary
Node.js 20 actions are deprecated. The following actions are running on Node.js 20 and may not work as expected: actions/download-artifact@v4, actions/github-script@v7. Actions will be forced to run with Node.js 24 by default starting June 2nd, 2026. Please check if updated versions of these actions are available that support Node.js 24. To opt into Node.js 24 now, set the FORCE_JAVASCRIPT_ACTIONS_TO_NODE24=true environment variable on the runner or in your workflow file. Once Node.js 24 becomes the default, you can temporarily opt out by setting ACTIONS_ALLOW_USE_UNSECURE_NODE_VERSION=true. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/

Artifacts

Produced during runtime
Name Size Digest
skill-eval-agent-copilot-results Expired
1.36 KB
sha256:767be81cbef773bd09667021ffaf40de3a77eccbfe981a586c00c803166ae737
skill-eval-agent-gemini-results Expired
1.35 KB
sha256:841f094300b01e7d604a3264f3a9fae130b4911b34c65c26ad3d594352e1d0f5
skill-eval-validation-results Expired
1.31 KB
sha256:c92badc848c2526aa82fc4afd6eec41170d9d549bb784b15bf003fd0a8aba2b7