Skip to content

Conversation

@aholstrup1
Copy link
Collaborator

@aholstrup1 aholstrup1 commented Nov 29, 2025

❔What, Why & How

It might be interesting to track the number of tests being run in your workflow over time, and to see whether tests are failing.

This PR would add that to the existing AL-Go telemetry. In the near future we could look into adding a page to the starter-dashboard as well, so an AL-Go partner could quite easily get an overview of their test runs across all their repos.

✅ Checklist

  • Add tests (E2E, unit tests)
  • Update RELEASENOTES.md
  • Update documentation (e.g. for new settings or scenarios)
  • Add telemetry

@aholstrup1 aholstrup1 requested a review from a team as a code owner November 29, 2025 11:25
Copilot AI review requested due to automatic review settings November 29, 2025 11:25
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR adds telemetry tracking for test results across three test types (standard tests, page scripting tests, and BCPT tests), enabling AL-Go partners to monitor test execution metrics over time. The implementation collects test counts (total, passed, failed, skipped) and execution time, emitting telemetry events that can be queried through Application Insights.

Key changes:

  • Added telemetry emission for test result metrics in TestResultAnalyzer.ps1
  • Updated documentation with KQL query examples and telemetry event specifications
  • Tracked metrics include: TotalTests, TotalPassed, TotalFailed, TotalSkipped, and TotalTime

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 7 comments.

File Description
Scenarios/EnablingTelemetry.md Added documentation for test result telemetry events including KQL query examples and dimension descriptions
Actions/AnalyzeTests/TestResultAnalyzer.ps1 Imported TelemetryHelper module and added telemetry emission logic to three test result analysis functions

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

You can also share your feedback on Copilot code review for a chance to win a $100 gift card. Take the survey.

Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated 1 comment.


💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

You can also share your feedback on Copilot code review for a chance to win a $100 gift card. Take the survey.

Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated no new comments.


💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

You can also share your feedback on Copilot code review for a chance to win a $100 gift card. Take the survey.

spetersenms
spetersenms previously approved these changes Dec 2, 2025
@mazhelez
Copy link
Collaborator

mazhelez commented Dec 3, 2025

⚠️ Release Notes Update Reminder

Thank you for updating the release notes!

Please ensure that your changes are placed above the new version section (currently ## v8.1) in the RELEASENOTES.md file.

This helps maintain a clear changelog structure where new changes are grouped under the latest unreleased version.

@aholstrup1 aholstrup1 merged commit 1924403 into microsoft:main Dec 3, 2025
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants