Skip to content
Open
Show file tree
Hide file tree
Changes from 17 commits
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions PLUGINS.md
Original file line number Diff line number Diff line change
Expand Up @@ -40,6 +40,7 @@ Miscellaenous tools for working with OpenShift CI
- **`/ci:add-debug-wait` `<workflow-or-job-name> [timeout]`** - Add a wait step to a CI workflow for debugging test failures
- **`/ci:ask-sippy` `[question]`** - Ask the Sippy AI agent questions about OpenShift CI payloads, jobs, and test results
- **`/ci:list-unstable-tests` `<version> <keywords> [sippy-url]`** - List unstable tests with pass rate below 95%
- **`/ci:pr-test-analysis` `[base-branch-or-pr-url]`** - Review Ginkgo test code changes in current branch or PR for naming violations and best practices
- **`/ci:query-job-status` `<execution-id>`** - Query the status of a gangway job execution by ID
- **`/ci:query-test-result` `<version> <keywords> [sippy-url]`** - Query test results from Sippy by version and test keywords
- **`/ci:trigger-periodic` `<job-name> [ENV_VAR=value ...]`** - Trigger a periodic gangway job with optional environment variable overrides
Expand Down
6 changes: 6 additions & 0 deletions docs/data.json
Original file line number Diff line number Diff line change
Expand Up @@ -204,6 +204,12 @@
"name": "list-unstable-tests",
"synopsis": "/ci:list-unstable-tests <version> <keywords> [sippy-url]"
},
{
"argument_hint": "[base-branch-or-pr-url]",
"description": "Review Ginkgo test code changes in current branch or PR for naming violations and best practices",
"name": "pr-test-analysis",
"synopsis": "/ci:pr-test-analysis [base-branch-or-pr-url]"
},
{
"argument_hint": "<execution-id>",
"description": "Query the status of a gangway job execution by ID",
Expand Down
41 changes: 41 additions & 0 deletions plugins/ci/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,47 @@ release quality.

## Commands

### pr-test-analysis

Review Ginkgo test code changes in current branch or PR for naming violations and best practices.

**Usage:**
```bash
/ci:pr-test-analysis [base-branch-or-pr-url]
```

**What it does:**
- Validates component mapping tags (`[Jira:"component"]` required for new tests)
- Detects dynamic or unstable test names
- Checks parallel safety (`[Serial]` tag usage)
- Identifies deprecated conventions (Author/Owner tags, untagged LEVEL0)
- Distinguishes between new tests (strict requirements) and modified tests (legacy tags allowed)

**Examples:**

1. **Review current branch with auto-detection:**
```bash
/ci:pr-test-analysis
```

2. **Review against specific base branch:**
```bash
/ci:pr-test-analysis up/main
```

3. **Review a GitHub pull request:**
```bash
/ci:pr-test-analysis https://github.com/openshift/origin/pull/305390
```

**Key Features:**
- NEW tests must use `[Jira:"component"]` tags
- MODIFIED tests may keep existing `[sig-*]` or `[bz-*]` tags
- Automatic OpenShift test conventions validation
- Works with both local branches and remote PRs

See [commands/pr-test-analysis.md](commands/pr-test-analysis.md) for full documentation.

### ask-sippy

Query the Sippy Chat AI agent for CI/CD data analysis. Sippy Chat has a
Expand Down
Loading
Loading