query-test-result

Name

ci:query-test-result

Synopsis

/ci:query-test-result <version> <keywords> [sippy-url]

Description

The ci:query-test-result command queries OpenShift CI test results from Sippy based on the OpenShift version and test name keywords. It retrieves test statistics including pass rate, number of runs, failures, and links to failed job runs.

By default, it queries the production Sippy instance at sippy.dptools.openshift.org. You can optionally specify a different Sippy instance URL to query alternative environments (e.g., QE component readiness).

This command is useful for:

• Checking the health of specific test cases
• Finding test failure patterns
• Getting links to failed Prow job runs for debugging
• Monitoring test regression trends
• Querying different Sippy instances (production, QE, etc.)

Arguments

• $1 (version): OpenShift version to query (e.g., "4.21", "4.20", "4.19")
• $2 (keywords): Keywords to search in test names (e.g., "PolarionID:81664", "olmv1", "sig-storage")
• $3 (sippy-url) [optional]: Sippy instance base URL. Defaults to "sippy.dptools.openshift.org" if not provided. Examples: "qe-component-readiness.dptools.openshift.org"

Implementation

1. Parse Arguments

   • Extract version from $1 (e.g., "4.21")
   • Extract keywords from $2 (e.g., "81664" or "olmv1")
   • Extract Sippy URL from $3 if provided, otherwise use default "sippy.dptools.openshift.org"
   • Normalize URL to extract base domain for API endpoint (strip "/sippy-ng/" suffix if present)
   • Add "https://" prefix if not already present

2. Build Sippy API Request

   • Construct filter JSON for the /api/tests endpoint:

     filters = {
         "items": [
             {
                 "columnField": "name",
                 "not": False,
                 "operatorValue": "contains",
                 "value": keywords
             }
         ],
         "linkOperator": "and"
     }
     

   • Set query parameters:
     • release: The OpenShift version
     • filter: JSON-encoded filter object
     • sort: "asc"
     • sortField: "net_improvement"