Example – Submitting a build and automated test results using the Helix ALM REST API
The following example can help you understand what is required to submit a build and automated test results using the Helix ALM REST API, and how the submitted data is displayed in the Helix ALM web client.
Step 1: Add an automation suite
An automation suite named Alpha Tests is added using the Helix ALM web client.
The suite is configured to automatically associate test results with test cases by script ID. The Test Cases area shows the automated test script IDs for the two test cases related to the tests that will run for this suite. During the test, these IDs are written out to the name attribute in the <testcase> element in the JUnit report files, as you can see in report file examples.
Step 2: Generate JUnit XML results report files
For this example, three JUnit XML results report files are generated after a build.
File 1
Copy
<?xml version="1.0" encoding="UTF-8"?>
<testsuite name="com.perforce.halm.reportingtool.AppTest" tests="3" skipped="0" failures="0" errors="0" timestamp="2022-09-14T12:56:44" hostname="CAFFEINE2" time="0.18">
<properties/>
<testcase name="appProvidesHelp()" classname="com.perforce.halm.reportingtool.AppTest" time="0.146"/>
<testcase name="appProvidesVersion()" classname="com.perforce.halm.reportingtool.AppTest" time="0.004"/>
<testcase name="appHandlesException() ALPHA-6" classname="com.perforce.halm.reportingtool.AppTest" time="0.028"/>
<system-out><![CDATA[Usage: reporting-tool.jar [-hv] [-P[=<password>]] [-A=<authType>]
[-b=<buildBranch>] [-d=<buildDescription>]
-f=<reportFileFormat> [-F=<sslFingerprint>]
[-H=<host>] [-i=<testRunSetID>]
[-l=<testRunSetLabel>] -n=<buildNumber>
[-p=<almProjectID>] [-s=<almSuiteID>] [-U=<username>]
[-x=<externalURL>] <reportFiles>...
Assists with submitting automated testing results to the Helix ALM Server.
<reportFiles>... Report files
-b, --branch=<buildBranch> Branch
-d, --description=<buildDescription>
Build description
-f, --format=<reportFileFormat>
Report file format. Valid values: JUnit, xUnit
-i, --testRunSetID=<testRunSetID>
Test Run Set identifier
-l, --testRunSetLabel=<testRunSetLabel>
Test Run Set label
-n, --number=<buildNumber> Build number
-p, --project=<almProjectID>
Helix ALM Project
-s, --suite=<almSuiteID> Helix ALM Automation Suite
-x, --externalURL=<externalURL>
External URL
Helix ALM REST API configuration
-A, --authType=<authType> Helix ALM REST API authentication method. Valid
values: basic, apiKey
-F, --fingerprint=<sslFingerprint>
SSL fingerprint for certificates to accept
-H, --host=<host> Helix ALM REST API URL.
-P, --password[=<password>]
Helix ALM REST API password or API key secret
-U, --username=<username> Helix ALM REST API username or API key ID
Reporting Tool Info
-h, --help Print the help info
-v, --version Print reporting tool version information.
null
Usage: reporting-tool.jar [-hv] [-P[=<password>]] [-A=<authType>]
[-b=<buildBranch>] [-d=<buildDescription>]
-f=<reportFileFormat> [-F=<sslFingerprint>]
[-H=<host>] [-i=<testRunSetID>]
[-l=<testRunSetLabel>] -n=<buildNumber>
[-p=<almProjectID>] [-s=<almSuiteID>] [-U=<username>]
[-x=<externalURL>] <reportFiles>...
Assists with submitting automated testing results to the Helix ALM Server.
<reportFiles>... Report files
-b, --branch=<buildBranch> Branch
-d, --description=<buildDescription>
Build description
-f, --format=<reportFileFormat>
Report file format. Valid values: JUnit, xUnit
-i, --testRunSetID=<testRunSetID>
Test Run Set identifier
-l, --testRunSetLabel=<testRunSetLabel>
Test Run Set label
-n, --number=<buildNumber> Build number
-p, --project=<almProjectID>
Helix ALM Project
-s, --suite=<almSuiteID> Helix ALM Automation Suite
-x, --externalURL=<externalURL>
External URL
Helix ALM REST API configuration
-A, --authType=<authType> Helix ALM REST API authentication method. Valid
values: basic, apiKey
-F, --fingerprint=<sslFingerprint>
SSL fingerprint for certificates to accept
-H, --host=<host> Helix ALM REST API URL.
-P, --password[=<password>]
Helix ALM REST API password or API key secret
-U, --username=<username> Helix ALM REST API username or API key ID
Reporting Tool Info
-h, --help Print the help info
-v, --version Print reporting tool version information.
]]></system-out>
<system-err><![CDATA[]]></system-err>
</testsuite>
Copy
<?xml version="1.0" encoding="UTF-8"?>
<testsuite name="com.perforce.halm.reportingtool.format.junit.JUnitMetaBuildTest" tests="6" skipped="0" failures="0" errors="0" timestamp="2022-09-14T12:56:45" hostname="CAFFEINE2" time="0.019">
<properties/>
<testcase name="processSuiteNoTests()" classname="com.perforce.halm.reportingtool.format.junit.JUnitMetaBuildTest" time="0.002"/>
<testcase name="processSuiteNoMetadata()" classname="com.perforce.halm.reportingtool.format.junit.JUnitMetaBuildTest" time="0.001"/>
<testcase name="processSuiteWithMetadata()" classname="com.perforce.halm.reportingtool.format.junit.JUnitMetaBuildTest" time="0.004"/>
<testcase name="processWrapperTwoSuitesNoTests()" classname="com.perforce.halm.reportingtool.format.junit.JUnitMetaBuildTest" time="0.002"/>
<testcase name="processSuiteAndWrapperNoTests()" classname="com.perforce.halm.reportingtool.format.junit.JUnitMetaBuildTest" time="0.003"/>
<testcase name="processInvalidFile() ALPHA-30" classname="com.perforce.halm.reportingtool.format.junit.JUnitMetaBuildTest" time="0.006"/>
<system-out><![CDATA[]]></system-out>
<system-err><![CDATA[]]></system-err>
</testsuite>
Copy
<?xml version="1.0" encoding="UTF-8"?>
<testsuite name="com.perforce.halm.reportingtool.format.junit.JUnitMetaResultTest" tests="2" skipped="1" failures="1" errors="0" timestamp="2022-09-14T12:56:44" hostname="CAFFEINE2" time="0.157">
<properties/>
<testcase name="processCaseInvalid()" classname="com.perforce.halm.reportingtool.format.junit.JUnitMetaResultTest" time="0.0">
<skipped/>
</testcase>
<testcase name="processCaseWithMetadata() ALPHA-30" classname="com.perforce.halm.reportingtool.format.junit.JUnitMetaResultTest" time="0.157">
<failure message="org.opentest4j.AssertionFailedError: Operating system was not the expected value. ==> expected: <Linux> but was: <Windows>" type="org.opentest4j.AssertionFailedError">org.opentest4j.AssertionFailedError: Operating system was not the expected value. ==> expected: <Linux> but was: <Windows>
at app//org.junit.jupiter.api.AssertionUtils.fail(AssertionUtils.java:55)
at app//org.junit.jupiter.api.AssertionUtils.failNotEqual(AssertionUtils.java:62)
at app//org.junit.jupiter.api.AssertEquals.assertEquals(AssertEquals.java:182)
at app//org.junit.jupiter.api.Assertions.assertEquals(Assertions.java:1135)
at app//com.perforce.halm.reportingtool.format.junit.JUnitMetaResultTest.processCaseWithMetadata(JUnitMetaResultTest.java:86)
at java.base@11.0.16/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base@11.0.16/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base@11.0.16/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base@11.0.16/java.lang.reflect.Method.invoke(Method.java:566)
at app//org.junit.platform.commons.util.ReflectionUtils.invokeMethod(ReflectionUtils.java:688)
at app//org.junit.jupiter.engine.execution.MethodInvocation.proceed(MethodInvocation.java:60)
at app//org.junit.jupiter.engine.execution.InvocationInterceptorChain$ValidatingInvocation.proceed(InvocationInterceptorChain.java:131)
at app//org.junit.jupiter.engine.extension.TimeoutExtension.intercept(TimeoutExtension.java:149)
at app//org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestableMethod(TimeoutExtension.java:140)
at app//org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestMethod(TimeoutExtension.java:84)
at app//org.junit.jupiter.engine.execution.ExecutableInvoker$ReflectiveInterceptorCall.lambda$ofVoidMethod$0(ExecutableInvoker.java:115)
at app//org.junit.jupiter.engine.execution.ExecutableInvoker.lambda$invoke$0(ExecutableInvoker.java:105)
at app//org.junit.jupiter.engine.execution.InvocationInterceptorChain$InterceptedInvocation.proceed(InvocationInterceptorChain.java:106)
at app//org.junit.jupiter.engine.execution.InvocationInterceptorChain.proceed(InvocationInterceptorChain.java:64)
at app//org.junit.jupiter.engine.execution.InvocationInterceptorChain.chainAndInvoke(InvocationInterceptorChain.java:45)
at app//org.junit.jupiter.engine.execution.InvocationInterceptorChain.invoke(InvocationInterceptorChain.java:37)
at app//org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:104)
at app//org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:98)
at app//org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.lambda$invokeTestMethod$6(TestMethodTestDescriptor.java:210)
at app//org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
at app//org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.invokeTestMethod(TestMethodTestDescriptor.java:206)
at app//org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:131)
at app//org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:65)
at app//org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$5(NodeTestTask.java:139)
at app//org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
at app//org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$7(NodeTestTask.java:129)
at app//org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137)
at app//org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:127)
at app//org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
at app//org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:126)
at app//org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:84)
at java.base@11.0.16/java.util.ArrayList.forEach(ArrayList.java:1541)
at app//org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.invokeAll(SameThreadHierarchicalTestExecutorService.java:38)
at app//org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$5(NodeTestTask.java:143)
at app//org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
at app//org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$7(NodeTestTask.java:129)
at app//org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137)
at app//org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:127)
at app//org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
at app//org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:126)
at app//org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:84)
at java.base@11.0.16/java.util.ArrayList.forEach(ArrayList.java:1541)
at app//org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.invokeAll(SameThreadHierarchicalTestExecutorService.java:38)
at app//org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$5(NodeTestTask.java:143)
at app//org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
at app//org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$7(NodeTestTask.java:129)
at app//org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137)
at app//org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:127)
at app//org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)
at app//org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:126)
at app//org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:84)
at app//org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.submit(SameThreadHierarchicalTestExecutorService.java:32)
at app//org.junit.platform.engine.support.hierarchical.HierarchicalTestExecutor.execute(HierarchicalTestExecutor.java:57)
at app//org.junit.platform.engine.support.hierarchical.HierarchicalTestEngine.execute(HierarchicalTestEngine.java:51)
at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:108)
at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:88)
at org.junit.platform.launcher.core.EngineExecutionOrchestrator.lambda$execute$0(EngineExecutionOrchestrator.java:54)
at org.junit.platform.launcher.core.EngineExecutionOrchestrator.withInterceptedStreams(EngineExecutionOrchestrator.java:67)
at org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:52)
at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:96)
at org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:75)
at org.gradle.api.internal.tasks.testing.junitplatform.JUnitPlatformTestClassProcessor$CollectAllTestClassesExecutor.processAllTestClasses(JUnitPlatformTestClassProcessor.java:99)
at org.gradle.api.internal.tasks.testing.junitplatform.JUnitPlatformTestClassProcessor$CollectAllTestClassesExecutor.access$000(JUnitPlatformTestClassProcessor.java:79)
at org.gradle.api.internal.tasks.testing.junitplatform.JUnitPlatformTestClassProcessor.stop(JUnitPlatformTestClassProcessor.java:75)
at org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.stop(SuiteTestClassProcessor.java:61)
at java.base@11.0.16/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base@11.0.16/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base@11.0.16/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base@11.0.16/java.lang.reflect.Method.invoke(Method.java:566)
at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:36)
at org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at org.gradle.internal.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:33)
at org.gradle.internal.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:94)
at com.sun.proxy.$Proxy2.stop(Unknown Source)
at org.gradle.api.internal.tasks.testing.worker.TestWorker$3.run(TestWorker.java:193)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.executeAndMaintainThreadName(TestWorker.java:129)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:100)
at org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:60)
at org.gradle.process.internal.worker.child.ActionExecutionWorker.execute(ActionExecutionWorker.java:56)
at org.gradle.process.internal.worker.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:133)
at org.gradle.process.internal.worker.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:71)
at app//worker.org.gradle.process.internal.worker.GradleWorkerMain.run(GradleWorkerMain.java:69)
at app//worker.org.gradle.process.internal.worker.GradleWorkerMain.main(GradleWorkerMain.java:74)
</failure>
</testcase>
<system-out><![CDATA[]]></system-out>
<system-err><![CDATA[]]></system-err>
</testsuite>
The following example is the REST API JSON translated from the JUnit report files. The JSON is submitted to Helix ALMvia the REST API using the POST /{projectID}/automationSuites/{automationSuiteID}/submitBuild endpoint.
Copy
{
"number": "1234",
"startDate": "2022-09-14T12:56:44",
"duration": 1019,
"results": [
{
"name": "appProvidesHelp()",
"uniqueName": "CAFFEINE2:com.perforce.halm.reportingtool.AppTest:com.perforce.halm.reportingtool.AppTest:appProvidesHelp()",
"status": {
"id": 1
},
"duration": 146
},
{
"name": "appProvidesVersion()",
"uniqueName": "CAFFEINE2:com.perforce.halm.reportingtool.AppTest:com.perforce.halm.reportingtool.AppTest:appProvidesVersion()",
"status": {
"id": 1
},
"duration": 4
},
{
"name": "appHandlesException() ALPHA-6",
"uniqueName": "CAFFEINE2:com.perforce.halm.reportingtool.AppTest:com.perforce.halm.reportingtool.AppTest:appHandlesException()",
"status": {
"id": 1
},
"duration": 28
},
{
"name": "processSuiteNoTests()",
"uniqueName": "CAFFEINE2:com.perforce.halm.reportingtool.format.junit.JUnitMetaBuildTest:com.perforce.halm.reportingtool.format.junit.JUnitMetaBuildTest:processSuiteNoTests()",
"status": {
"id": 1
},
"duration": 2
},
{
"name": "processSuiteNoMetadata()",
"uniqueName": "CAFFEINE2:com.perforce.halm.reportingtool.format.junit.JUnitMetaBuildTest:com.perforce.halm.reportingtool.format.junit.JUnitMetaBuildTest:processSuiteNoMetadata()",
"status": {
"id": 1
},
"duration": 1
},
{
"name": "processSuiteWithMetadata()",
"uniqueName": "CAFFEINE2:com.perforce.halm.reportingtool.format.junit.JUnitMetaBuildTest:com.perforce.halm.reportingtool.format.junit.JUnitMetaBuildTest:processSuiteWithMetadata()",
"status": {
"id": 1
},
"duration": 4
},
{
"name": "processWrapperTwoSuitesNoTests()",
"uniqueName": "CAFFEINE2:com.perforce.halm.reportingtool.format.junit.JUnitMetaBuildTest:com.perforce.halm.reportingtool.format.junit.JUnitMetaBuildTest:processWrapperTwoSuitesNoTests()",
"status": {
"id": 1
},
"duration": 2
},
{
"name": "processSuiteAndWrapperNoTests()",
"uniqueName": "CAFFEINE2:com.perforce.halm.reportingtool.format.junit.JUnitMetaBuildTest:com.perforce.halm.reportingtool.format.junit.JUnitMetaBuildTest:processSuiteAndWrapperNoTests()",
"status": {
"id": 1
},
"duration": 3
},
{
"name": "processInvalidFile() ALPHA-30",
"uniqueName": "CAFFEINE2:com.perforce.halm.reportingtool.format.junit.JUnitMetaBuildTest:com.perforce.halm.reportingtool.format.junit.JUnitMetaBuildTest:processInvalidFile()",
"status": {
"id": 1
},
"duration": 6
},
{
"name": "processCaseInvalid()",
"uniqueName": "CAFFEINE2:com.perforce.halm.reportingtool.format.junit.JUnitMetaResultTest:com.perforce.halm.reportingtool.format.junit.JUnitMetaResultTest:processCaseInvalid()",
"status": {
"id": 3
},
"duration": 0
},
{
"name": "processCaseWithMetadata() ALPHA-30",
"uniqueName": "CAFFEINE2:com.perforce.halm.reportingtool.format.junit.JUnitMetaResultTest:com.perforce.halm.reportingtool.format.junit.JUnitMetaResultTest:processCaseWithMetadata()",
"status": {
"id": 2
},
"duration": 157,
"errorMessage": "org.opentest4j.AssertionFailedError: Operating system was not the expected value. ==> expected: <Linux> but was: <Windows>",
"properties": [
{
"name": "failureType",
"value": "org.opentest4j.AssertionFailedError"
},
{
"name": "failureValue",
"value": "org.opentest4j.AssertionFailedError: Operating system was not the expected value. ==> expected: <Linux> but was: <Windows>\n\tat app//org.junit.jupiter.api.AssertionUtils.fail(AssertionUtils.java:55)\n\tat app//org.junit.jupiter.api.AssertionUtils.failNotEqual(AssertionUtils.java:62)\n\tat app//org.junit.jupiter.api.AssertEquals.assertEquals(AssertEquals.java:182)\n\tat app//org.junit.jupiter.api.Assertions.assertEquals(Assertions.java:1135)\n\tat app//com.perforce.halm.reportingtool.format.junit.JUnitMetaResultTest.processCaseWithMetadata(JUnitMetaResultTest.java:86)\n\tat java.base@11.0.16/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat java.base@11.0.16/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\n\tat java.base@11.0.16/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.base@11.0.16/java.lang.reflect.Method.invoke(Method.java:566)\n\tat app//org.junit.platform.commons.util.ReflectionUtils.invokeMethod(ReflectionUtils.java:688)\n\tat app//org.junit.jupiter.engine.execution.MethodInvocation.proceed(MethodInvocation.java:60)\n\tat app//org.junit.jupiter.engine.execution.InvocationInterceptorChain$ValidatingInvocation.proceed(InvocationInterceptorChain.java:131)\n\tat app//org.junit.jupiter.engine.extension.TimeoutExtension.intercept(TimeoutExtension.java:149)\n\tat app//org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestableMethod(TimeoutExtension.java:140)\n\tat app//org.junit.jupiter.engine.extension.TimeoutExtension.interceptTestMethod(TimeoutExtension.java:84)\n\tat app//org.junit.jupiter.engine.execution.ExecutableInvoker$ReflectiveInterceptorCall.lambda$ofVoidMethod$0(ExecutableInvoker.java:115)\n\tat app//org.junit.jupiter.engine.execution.ExecutableInvoker.lambda$invoke$0(ExecutableInvoker.java:105)\n\tat app//org.junit.jupiter.engine.execution.InvocationInterceptorChain$InterceptedInvocation.proceed(InvocationInterceptorChain.java:106)\n\tat app//org.junit.jupiter.engine.execution.InvocationInterceptorChain.proceed(InvocationInterceptorChain.java:64)\n\tat app//org.junit.jupiter.engine.execution.InvocationInterceptorChain.chainAndInvoke(InvocationInterceptorChain.java:45)\n\tat app//org.junit.jupiter.engine.execution.InvocationInterceptorChain.invoke(InvocationInterceptorChain.java:37)\n\tat app//org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:104)\n\tat app//org.junit.jupiter.engine.execution.ExecutableInvoker.invoke(ExecutableInvoker.java:98)\n\tat app//org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.lambda$invokeTestMethod$6(TestMethodTestDescriptor.java:210)\n\tat app//org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)\n\tat app//org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.invokeTestMethod(TestMethodTestDescriptor.java:206)\n\tat app//org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:131)\n\tat app//org.junit.jupiter.engine.descriptor.TestMethodTestDescriptor.execute(TestMethodTestDescriptor.java:65)\n\tat app//org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$5(NodeTestTask.java:139)\n\tat app//org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)\n\tat app//org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$7(NodeTestTask.java:129)\n\tat app//org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137)\n\tat app//org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:127)\n\tat app//org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)\n\tat app//org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:126)\n\tat app//org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:84)\n\tat java.base@11.0.16/java.util.ArrayList.forEach(ArrayList.java:1541)\n\tat app//org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.invokeAll(SameThreadHierarchicalTestExecutorService.java:38)\n\tat app//org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$5(NodeTestTask.java:143)\n\tat app//org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)\n\tat app//org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$7(NodeTestTask.java:129)\n\tat app//org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137)\n\tat app//org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:127)\n\tat app//org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)\n\tat app//org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:126)\n\tat app//org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:84)\n\tat java.base@11.0.16/java.util.ArrayList.forEach(ArrayList.java:1541)\n\tat app//org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.invokeAll(SameThreadHierarchicalTestExecutorService.java:38)\n\tat app//org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$5(NodeTestTask.java:143)\n\tat app//org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)\n\tat app//org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$7(NodeTestTask.java:129)\n\tat app//org.junit.platform.engine.support.hierarchical.Node.around(Node.java:137)\n\tat app//org.junit.platform.engine.support.hierarchical.NodeTestTask.lambda$executeRecursively$8(NodeTestTask.java:127)\n\tat app//org.junit.platform.engine.support.hierarchical.ThrowableCollector.execute(ThrowableCollector.java:73)\n\tat app//org.junit.platform.engine.support.hierarchical.NodeTestTask.executeRecursively(NodeTestTask.java:126)\n\tat app//org.junit.platform.engine.support.hierarchical.NodeTestTask.execute(NodeTestTask.java:84)\n\tat app//org.junit.platform.engine.support.hierarchical.SameThreadHierarchicalTestExecutorService.submit(SameThreadHierarchicalTestExecutorService.java:32)\n\tat app//org.junit.platform.engine.support.hierarchical.HierarchicalTestExecutor.execute(HierarchicalTestExecutor.java:57)\n\tat app//org.junit.platform.engine.support.hierarchical.HierarchicalTestEngine.execute(HierarchicalTestEngine.java:51)\n\tat org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:108)\n\tat org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:88)\n\tat org.junit.platform.launcher.core.EngineExecutionOrchestrator.lambda$execute$0(EngineExecutionOrchestrator.java:54)\n\tat org.junit.platform.launcher.core.EngineExecutionOrchestrator.withInterceptedStreams(EngineExecutionOrchestrator.java:67)\n\tat org.junit.platform.launcher.core.EngineExecutionOrchestrator.execute(EngineExecutionOrchestrator.java:52)\n\tat org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:96)\n\tat org.junit.platform.launcher.core.DefaultLauncher.execute(DefaultLauncher.java:75)\n\tat org.gradle.api.internal.tasks.testing.junitplatform.JUnitPlatformTestClassProcessor$CollectAllTestClassesExecutor.processAllTestClasses(JUnitPlatformTestClassProcessor.java:99)\n\tat org.gradle.api.internal.tasks.testing.junitplatform.JUnitPlatformTestClassProcessor$CollectAllTestClassesExecutor.access$000(JUnitPlatformTestClassProcessor.java:79)\n\tat org.gradle.api.internal.tasks.testing.junitplatform.JUnitPlatformTestClassProcessor.stop(JUnitPlatformTestClassProcessor.java:75)\n\tat org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.stop(SuiteTestClassProcessor.java:61)\n\tat java.base@11.0.16/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat java.base@11.0.16/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\n\tat java.base@11.0.16/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.base@11.0.16/java.lang.reflect.Method.invoke(Method.java:566)\n\tat org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:36)\n\tat org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)\n\tat org.gradle.internal.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:33)\n\tat org.gradle.internal.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:94)\n\tat com.sun.proxy.$Proxy2.stop(Unknown Source)\n\tat org.gradle.api.internal.tasks.testing.worker.TestWorker$3.run(TestWorker.java:193)\n\tat org.gradle.api.internal.tasks.testing.worker.TestWorker.executeAndMaintainThreadName(TestWorker.java:129)\n\tat org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:100)\n\tat org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:60)\n\tat org.gradle.process.internal.worker.child.ActionExecutionWorker.execute(ActionExecutionWorker.java:56)\n\tat org.gradle.process.internal.worker.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:133)\n\tat org.gradle.process.internal.worker.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:71)\n\tat app//worker.org.gradle.process.internal.worker.GradleWorkerMain.run(GradleWorkerMain.java:69)\n\tat app//worker.org.gradle.process.internal.worker.GradleWorkerMain.main(GradleWorkerMain.java:74)\n"
}
]
}
]
}
The following screenshots show the data in the Helix ALM web client after it is submitted via the REST API.
Automated test results status
When viewing the results in the automation suite, the Automated Test Result Status tab shows the 11 total tests from the submitted build. The passed and failed test results are indicated. Test results are correctly associated with the two test cases in the automation suite. The other eight test results in the build are not associated with test cases.
All results in the build
When viewing the results in the build, the All Results tab shows all tests that were included in the submitted build. The test result status, associated test cases, and duration are displayed.
