TestScriptEngineIG - Local Development build (v0.0.1). See the Directory of published versions
Resource Profile: TestScript Engine TestReport
| Official URL: https://fhir-crucible.github.io/testscript-engine-ig/StructureDefinition/testscript-engine-testreport | Version: 0.0.1 | |||
| Active as of 2022-12-29 | Computable Name: TestScriptEngineReport | |||
TestReport with extensions specific to the MITRE FHIR Foundry testscript-engine and testscript-generator
Usage:
- Examples for this Resource Profile: TestReport for SubtestToExecuteExample, TestReport for SubtestToExecuteExample, TestReport for SubtestToExecuteExample
Formal Views of Profile Content
Description of Profiles, Differentials, Snapshots and how the different presentations work.
This structure is derived from TestReport
| Name | Flags | Card. | Type | Description & Constraints |
|---|---|---|---|---|
  TestReport | 0..* | TestReport | Describes the results of a TestScript execution | |
  Slices for extension | 0..* | Extension | Extension Slice: Unordered, Open by value:url | |
 DynamicInput | 0..* | (Complex) | Extension URL: https://fhir-crucible.github.io/testscript-engine-ig/StructureDefinition/dynamic-input | |
| ExecutedAsSubtest | 0..1 | boolean | Extension URL: https://fhir-crucible.github.io/testscript-engine-ig/StructureDefinition/executed-as-subtest | |
 MustPass | 0..1 | boolean | Extension URL: https://fhir-crucible.github.io/testscript-engine-ig/StructureDefinition/executed-as-subtest-must-pass | |
| Documentation for this format | ||||
Terminology Bindings
| Path | Conformance | ValueSet |
| TestReport.status | required | TestReportStatus |
| TestReport.result | required | TestReportResult |
Constraints
| Id | Grade | Path(s) | Details | Requirements |
| dom-2 | error | TestReport | If the resource is contained in another resource, it SHALL NOT contain nested Resources : contained.contained.empty() | |
| dom-3 | error | TestReport | If the resource is contained in another resource, it SHALL be referred to from elsewhere in the resource or SHALL refer to the containing resource : contained.where((('#'+id in (%resource.descendants().reference | %resource.descendants().as(canonical) | %resource.descendants().as(uri) | %resource.descendants().as(url))) or descendants().where(reference = '#').exists() or descendants().where(as(canonical) = '#').exists() or descendants().where(as(canonical) = '#').exists()).not()).trace('unmatched', id).empty() | |
| dom-4 | error | TestReport | If a resource is contained in another resource, it SHALL NOT have a meta.versionId or a meta.lastUpdated : contained.meta.versionId.empty() and contained.meta.lastUpdated.empty() | |
| dom-5 | error | TestReport | If a resource is contained in another resource, it SHALL NOT have a security label : contained.meta.security.empty() | |
| dom-6 | best practice | TestReport | A resource should have narrative for robust management : text.`div`.exists() | |
| ele-1 | error | **ALL** elements | All FHIR elements must have a @value or children : hasValue() or (children().count() > id.count()) | |
| ext-1 | error | **ALL** extensions | Must have either extensions or value[x], not both : extension.exists() != value.exists() |
| Name | Flags | Card. | Type | Description & Constraints | ||||
|---|---|---|---|---|---|---|---|---|
| TestReport | 0..* | TestReport | Describes the results of a TestScript execution | |||||
 id | Σ | 0..1 | id | Logical id of this artifact | ||||
 meta | Σ | 0..1 | Meta | Metadata about the resource | ||||
| implicitRules | ?!Σ | 0..1 | uri | A set of rules under which this content was created | ||||
| language | 0..1 | code | Language of the resource content Binding: CommonLanguages (preferred): A human language.
| |||||
| text | 0..1 | Narrative | Text summary of the resource, for human interpretation | |||||
| contained | 0..* | Resource | Contained, inline Resources | |||||
| Slices for extension | 0..* | Extension | Extension Slice: Unordered, Open by value:url | |||||
| DynamicInput | 0..* | (Complex) | Extension URL: https://fhir-crucible.github.io/testscript-engine-ig/StructureDefinition/dynamic-input | |||||
| ExecutedAsSubtest | 0..1 | boolean | Extension URL: https://fhir-crucible.github.io/testscript-engine-ig/StructureDefinition/executed-as-subtest | |||||
| MustPass | 0..1 | boolean | Extension URL: https://fhir-crucible.github.io/testscript-engine-ig/StructureDefinition/executed-as-subtest-must-pass | |||||
 modifierExtension | ?! | 0..* | Extension | Extensions that cannot be ignored | ||||
| identifier | Σ | 0..1 | Identifier | External identifier | ||||
| name | Σ | 0..1 | string | Informal name of the executed TestScript | ||||
| status | ?!Σ | 1..1 | code | completed | in-progress | waiting | stopped | entered-in-error Binding: TestReportStatus (required): The current status of the test report. | ||||
 testScript | Σ | 1..1 | Reference(TestScript) | Reference to the version-specific TestScript that was executed to produce this TestReport | ||||
| result | Σ | 1..1 | code | pass | fail | pending Binding: TestReportResult (required): The reported execution result. | ||||
| score | Σ | 0..1 | decimal | The final score (percentage of tests passed) resulting from the execution of the TestScript | ||||
| tester | Σ | 0..1 | string | Name of the tester producing this report (Organization or individual) | ||||
| issued | Σ | 0..1 | dateTime | When the TestScript was executed and this TestReport was generated | ||||
 participant | 0..* | BackboneElement | A participant in the test execution, either the execution engine, a client, or a server | |||||
 id | 0..1 | string | Unique id for inter-element referencing | |||||
| extension | 0..* | Extension | Additional content defined by implementations | |||||
| modifierExtension | ?!Σ | 0..* | Extension | Extensions that cannot be ignored even if unrecognized | ||||
| type | 1..1 | code | test-engine | client | server Binding: TestReportParticipantType (required): The type of participant. | |||||
| uri | 1..1 | uri | The uri of the participant. An absolute URL is preferred | |||||
| display | 0..1 | string | The display name of the participant | |||||
| setup | 0..1 | BackboneElement | The results of the series of required setup operations before the tests were executed | |||||
| id | 0..1 | string | Unique id for inter-element referencing | |||||
| extension | 0..* | Extension | Additional content defined by implementations | |||||
| modifierExtension | ?!Σ | 0..* | Extension | Extensions that cannot be ignored even if unrecognized | ||||
 action | C | 1..* | BackboneElement | A setup operation or assert that was executed | ||||
 id | 0..1 | string | Unique id for inter-element referencing | |||||
| extension | 0..* | Extension | Additional content defined by implementations | |||||
| modifierExtension | ?!Σ | 0..* | Extension | Extensions that cannot be ignored even if unrecognized | ||||
| operation | 0..1 | BackboneElement | The operation to perform | |||||
| id | 0..1 | string | Unique id for inter-element referencing | |||||
| extension | 0..* | Extension | Additional content defined by implementations | |||||
| modifierExtension | ?!Σ | 0..* | Extension | Extensions that cannot be ignored even if unrecognized | ||||
| result | 1..1 | code | pass | skip | fail | warning | error Binding: TestReportActionResult (required): The results of executing an action. | |||||
| message | 0..1 | markdown | A message associated with the result | |||||
| detail | 0..1 | uri | A link to further details on the result | |||||
| assert | 0..1 | BackboneElement | The assertion to perform | |||||
| id | 0..1 | string | Unique id for inter-element referencing | |||||
| extension | 0..* | Extension | Additional content defined by implementations | |||||
| modifierExtension | ?!Σ | 0..* | Extension | Extensions that cannot be ignored even if unrecognized | ||||
| result | 1..1 | code | pass | skip | fail | warning | error Binding: TestReportActionResult (required): The results of executing an action. | |||||
| message | 0..1 | markdown | A message associated with the result | |||||
| detail | 0..1 | string | A link to further details on the result | |||||
| test | 0..* | BackboneElement | A test executed from the test script | |||||
| id | 0..1 | string | Unique id for inter-element referencing | |||||
| extension | 0..* | Extension | Additional content defined by implementations | |||||
| modifierExtension | ?!Σ | 0..* | Extension | Extensions that cannot be ignored even if unrecognized | ||||
| name | 0..1 | string | Tracking/logging name of this test | |||||
| description | 0..1 | string | Tracking/reporting short description of the test | |||||
| action | C | 1..* | BackboneElement | A test operation or assert that was performed | ||||
| id | 0..1 | string | Unique id for inter-element referencing | |||||
| extension | 0..* | Extension | Additional content defined by implementations | |||||
| modifierExtension | ?!Σ | 0..* | Extension | Extensions that cannot be ignored even if unrecognized | ||||
 operation | 0..1 | See operation (TestReport) | The operation performed | |||||
| assert | 0..1 | See assert (TestReport) | The assertion performed | |||||
| teardown | 0..1 | BackboneElement | The results of running the series of required clean up steps | |||||
| id | 0..1 | string | Unique id for inter-element referencing | |||||
| extension | 0..* | Extension | Additional content defined by implementations | |||||
| modifierExtension | ?!Σ | 0..* | Extension | Extensions that cannot be ignored even if unrecognized | ||||
| action | 1..* | BackboneElement | One or more teardown operations performed | |||||
| id | 0..1 | string | Unique id for inter-element referencing | |||||
| extension | 0..* | Extension | Additional content defined by implementations | |||||
| modifierExtension | ?!Σ | 0..* | Extension | Extensions that cannot be ignored even if unrecognized | ||||
| operation | 1..1 | See operation (TestReport) | The teardown operation performed | |||||
| Documentation for this format | ||||||||
Terminology Bindings
| Path | Conformance | ValueSet | ||||
| TestReport.language | preferred | CommonLanguages
| ||||
| TestReport.status | required | TestReportStatus | ||||
| TestReport.result | required | TestReportResult | ||||
| TestReport.participant.type | required | TestReportParticipantType | ||||
| TestReport.setup.action.operation.result | required | TestReportActionResult | ||||
| TestReport.setup.action.assert.result | required | TestReportActionResult |
Constraints
| Id | Grade | Path(s) | Details | Requirements |
| ele-1 | error | **ALL** elements | All FHIR elements must have a @value or children : hasValue() or (children().count() > id.count()) | |
| ext-1 | error | **ALL** extensions | Must have either extensions or value[x], not both : extension.exists() != value.exists() | |
| inv-1 | error | TestReport.setup.action | Setup action SHALL contain either an operation or assert but not both. : operation.exists() xor assert.exists() | |
| inv-2 | error | TestReport.test.action | Test action SHALL contain either an operation or assert but not both. : operation.exists() xor assert.exists() |
This structure is derived from TestReport
Differential View
This structure is derived from TestReport
| Name | Flags | Card. | Type | Description & Constraints |
|---|---|---|---|---|
| TestReport | 0..* | TestReport | Describes the results of a TestScript execution | |
| Slices for extension | 0..* | Extension | Extension Slice: Unordered, Open by value:url | |
| DynamicInput | 0..* | (Complex) | Extension URL: https://fhir-crucible.github.io/testscript-engine-ig/StructureDefinition/dynamic-input | |
| ExecutedAsSubtest | 0..1 | boolean | Extension URL: https://fhir-crucible.github.io/testscript-engine-ig/StructureDefinition/executed-as-subtest | |
| MustPass | 0..1 | boolean | Extension URL: https://fhir-crucible.github.io/testscript-engine-ig/StructureDefinition/executed-as-subtest-must-pass | |
| Documentation for this format | ||||
Key Elements View
Terminology Bindings
| Path | Conformance | ValueSet |
| TestReport.status | required | TestReportStatus |
| TestReport.result | required | TestReportResult |
Constraints
| Id | Grade | Path(s) | Details | Requirements |
| dom-2 | error | TestReport | If the resource is contained in another resource, it SHALL NOT contain nested Resources : contained.contained.empty() | |
| dom-3 | error | TestReport | If the resource is contained in another resource, it SHALL be referred to from elsewhere in the resource or SHALL refer to the containing resource : contained.where((('#'+id in (%resource.descendants().reference | %resource.descendants().as(canonical) | %resource.descendants().as(uri) | %resource.descendants().as(url))) or descendants().where(reference = '#').exists() or descendants().where(as(canonical) = '#').exists() or descendants().where(as(canonical) = '#').exists()).not()).trace('unmatched', id).empty() | |
| dom-4 | error | TestReport | If a resource is contained in another resource, it SHALL NOT have a meta.versionId or a meta.lastUpdated : contained.meta.versionId.empty() and contained.meta.lastUpdated.empty() | |
| dom-5 | error | TestReport | If a resource is contained in another resource, it SHALL NOT have a security label : contained.meta.security.empty() | |
| dom-6 | best practice | TestReport | A resource should have narrative for robust management : text.`div`.exists() | |
| ele-1 | error | **ALL** elements | All FHIR elements must have a @value or children : hasValue() or (children().count() > id.count()) | |
| ext-1 | error | **ALL** extensions | Must have either extensions or value[x], not both : extension.exists() != value.exists() |
Snapshot View
| Name | Flags | Card. | Type | Description & Constraints | ||||
|---|---|---|---|---|---|---|---|---|
| TestReport | 0..* | TestReport | Describes the results of a TestScript execution | |||||
| id | Σ | 0..1 | id | Logical id of this artifact | ||||
| meta | Σ | 0..1 | Meta | Metadata about the resource | ||||
| implicitRules | ?!Σ | 0..1 | uri | A set of rules under which this content was created | ||||
| language | 0..1 | code | Language of the resource content Binding: CommonLanguages (preferred): A human language.
| |||||
| text | 0..1 | Narrative | Text summary of the resource, for human interpretation | |||||
| contained | 0..* | Resource | Contained, inline Resources | |||||
| Slices for extension | 0..* | Extension | Extension Slice: Unordered, Open by value:url | |||||
| DynamicInput | 0..* | (Complex) | Extension URL: https://fhir-crucible.github.io/testscript-engine-ig/StructureDefinition/dynamic-input | |||||
| ExecutedAsSubtest | 0..1 | boolean | Extension URL: https://fhir-crucible.github.io/testscript-engine-ig/StructureDefinition/executed-as-subtest | |||||
| MustPass | 0..1 | boolean | Extension URL: https://fhir-crucible.github.io/testscript-engine-ig/StructureDefinition/executed-as-subtest-must-pass | |||||
| modifierExtension | ?! | 0..* | Extension | Extensions that cannot be ignored | ||||
| identifier | Σ | 0..1 | Identifier | External identifier | ||||
| name | Σ | 0..1 | string | Informal name of the executed TestScript | ||||
| status | ?!Σ | 1..1 | code | completed | in-progress | waiting | stopped | entered-in-error Binding: TestReportStatus (required): The current status of the test report. | ||||
| testScript | Σ | 1..1 | Reference(TestScript) | Reference to the version-specific TestScript that was executed to produce this TestReport | ||||
| result | Σ | 1..1 | code | pass | fail | pending Binding: TestReportResult (required): The reported execution result. | ||||
| score | Σ | 0..1 | decimal | The final score (percentage of tests passed) resulting from the execution of the TestScript | ||||
| tester | Σ | 0..1 | string | Name of the tester producing this report (Organization or individual) | ||||
| issued | Σ | 0..1 | dateTime | When the TestScript was executed and this TestReport was generated | ||||
| participant | 0..* | BackboneElement | A participant in the test execution, either the execution engine, a client, or a server | |||||
| id | 0..1 | string | Unique id for inter-element referencing | |||||
| extension | 0..* | Extension | Additional content defined by implementations | |||||
| modifierExtension | ?!Σ | 0..* | Extension | Extensions that cannot be ignored even if unrecognized | ||||
| type | 1..1 | code | test-engine | client | server Binding: TestReportParticipantType (required): The type of participant. | |||||
| uri | 1..1 | uri | The uri of the participant. An absolute URL is preferred | |||||
| display | 0..1 | string | The display name of the participant | |||||
| setup | 0..1 | BackboneElement | The results of the series of required setup operations before the tests were executed | |||||
| id | 0..1 | string | Unique id for inter-element referencing | |||||
| extension | 0..* | Extension | Additional content defined by implementations | |||||
| modifierExtension | ?!Σ | 0..* | Extension | Extensions that cannot be ignored even if unrecognized | ||||
| action | C | 1..* | BackboneElement | A setup operation or assert that was executed | ||||
| id | 0..1 | string | Unique id for inter-element referencing | |||||
| extension | 0..* | Extension | Additional content defined by implementations | |||||
| modifierExtension | ?!Σ | 0..* | Extension | Extensions that cannot be ignored even if unrecognized | ||||
| operation | 0..1 | BackboneElement | The operation to perform | |||||
| id | 0..1 | string | Unique id for inter-element referencing | |||||
| extension | 0..* | Extension | Additional content defined by implementations | |||||
| modifierExtension | ?!Σ | 0..* | Extension | Extensions that cannot be ignored even if unrecognized | ||||
| result | 1..1 | code | pass | skip | fail | warning | error Binding: TestReportActionResult (required): The results of executing an action. | |||||
| message | 0..1 | markdown | A message associated with the result | |||||
| detail | 0..1 | uri | A link to further details on the result | |||||
| assert | 0..1 | BackboneElement | The assertion to perform | |||||
| id | 0..1 | string | Unique id for inter-element referencing | |||||
| extension | 0..* | Extension | Additional content defined by implementations | |||||
| modifierExtension | ?!Σ | 0..* | Extension | Extensions that cannot be ignored even if unrecognized | ||||
| result | 1..1 | code | pass | skip | fail | warning | error Binding: TestReportActionResult (required): The results of executing an action. | |||||
| message | 0..1 | markdown | A message associated with the result | |||||
| detail | 0..1 | string | A link to further details on the result | |||||
| test | 0..* | BackboneElement | A test executed from the test script | |||||
| id | 0..1 | string | Unique id for inter-element referencing | |||||
| extension | 0..* | Extension | Additional content defined by implementations | |||||
| modifierExtension | ?!Σ | 0..* | Extension | Extensions that cannot be ignored even if unrecognized | ||||
| name | 0..1 | string | Tracking/logging name of this test | |||||
| description | 0..1 | string | Tracking/reporting short description of the test | |||||
| action | C | 1..* | BackboneElement | A test operation or assert that was performed | ||||
| id | 0..1 | string | Unique id for inter-element referencing | |||||
| extension | 0..* | Extension | Additional content defined by implementations | |||||
| modifierExtension | ?!Σ | 0..* | Extension | Extensions that cannot be ignored even if unrecognized | ||||
| operation | 0..1 | See operation (TestReport) | The operation performed | |||||
| assert | 0..1 | See assert (TestReport) | The assertion performed | |||||
| teardown | 0..1 | BackboneElement | The results of running the series of required clean up steps | |||||
| id | 0..1 | string | Unique id for inter-element referencing | |||||
| extension | 0..* | Extension | Additional content defined by implementations | |||||
| modifierExtension | ?!Σ | 0..* | Extension | Extensions that cannot be ignored even if unrecognized | ||||
| action | 1..* | BackboneElement | One or more teardown operations performed | |||||
| id | 0..1 | string | Unique id for inter-element referencing | |||||
| extension | 0..* | Extension | Additional content defined by implementations | |||||
| modifierExtension | ?!Σ | 0..* | Extension | Extensions that cannot be ignored even if unrecognized | ||||
| operation | 1..1 | See operation (TestReport) | The teardown operation performed | |||||
| Documentation for this format | ||||||||
Terminology Bindings
| Path | Conformance | ValueSet | ||||
| TestReport.language | preferred | CommonLanguages
| ||||
| TestReport.status | required | TestReportStatus | ||||
| TestReport.result | required | TestReportResult | ||||
| TestReport.participant.type | required | TestReportParticipantType | ||||
| TestReport.setup.action.operation.result | required | TestReportActionResult | ||||
| TestReport.setup.action.assert.result | required | TestReportActionResult |
Constraints
| Id | Grade | Path(s) | Details | Requirements |
| ele-1 | error | **ALL** elements | All FHIR elements must have a @value or children : hasValue() or (children().count() > id.count()) | |
| ext-1 | error | **ALL** extensions | Must have either extensions or value[x], not both : extension.exists() != value.exists() | |
| inv-1 | error | TestReport.setup.action | Setup action SHALL contain either an operation or assert but not both. : operation.exists() xor assert.exists() | |
| inv-2 | error | TestReport.test.action | Test action SHALL contain either an operation or assert but not both. : operation.exists() xor assert.exists() |
This structure is derived from TestReport
Other representations of profile: CSV, Excel, Schematron