-
Notifications
You must be signed in to change notification settings - Fork 12
Home
The OVAL Test Content is a set of OVAL Definitions that provides a simple way to test the capability of OVAL Definition Evaluators. After running the OVAL Test Content through an OVAL Definition Evaluator, the OVAL Results will show the user which tests are properly supported by that tool. This allows users to perform unit testing of tools against the OVAL Language. Over time, the OVAL Test Content will cover the basic behavior of all tests and capabilities in the OVAL Language.
The OVAL Test Content has four components to its version. The first three components align with the major, minor, and update release versions of the OVAL Language. The fourth component is the build number of the OVAL Test Content. This build number is incremented as we produce and test new releases of the OVAL Test Content. The complete version identifier has the following form: MAJOR.MINOR.UPDATE.BUILD. For example, "5.10.1.1".
All new content (definitions, tests, objects, etc.) starts with a version of '1'. For updated content, the version will be incremented by one for all changes (including non-functional updates, such as comment only changes). This applies to all items (definitions, tests, objects, etc.). Additionally, all items that make use of the updated item will also have their version incremented by one (this is done recursively). Note that this recursive version incrementing does not continue past the definition level. That is, if a definition that has been updated is extended by another definition, the extending definition will not have its version incremented.
The OVAL Test Content should be considered an initial draft. The content does not test all OVAL Language capabilities and has been developed and tested on a small number of systems. It has been released at this early stage because it provides value to the community as a draft and because the best way to mature this test content is through active use and collaboration with the community. Future releases will address that feedback. For a complete listing of the tests that are supported see the [Supported Constructs] (https://github.com/OVALProject/Test-Content/wiki/Supported-Constructs) page.
The OVAL Test Content is currently developed and tested on the 32-bit version of Red Hat Enterprise Linux 5. [Supported Constructs for Linux] (https://github.com/OVALProject/Test-Content/wiki/Supported-Constructs#linux).
The OVAL Test Content is currently developed and tested on the 32-bit version of Sun Solaris 10. [Supported Constructs for Solaris] (https://github.com/OVALProject/Test-Content/wiki/Supported-Constructs#solaris).
The OVAL Test Content is currently developed and tested on the 64-bit version of Microsoft Windows 7. [Supported Constructs for Windows] (https://github.com/OVALProject/Test-Content/wiki/Supported-Constructs#windows).
The OVAL Test Content is currently developed and tested on the 32-bit version of Apple Mac OSX 10.6. [Supported Constructs for Mac OS] (https://github.com/OVALProject/Test-Content/wiki/Supported-Constructs#mac-os).
- Set up Git on your system
- Create a new issue to request a new feature or to report a bug in the OVAL Test Content Tracker
- Fork the OVAL Test Content Repository
- [Make changes] (https://github.com/OVALProject/Test-Content/wiki/Make-Changes) to your fork
- Send a pull request
- [Sync] (https://help.github.com/articles/syncing-a-fork) your fork to get the latest changes
First, extract the OVAL Test Content to a directory of your choice. Then unzip support.zip to the following location depending on the platform of the system being tested.
Windows: C:\support
Linux, Mac OS, Solaris: /tmp/support
Run each of the OVAL Definition documents in the platform directory of the system being tested against your OVAL Definition Evaluator.
Each OVAL Definition document is written to evaluate to true unless otherwise specified.
To request new OVAL Test Content, please add a feature request tracker item, with a brief description of the content that you would like to see created. We will be adding new OVAL Test Content as we implement new features in the OVAL Interpreter, however, if the OVAL Community would like to see certain content get created, we would be happy to accommodate that need.
To report a problem with the OVAL Test Content, please add a [bug tracker] (https://github.com/OVALProject/Test-Content/issues/new?&labels=bug) item, with a brief description of the problem. Please include the platform and version of the OVAL Test Content, the name of the OVAL Definitions document, and the identifier of the affected construct.
The [Useful Links] (https://github.com/OVALProject/Test-Content/wiki/Useful-Links) page contains links to resources that will help with the OVAL Test Content and GitHub among other things.