Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Script Testing Concepts

...

You can use any Subversion client to download the files. You'll need your NDC credentials to access the server. When you check out the system, you'll see several directories worth of files. Here's a brief overview:

test/
    bin/
        ...misc MATLAB folders...
        gmattest.m                      # The main test system script
        rundef.m                        # The run definition file (see below)
        setup.m                         # Run this before gmattest.m to set up path info
                                        # (or add to your startup.m)
        ...other .m files...            # Old or developmental scripts; ignore

    doc/
        ...developer documentation...
        reqs/                           # This is where your test matrices will go

    extern/
        Commands/
            FRC-1_Optimize/             # These folders will contain the scripts used to
                                        # generate your truth data (such as STK/Connect
                                        # scripts)
            ...other FRC folders...
        Resources/
            FRR-1_SpacecraftOrbitState/ # same as above
            ...other FRR folders...

    input/
        Commands/
            FRC-1_Optimize/
                scripts/                # .tc files and .script files
                truth/                  # .truth files (truth data)
            ...other FRC folders...
        Resources/
            FRR-1_SpacecraftOrbitState/ # same as above
            ...other FRR folders...

    output/                             # This is where the output files, log files, and results
                                        # are stored. They are divided by the build specifier
                                        # (see the Run Definition section) and then by the 
                                        # Commands/Resources structure like the extern and input
                                        # folders.

...

The test system supports options that allow exclusion of plugins, old or under development tests among others.   This enables the test system to be configured to easilyt test different release configurations includinng a full release, a production release, or a public release. 

Code Block
% Tell the test system to run/not run tests tests that have alpha features 
RunDef.SetRunAlphaTests(true);
% Test the test system to run/not run tests that have internal features
RunDef.SetRunInternalTests(true);
% Test test system to exclude tests in folders that
% are either in old or UnderDevelopment
runDefMan.SetRunExcludedFolders(false);
% Pass in RunDef so manager can configure it according to settings above.   
RunDef = runDefMan.PrepareRunDef(RunDef);

Note, the test system identifies tests that are internal and alpha by collecting script snippet names from two functions located in the folder: ScriptTest\bin\testconfig as shown below.  These functions must be updated to include new alpha and internal components so that the test system will skip those tests when requested. 

Code Block
function [alphaResources,alphaCommands,alphaSnippets] = GetAlphaScriptConfig()
% This function returns the names of Resources, Commands, and field names that are alpha. 
Code Block
[internalResources,internalCommands,internalSnippets] = GetInternalScriptConfig()
% This function returns the names of Resources, Commands, and field names that are internal. 

Configuration for Nightly Regression Testing

...