This page is used to track the process and progress of the R2015a release.
Release Lead Roles
Role | Assignee | Authority/Responsibility |
---|---|---|
Release Manager | SPH | "owns" release, initiates process, creates tracking page, sends daily status updates, tracks issues to completion, makes sure everyone gets their stuff done, brings decisions to CCB/team, maintains tracking page, collects lessons learned, documents process improvements for next release. Must be reachable and preferably in the office during critical stages like creating and testing RCs. |
Build Manager | JJKP or LOJ(?) | controls build system, creates RCs, sends RC availability announcements. Must be reachable and preferably in the office during critical stages like creating and testing RCs. |
Test Manager | TR | control GUI/script testing for each RC. Must be reachable and preferably in the office during critical stages like creating and testing RCs. |
Open Process Questions R2015a
- Consider merging to production and test this before next release process
- Automate installer packaging
- Consider sanity check from mission users' scripts
- Feature Freeze/QA Complete/Beta Test must happen earlier (month before code/App Freeze)
- We need to baseline the test results well before release process starts. Probably at Feature Freeze\QA Freeze
- Consider allowing GATS to produce multiple reports from one test run
- When should we merge with production and baseline tests?
Release Risks
This is a list of all risks (opened and closed) related to smooth release of R2015a.
Owner | Status | Description | Resolution |
---|---|---|---|
RQ | Closed | GMAT function testing is not completed so there could be many unknown issues discovered close to code freeze. | Configured test system to run regression test system in function mode and ran tens of thousands of test. |
JJKP | Open | Many failing event location tests. There may be hidden bugs because issues have not been resolved. | |
DJC | Open | Python interface unstable. Process for testing and integration into nightly build is unclear. | |
SPH | Open | Space weather file not ready for testing and tests are not written. |
Tasks
All dates are referenced to 12:00 noon EDT.
For example, a deadline of March 15 should be interpreted as March 15, 12:00 noon EDT.
Early Tasks
These are long-lead early tasks that can be completed before the detailed release cycle.
Use "(/)
" for the checkmark () and "(x)" for the cross ()
Task | Who | Status | Internal Status | Notes |
---|---|---|---|---|
Review Previous Build Release R2015b Process Notes | All | |||
Obtain Release Approvals | SPH | Done | Done | Needed by release day. |
Get updated legal statement/license | SPH | Done | Done | Needed by Code Freeze. |
Update sample scripts | SPH | Done | Done | Needed by App Freeze.
|
Write draft Release Notes |
SPH | Done | Done | Needed by App Freeze. |
Update standard descriptive text | SPH | Done | Done | Needed by App Freeze. Will be used in User Guide, websites, release announcement. |
Update version number in User Guide cover | JJKP | Done | Done | Needed by App Freeze. Contact Katy Gammage or Mary Hrybyk-Keith to update cover page. Next time: integrate sejda-console to do this automatically. |
Update info on public-facing websites | JJKP | Needed by Release Day. See the list of sites. Update this list as well, if necessary. Updated major sites before announcement. Minor ones can be updated a bit later. | ||
Update release announcement contacts | SPH | Needed by Release Day. Located here. | ||
Put in order for additional icons | SPH | Done | Done | (if necessary) Needed by Visual Freeze. |
For QA Complete (Sept. 16)
QA complete means that all known bugs are being tracked, all bug fixes are verified and documented, and the release process can begin.
Use "(/)
" for the checkmark () and "(x)" for the cross ()
Task | Who | Status | Notes |
---|---|---|---|
Verify that all known bugs are checked into JIRA | (All) | JJKP: SPH: | |
Complete all JIRA verifications | (All) | JJKP: SPH: | |
Complete QA wrap-up tasks | DJC, SPH, JJKP, RQ | JJKP: SPH: | JJKP: Need to run save mode one last time before code freeze. |
Address all JIRA tickets awaiting feedback | (All) | JJKP: SPH: | |
Mark .tc files with requirements and verify traceability to new requirements | (All) | JJKP: SPH: | This is new this year! |
For Visual Freeze (Oct. 5)
Visual Freeze finalizes all graphical changes to the software, so that screenshots, documentation, and TestComplete can be updated.
Use "(/)
" for the checkmark () and "(x)" for the cross ()
Task | Who | Status | Internal Status | Notes |
---|---|---|---|---|
Update About panel | LOJ |
| ||
Update splash screen | TGG |
| ||
Update icons | TGG | SPH: TGG: | SPH: TGG: | If there are any updates, additions, deletions. Including GMATIcon for Welcome Page |
Update gmat_startup_file.txt | JJKP |
| ||
Switch to release configuration in script test system | JJKP |
| ||
Complete visual updates | (All) | SPH: RQ: |
For Code Freeze (Oct. 9)
Code Freeze is a freeze on the software itself before final testing.
Use "(/)
" for the checkmark () and "(x)" for the cross ()
Task | Who | Status | Internal Status | Notes |
---|---|---|---|---|
Update EOP files | WCS | Update eopc04_08.62-now and run smoke tests and SPICE .bpc file | ||
Update tai-utc file & naif LSK | WCS | Update gmat_startup_file with new LSK | ||
Update Info.plist and RunGMAT as needed | WCS | Need copyright and release number/name at least | ||
Update files w/ updated legal statement | LOJ |
| ||
Update license text | LOJ | Update | ||
Update copyright and code headers | LOJ | This tool makes adding paragraphs and changing headers simple. http://sourceforge.net/projects/findandreplace/ As of R2015a these directories have files that need updating. public\src (hpp, cpp) public\plugin (hpp, cpp) public\application\matlab\gmat_keyword (.m) internal\code (hpp,cpp) | ||
Final bug fixes | (All) | |||
Mark all open bugs as Affects: current release | SPH | SPH: |
For this release: Should we branch the repo here, instead of after release? We need to allow people to continue working on unrelated items while release work is ongoing.{warning
(DJC here) A better approach going forward would be to merge master into production, and switch the test system to the production branch. This probably ought to be done right before building RC1. The dev team would have 2 options then:
- Checkout branches based on what they are working on (i.e. checkout production for bug fixes for the release, and their current clone of master – every one is cloning for new work, right? – for ongoing work)
- Alternatively, make bug fixes in master and cherry-pick merge changes into production as bugs are fixed
The former is the better approach, IMO, because it ensures that the bug fix is made on the current code base for the release.
For App Freeze (Oct 9)
App Freeze is a freeze on all application bundle files beyond data and code. This includes documentation, sample scripts, stuff in the extras
folder, etc.
Use "(/)
" for the checkmark () and "(x)" for the cross ()
Task | Who | Status | Notes |
---|---|---|---|
Update README.txt | JJKP | (/) | Update with major release highlights. |
Update extras folder | JJKP | (/) | Notepad++ syntax coloring file |
Update PDF files in docs folder | SPH/DJC | DJC: SPH: |
|
Gather list of compatibility changes since last release | SPH |
| |
Update Release Notes | SPH | ||
Update screenshots in User Guide | (Feature leads) | JJKP: SPH: RQ: DSQ: | |
Test User Guide instructions & code | (Feature leads) | RQ: DSQ: JJKP: SPH: |
SPH: only tested features that changed for which I was FDE |
Update Windows installer package | JJKP | ||
Update links in GMAT.ini | JJKP |
| |
Update link tests in TestComplete | TR |
|
Testing of Release Candidate 1 (Oct 14 - Oct. 28 )
This will start with the 2014-05-05 daily build. Repeat this phase until tests check out. Steve will make the call.
Use "(/)
" for the checkmark () and "(x)" for the cross ()
Task | Who | Status | Notes |
---|---|---|---|
Update README.txt | JJKP | RC1: RC2-RC5: N/A | Next time: this should probably be "Update Release Notes" to add outstanding bugs, etc. |
Build Windows installer | JJKP (backup: TGG) | RC1: RC2: RC2-2: RC3: RC4: RC5: | Version string: R2015a-rc# Next time: build manager should do this |
Bundle Windows zip | JJKP (backup: TGG) | RC1: RC2: RC2-2: RC3: RC4: RC5: | Version string: R2015a-rc# Next time: build manager should do this |
Run TestComplete smoke tests | TR | RC1: | These are tests on the packaged versions of GMAT: the installer and the zip bundle. |
Run TestComplete system test missions | TR | RC1: | These are tests on the packaged versions of GMAT: the installer and the zip bundle. |
Run script test system | JJKP (backup: TGG) | RC1: RC2: RC2-2: RC3: RC4: RC5: | Run the internal installer tests on T4 and the public installer tests on Joel's machine. Run .zip bundle tests afterwards on same build to compare. |
Test all sample scripts | SPH | RC2: RC4: | At a minimum these need to be run individually by hand. I ran them by adding the folder, and they run so fast I missed some pretty big problems. Ideally, these should all be in script regression tests. Many but not all already are regression tested. Or, we should add them to GUI regression system. |
Run TestComplete full regression tests | TR | RC4: RC5: | (For final RC only) |
Notes
- While this cycle is ongoing is a good time to do wiki updates and cleanup.
Stage Release (Oct 30)
This is a soft release, putting all the files in place and updating information. Then on release day, we only need to send the announcements.
Use "(/)
" for the checkmark () and "(x)" for the cross ()
Task | Who | Status | Notes |
---|---|---|---|
Bundle source code | DJC* |
| |
Bundle data | DJC* |
| |
Upload source bundle to SourceForge | JJKP |
| |
Upload data bundle to SourceForge | JJKP |
| |
Upload Windows installer to SourceForge | JJKP | Download, install, and run after uploading. | |
Upload Windows zip to SourceForge | JJKP | Download and run after uploading. | |
Post README.rst.txt on SourceForge | JJKP | Update for new release | |
Upload docs to documentation site | JJKP |
| |
Post internal & public release files to MESA network | JJKP | 2014-05-22: posted internal files only; public files are in build\VS2010_build\R2015a | |
Branch and tag repositories | DJC | At least tag the test system; consider branching also if the burden on the repo is low. | |
Make SourceForge repository backup | JJKP | Follow SourceForge's instructions. Perform the backup on the Linode server and download the resultant .zip file, since the local network blocks rsync. |
* DJC can only do steps 1-3 here because of contractual constraints
Release Day (Nov. 2)
Use "(/)
" for the checkmark () and "(x)" for the cross ()
Task | Who | Status | Notes |
---|---|---|---|
Make files visible on SourceForge | JJKP | 07/21: Made visible at time of posting, as "soft" release. | |
Send out release announcement | SPH |
| |
Post release announcement on SourceForge | SPH* | ||
Post release announcement on GMAT Blog | JJKP | ||
Mark as released in JIRA | SPH | ||
Migrate code to SourceForge repository | JJKP | Do we migrate to git at the same time? |
This needs to be assigned to a different person; DJC cannot post to SF
Post-Release
Use "(/)
" for the checkmark ().
Task | Who | Status | Notes |
---|---|---|---|
Party! | (All) | Plan for week of June 19 | |
Conduct postmortem review | SPH | This includes gathering feedback, holding the postmortem meeting, and documenting the results. | |
Submit GSFC Metrics Summary | WCS | The link to submit the metrics is invalid.No action is required for this item. It was decided on 09/25/14's GMAT meeting to check tasks that do not require any action or are inactive. | |
Submit NTR for next release | SPH | Per Hughes: The NTR cannot be written until all features are finalized and it is too early to do that. |
Notes for postmortem
Please add your notes to the R2015a Lessons Learned document.
Compatibility changes
Creating an RC
- Create the build
- Log into
gs580w-gmat-t4
as "gsfc580gmatbuild
". The credentials are on the network drive, in theInfrastructure
folder. - Start Task Scheduler.
- [RC1 only] Disable the "GMAT Daily Build" task, so it doesn't run automatically during the RC cycle (this can make things overly confusing).
- Manually run the "GMAT Daily Build" task.
- Log into
- Create the bundles
- On your local system, navigate to
GmatDevelopment\build\install\windows-nsis
. Note that you do not need to pull files down from the Git repository; this process will pull files from the remote build and create the packages in your local directory. There's aREADME.txt
file there that explains things. - Open a MinGW, MSYS2, or Cygwin shell in this directory.
- Run '
make assemble VERSION="R2015a-rc#"'
, where "#
" is the number of the RC you're creating. This will create two directories in the current directory:gmat-internal
andgmat-public
. Run the following commands to add the User Guide cover. This requires sejda-console.
sejda-console merge -f ../../../doc/help/src/files/images/Cover-UserGuide-A4-Trimmed.pdf gmat-internal/GMAT/docs/help/help-a4.pdf -o gmat-internal/GMAT/docs/help/help-a4-new.pdf -s all:all: mv gmat-internal/GMAT/docs/help/help-a4-new.pdf gmat-internal/GMAT/docs/help/help-a4.pdf sejda-console merge -f ../../../doc/help/src/files/images/Cover-UserGuide-Letter-Trimmed.pdf gmat-internal/GMAT/docs/help/help-letter.pdf -o gmat-internal/GMAT/docs/help/help-letter-new.pdf -s all:all: mv gmat-internal/GMAT/docs/help/help-letter-new.pdf gmat-internal/GMAT/docs/help/help-letter.pdf sejda-console merge -f ../../../doc/help/src/files/images/Cover-UserGuide-A4-Trimmed.pdf gmat-public/GMAT/docs/help/help-a4.pdf -o gmat-public/GMAT/docs/help/help-a4-new.pdf -s all:all: mv gmat-public/GMAT/docs/help/help-a4-new.pdf gmat-public/GMAT/docs/help/help-a4.pdf sejda-console merge -f ../../../doc/help/src/files/images/Cover-UserGuide-Letter-Trimmed.pdf gmat-public/GMAT/docs/help/help-letter.pdf -o gmat-public/GMAT/docs/help/help-letter-new.pdf -s all:all: mv gmat-public/GMAT/docs/help/help-letter-new.pdf gmat-public/GMAT/docs/help/help-letter.pdf
- Run '
make VERSION="R2015a-rc#"'
, where "#
" is the number of the RC you're creating. This will create four packages in the current directory: A.zip
and a.exe
file for both the internal and public versions. Note: To create only an internal version, run 'make internal VERSION="R2015a-rc#"
'. - Copy the four package files to the network:
\\mesa-file\595\GMAT\Builds\windows\VS2013_build_32\R2015a
- To clean everything up afterwards, run "
make clean
".
- On your local system, navigate to
- Run the script test system on the internal installer package. See Running the script test system, below.
Note: To make the final release bundles, you can't just rename the files to take off the "-rc#" portion. You need to recreate the bundles using this command: make VERSION="R2015a"
Running the script test system
In the steps below, "#
" is the RC number and "<config>
" is "internal
" or "public
".
- Log into
gs580w-gmat-t4
as "gsfc580gmattest
". The credentials are on the network drive, in theInfrastructure
folder. - [RC1 only] Start Task Scheduler and disable the "Run Script Test" task. You'll need to run the RC tests manually.
- Uninstall all previous versions of GMAT.
- Install the version being tested.
- Check "Enable MATLAB interface".
- Leave "Associate file types" unchecked.
- Update the test system repo (located at
C:\Users\gsfc580gmattest\Documents\GmatTest
) - In MATLAB (64-bit):
- Run:
>> cd C:\Users\gsfc580gmattest\Documents\GmatTest\bin
- Run (replace
#
with RC number and<config>
with "internal
" or "public
"):>> diary('..\log\R2015a-rc#-<config>.log')
- Run (this command copies application files such as SPICE kernels needed for regression tests into the new installation of GMAT):
>> preparegmat('C:\Path\To\GMAT')
- In
C:\Users\testuser\Documents\GmatTest\bin
, copy the appropriate template (autorundef.R2015aInternal.template.m
orautorundef.R2015aPublic.template.m
) to a new name (such asautorundef.R2015aRc1Internal.m
) and fill in the values:RunDef.Build
: "R2015a-rc#-<config>
"RunDef.GmatExe
: path to installedGMAT.exe
RunDef.RegressionBuild
: last build date if testing RC1 (look inGmatTest\output
for latest folder, such as2013-07-31
), otherwise, "R2015a-rc#-<config>
"
- Run:
>>gmattest <name of rundef.m>
(e.g.autorundef.R2015aRc1Internal.m
) - Wait until run completes (usually 8+ hours)
- Run:
>>diary('off')
- Run:
- In a Windows
cmd
window, post results to network usingrobocopy
:>robocopy "C:\Users\gsfc580gmattest\Documents\GmatTest\output\R2015a-rc#-<config>" "\\mesa-file\595\GMAT\TestResults\win7\R2015a-rc#-<config>" /E /MT /LOG:%TEMP%\robocopy.txt