FOSSology

Adding some notes about what needs to be done to complete this backlog item:

Summary:

The FOSSology continuous integration system (Jenkins) should automatically install the nightly build packages every day, and validate that they installed without errors.

Background

We already have a nightly automated job in Jenkins to generate new Linux distro packages from top of tree. This job can be seen here (Sorry, internal link only): http://fotest.fc.hp.com:8080/job/Fossology_Package_Build/ (The only thing this job does is execute the script
trunk/fossology/utils/runBuild_v2.0.php)

When this script completes, it copies all of the new packages into a web-accessible location at (Sorry, internal link only):

http://fobuild.fc.hp.com/fossology/2.0.1/testing/current/

(Note: We should probably change the name of these to something other than "2.0.1" to avoid any confusion, such as "2.2.0~testing")

What needs to happen is we need another automated Jenkins job that is run after the packages have been built, to execute a package install for each of the Linux distro platforms.

Current Environment

We already have VMware virtual machines set up for package install testing. These are available (sorry, only project internal at the moment) at:

fo-ubuntu-1204-32.fc.hp.com
fo-ubuntu-1204-64.fc.hp.com
fo-ubuntu-1210-32.fc.hp.com
...
fo-fedora-17-32.fc.hp.com
...
fo-centos-6-64.fc.hp.com
...
etc., etc..

These VMs should be used to test the packages. ALTERNATIVELY, if it is easier/faster to do, please feel free to create KVM VM's or any other mechanism that you find easy and simple to set up and administer. The VM platform really does not matter, as long as the VMs are available and can be used for testing.

The idea of the nightly package install test is something like this:

1. Create a VM, install with the Linux distro of interest (e.g. Ubuntu 12.10 x86_64)

2. Once the base OS has been installed and configured to work in the environment, but BEFORE any other actions are taken on the VM, create a snapshot of the Initial OS Install. This snapshot will be used at the start of every test.

3. Before beginning the FOSSology package install test, revert the VM to this Initial OS Install snapshot.

4. Use the native distro package manager tool (i.e. 'yum' for Fedora/CentOS, 'apt' for Debian/Ubuntu) to point to the nightly package build repository. Install the package using the native package manager (i.e., 'sudo apt-get install fossology', or 'sudo yum install fossology').

5. Just scan the console output for any sign of problems, such as "ERROR" or "FAILURE". the native Jenkins console output parser should be sufficient for this task, at least initially. Later on we can go back to add more sophisticated error checking, and we can add additional post-installation tests. But for now, we just need to check that the package appears to install without any errors.

6. That's it. Do this for every flavor of distro that we generate packages for.

Note

We already had a package install test automation job set up for the 2.0.0 release a long time ago. The tool is still around, and it may be useful to modify and update the existing scripts rather than start fresh. (Or it may not be useful...). The existing package install automation job can be seen here (sorry, internal link only):

http://fotest.fc.hp.com:8080/job/Fossology_Package_Install/

Note: This is a Jenkins "Matrix job" which should run the test on several Jenkins slave agents simultaneously. This job executes the script

trunk/fossology/src/testing/install/pkgConfig.php

(and the associated files in trunk/fossology/src/testing/install)

If we plan to use this script, we will need to make extensive changes to it to account for new package locations, new VM hostnames, etc., etc.. but it may be a useful starting point.

thanks dan

Check from here: http://fotest.fc.hp.com:8080/job/Fossology_Package_Install/

For now I didn't open the email notification.