| "Feature" to Test |
Unit (% Coverage) |
Functional (Yes, No, Partial) |
System (Yes, No, Partial) |
2.2.0 Tests |
Tester |
Status |
| Agents |
| Adj2Nest |
tests needed |
tests needed |
N/A |
include tests to verify results in db, DO NOT rely on return codes |
Vincent |
PASS, tested with manual UI and checked results in db |
| Buckets |
|
|
Yes |
rum from command line |
Larry |
Pass |
| Copyright |
Partial |
Partial |
Partial |
run from command line |
Larry |
PASS |
| Delagent |
44% |
Partial |
Partial |
add tests to verify #1053, #1269, #3225, #3681 |
Vincent |
#1053 still not fix; Added functional tests for #1269 and #3225; #3681 test with manual UI tests |
| Mimetype |
49% |
Partial |
|
run from command line |
Larry |
PASS except #4725 |
| Nomos |
|
Partial |
Yes |
manually test nomos w/new license test files |
Bob |
PASS (Non-urgent failed tests were deferred to 2.3.0) |
| Package Agent |
57% |
Partial |
|
run from command line |
Larry |
PASS |
| Scheduler |
Partial |
Yes |
Yes |
|
Bob |
PASS |
| Ununpack |
48% |
Partial |
N/A - automated functional |
add tests to verify results in db/repo, DO NOT rely on return codes |
Vincent |
PASS, test from command line and manual UI test, check results in db/repo |
| Wget_Agent |
14% |
Partial |
N/A - automated functional |
add tests to verify results in db/repo, DO NOT rely on return codes |
Vincent |
PASS except #4707, test from command line and manual UI test, check results in db/repo |
| UI (Please perform tests using IE browser) |
| BucketsDiff |
|
|
Yes |
|
Mary/Larry |
PASS |
| NomosDiff |
|
|
Yes |
|
Mary/Larry |
PASS |
| Homepage |
|
|
Yes |
|
Mary |
PASS |
| Upload |
|
|
yes |
test added to verify #1107; Step 22,upload same package multiple times FAILS; #4335 Upload from server with wildcards FAILS |
Mary/Larry |
PASS (failed tests will be addressed in 2.3.0) |
| Jobs |
|
|
Yes |
|
Mary/Larry |
PASS |
| Search |
|
|
Yes |
tests added to verify #1221; Failed |
Mary/Larry |
PASS (failed test will be addressed in 2.3.0) |
| Browse |
|
|
Yes |
|
Mary/Larry |
PASS |
| License Browse |
|
|
Partial |
preliminary tests created |
Mary/Larry |
PASS |
| Organize |
|
|
Yes |
Scheduler dies when delete folder is requested, #4437 |
Mary/Larry |
PASS (failed test will be addressed in 2.3.0) |
| User Permissions |
|
|
Yes |
|
Larry, Vincent |
PASS |
| Group Permissions |
|
|
Create tests |
add tests to verify new functionality |
Larry, Vincent |
First round testing using uses cases: PASS |
| Upload Permissions |
|
|
Create tests |
add tests to verify new functionality |
Larry, Vincent |
First round testing using uses cases: PASS |
| Admin |
|
|
Yes |
#3393 |
Mary |
PASS |
| Tagging |
|
|
Yes |
tagging tests modified for changes in 2.2.0 |
Mary (Larry) |
PASS |
| Libraries |
| libfossagent |
|
N/A - tested by agent |
N/A - tested by agent/UI |
|
|
PASS |
| libfossrepo |
|
N/A - tested by agent |
N/A - tested by agent/UI |
|
|
PASS |
| libfossscheduler |
Partial? |
N/A - tested by agent |
N/A - tested by agent/UI |
|
|
PASS |
| libfossdb |
Partial? |
N/A - tested by agent |
N/A - tested by agent/UI |
|
|
PASS |
| libTestDB |
|
|
|
|
|
PASS |
| fossconfig |
Partial? |
|
N/A - tested by agent/UI |
|
|
PASS |
| sqlCopy |
|
|
|
|
|
|
| repcopyin |
|
|
|
|
|
|
| repremove |
|
|
|
|
|
|
| Common UI modules |
| common-active.php |
Partial |
|
N/A - tested by UI |
|
|
PASS |
| common-agents.php |
|
|
N/A - tested by UI |
|
|
PASS |
| common-auth.php |
Partial |
|
N/A - tested by UI |
|
|
PASS |
| common-cache.php |
Partial |
|
N/A - tested by UI |
|
|
PASS |
| common-cli.php |
Partial |
|
N/A - tested by UI |
|
|
PASS |
| common-buckets.php |
|
|
N/A - tested by UI |
|
|
PASS |
| common-compare.php |
|
|
N/A - tested by UI |
|
|
PASS |
| common-db.php |
|
|
N/A - tested by UI |
|
|
PASS |
| common-dir.php |
Partial |
|
N/A - tested by UI |
|
|
PASS |
| common-folders.php |
|
|
N/A - tested by UI |
|
|
PASS |
| common-job.php |
|
|
N/A - tested by UI |
|
|
PASS |
| common-license-file.php |
Partial |
|
N/A - tested by UI |
add test to verify #3939 |
|
PASS |
| common-menu.php |
Partial |
|
N/A - tested by UI |
|
|
PASS |
| common-parm.php |
Partial |
|
N/A - tested by UI |
|
|
PASS |
| common-perms.php |
|
|
N/A - tested by UI |
|
|
PASS |
| common.php |
|
|
N/A - tested by UI |
|
|
PASS |
| common-pkg.php |
Partial |
|
N/A - tested by UI |
|
|
PASS |
| common-plugin.php |
|
|
N/A - tested by UI |
|
|
PASS |
| common-repo.php |
|
|
N/A - tested by UI |
|
|
PASS |
| common-scheduler.php |
|
|
N/A - tested by UI |
|
|
PASS |
| common-sysconfig.php |
Partial |
|
N/A - tested by UI |
|
|
PASS |
| common-tags.php |
|
|
N/A - tested by UI |
|
|
PASS |
| common-ui.php |
|
|
N/A - tested by UI |
|
|
PASS |
| bootstrap.php |
|
|
N/A - tested by UI |
|
|
PASS |
| libschema.php |
|
|
N/A - tested by UI |
|
|
PASS |
| Other |
| cp2foss |
|
Needs Automation |
|
#3987 FAIL |
larry |
PASS (failed test will be addressed in 2.3.0) |
| dbcreate |
|
|
|
|
fo-postinstall larry |
PASS |
| fossinit |
|
|
|
|
fo-postinstall larry |
PASS |
| fossjobs |
|
Needs Automation |
|
|
larry |
PASS |
| fo_cli |
|
cli tested via scheduler's functional tests |
N/A - automated functional |
|
Bob |
PASS |
| fo-cleanold |
|
|
N/A - automated functional |
Mary: #3165,fo-cleanold overwrites /etc/cron.d/fossology with /etc/init.d/fossology |
larry/Mary |
PASS |
| schema_export |
|
|
N/A - automated functional |
|
larry |
PASS |
| fo_nomos_license_list |
|
|
|
|
larry |
PASS |
| fo_copyright_list |
|
|
|
|
larry |
PASS |
| RESTful UI for PTS |
|
|
Yes |
|
larry(PTS upgrade?) |
|
| Source Install |
N/A |
Yes |
Yes |
please test clusters, too |
Vincent |
Pass |
| Package Install |
N/A |
Yes |
Yes tested in debian with 2.2.0 package, and migration test from 2.1.1 to 2.2.0 in rhel |
|
larry |
PASS except #4713 #4719 #4707 |
| Cluster Package Install |
N/A |
Yes |
Yes |
|
Vincent |
Pass |
| Package Purge |
N/A |
|
|
FAIL #4731 |
larry |
PASS (failed test will be addressed in 2.3.0) |
| Continuous Integration |
|
|
Yes |
|
|
PASS |
| Migration 2.1.0 -> 2.2.0 |
N/A |
|
Yes |
need unit tests |
Vincent/Larry |
Passed on Rhel6 Debian6 Fedora17 Ubuntu12.04 |
| Migration 2.1.1 -> 2.2.0 |
N/A |
|
Yes |
need unit tests |
Vincent/Larry |
Passed on Debian6(squeeze) Rhel6 Ubuntu12.10 Fedora17 Ubuntu12.04 |
| Cluster Testing |
N/A |
|
Yes |
|
Vincent |
Pass on 1host/1agent source install(svn6492) |
|
| Performance/Load |
N/A |
|
Yes |
|
Mary |
PASS |
| Concurrent User (UI/DB) |
N/A |
|
|
|
|
|
| Dependency Certification |
| PostgreSQL |
N/A |
|
N/A |
|
|
|
| Apache httpd |
N/A |
|
N/A |
|
|
|
| Glib |
N/A |
|
N/A |
|
|
|
| Documentation & Processes |
| Postgresql support definition & process |
N/A |
|
N/A |
|
|
|