http://www.fossology.org/ 2010-09-09T04:54:45-06:00 http://www.fossology.org/ http://www.fossology.org/lib/images/favicon.ico text/html 2008-05-08T12:52:27-06:00 http://www.fossology.org/task:add_license_groups?rev=1210272747&do=diff Add license groupsTaskAdd license groups to analysis reportsOwnerNealkTarget0.8.0 License groups will be logical groupings of various licenses known to FOSSology. The project will provide a default set of license groups that seem to make sense to us, but users can define their own license groups arbitrarily. text/html 2008-10-09T10:44:14-06:00 http://www.fossology.org/task:add_modify_licenses_on-the-fly?rev=1223570654&do=diff This is a feature that will allow users to create new licenses based on the results of a license analysis. In the course of reviewing a license analysis report, users may see licenses that are being mis-identified by FOSSology, or that they want to split up in different ways. text/html 2008-09-16T18:38:39-06:00 http://www.fossology.org/task:add_support_for_postgres_8.3?rev=1221611919&do=diff Lots of good reasons to move to 8.3 sooner rather than later. From 2008.08.29 bobg says I ran into yet another reason to get to postgresql 8.3, they finally (actually in 8.2) extended inserts so that you can return the primary key on insert. Before 8.2 (and what we use) "usually" works. In 8.3 we can INSERT INTO ... RETURNING id. The returning clause is a postgres extension to sql. Mysql added this extension quite some time ago. Not sure why it took postgres so long. I would really… text/html 2008-06-25T15:25:45-06:00 http://www.fossology.org/task:agent_selt-test_agent?rev=1214429145&do=diff who: nealk what: Returns a checksum for each license, license.bsam, and agent build revision. (from 2008-06-24 email) This will be compared with the scheduler to detect if an agent is out of date. Agent will also check for access to each of the repo directories in order to make sure full access works. The problems: agent boxes may be different versions, and repo may not be mounted. And we cannot check for mounts since none of our config files identify if the repo is a mount or a local directo… text/html 2009-07-23T13:53:39-06:00 http://www.fossology.org/task:analyze_license_deltas?rev=1248378819&do=diff Package report 1 - List packages and compare found licenses with stated license Package report 2 Same as above but integrated into a standard license report. If the license report is on a package (spec file or deb is available), display the stated license in addition to the found licenses. text/html 2010-07-14T16:14:40-06:00 http://www.fossology.org/task:archive?rev=1279145680&do=diff This page captures a list of tasks that have been completed, and the relevant release info for those tasks. Refer also to: * Task List * Roadmap * Project Team Completed tasks.. * nomos (1.2.0) * buckets (1.2.0) * Cleanup license naming in the new license_ref table (1.2.0) * Package agent (1.2.0) * default agents per user (1.2.0) * Create tests to validate buckets against nomos (1.2.0) * License Browser color coding (1.2.0) * Report Copyrights, URL's, and email … text/html 2009-08-04T09:06:30-06:00 http://www.fossology.org/task:archived_reports?rev=1249398390&do=diff Archived analysis reports It is very useful to be able to create an archived copy of a license analysis (or other types of analysis). Need to know: Is this an archived report or archived license analysis data? If the data is archived the original report could theoretically be regenerated. That is, it could be regenerated as long as the software writing the report hasn't changed significantly. text/html 2009-07-23T15:47:43-06:00 http://www.fossology.org/task:binary_analysis?rev=1248385663&do=diff Binary Analysis for Open Source Discovery Forensic discovery of open source inside of binary files, in particular firmware. text/html 2010-01-07T16:28:31-06:00 http://www.fossology.org/task:buckets?rev=1262906911&do=diff Bucket Description Buckets allow a fossology system administrator to create reporting categories. For example, HP uses categories like “Preferred Licenses”, “SHIP-HOLD Licenses”, “Possibly restrictive licensing terms”, “Commercial Licenses”, ... See the example report Buckets. text/html 2008-08-21T10:56:42-06:00 http://www.fossology.org/task:clean_up_db_schema?rev=1219337802&do=diff Bobg is working on most of this set of tasks: get rid of ufile, review tables (I see unique constraints on columns that can take null), use cascades to remove uploads, ... Specifically: * Remove ufiles in database * Migrate to using nested sets * Change most of the UI code so that it uses these new fields * Change unpack agent to use the new nested sets * Modify scheduler.conf (sqlagent goes away, new agent) * Changing the schema in the init plugin to upgrade an existing installa… text/html 2009-06-08T13:44:40-06:00 http://www.fossology.org/task:combined_copyright_notices_example?rev=1244490280&do=diff EXAMPLE Combined copyright notices, grouped by license MIT-style licenses copyright Steve Karg * Copyright (C) 2005-2008 Steve Karg <skarg@users.sourceforge.net> * Copyright (C) 2007 Steve Karg <skarg@users.sourceforge.net> RS-485 initialization on AT91SAM7S inspired by Keil Eletronik serial.c * Copyright (C) 2007 Steve Karg <skarg@users.sourceforge.net> Portions of the AT91SAM7S startup code were developed by James P Lynch. * Copyright (C) 2007 Steve Karg <skarg@users.sourceforge.net… text/html 2010-07-28T16:56:13-06:00 http://www.fossology.org/task:copyright_author_detection_agent?rev=1280357773&do=diff Copyright, URL & author detection agent Reports: * All the copyrights for Package A * All the files in package A that have copyrights for Mary Doe * With a historical repository, Find all the files that have had their copyrights changed * All files with no copyrights * All email addresses * All url's text/html 2010-08-02T16:50:58-06:00 http://www.fossology.org/task:cp2foss_authentication_error?rev=1280789458&do=diff The bucket agent needs to know what bucketpool to use when it runs. Bucketpool definitions are considered private and defined on a per user basis. The default bucketpool for a user is stored in the user record. Therefore, cp2foss must be able to determine the user identity from the session cookie. text/html 2008-09-16T17:54:07-06:00 http://www.fossology.org/task:create_invisible_license_groups?rev=1221609247&do=diff A conversation within the team led to the following suggestion: "An invisible [license group] would be a way to hide results for licenses that are so permissive as to not really matter. Which licenses do not matter to a given organization will of course vary, however I think we can start with the permissive MIT license, perhaps next the BSD. Reporting the presence of this license amounts to adding noise to the report, possibly obscuring the licenses we are interested in. In addition, what w… text/html 2008-11-20T11:56:11-06:00 http://www.fossology.org/task:create_package_ontology?rev=1227207371&do=diff Package ontology (from paw) Question: What is synonymous to the Debian Package apache2 in RedHat? Answer: httpd, they are both binaries of the Apache http Server from the Apache Software Foundation Did you know that these packages are equivalent? text/html 2008-09-09T13:16:55-06:00 http://www.fossology.org/task:create_rpm_and_deb_distro_packages_for_fossology?rev=1220987815&do=diff Depends on re-write build install system Please announce on mailing list when when rpm is available for testing. (George Pace would like to test.) text/html 2008-09-16T17:46:55-06:00 http://www.fossology.org/task:create_ui_and_automatic_process_for_adding_licenses?rev=1221608815&do=diff On Jun 20, 2008, at 5:01 PM, Daniel Johnson (danijoh2) wrote: Hey all, I sent out an e-mail a week or so ago wondering if it is possible to add license text to the license repository. Further yet, if it will be possible in a future release to run a scan on a given phrase. I hadn't heard anything back so I was just wondering what your thoughts were. I think the e-mail just got lost in the mess. Thanks, Daniel Bobg replies... text/html 2009-11-12T09:58:04-06:00 http://www.fossology.org/task:define_test_implement_full_backup_recovery_process?rev=1258045084&do=diff * FOSSology Data Backup and Restore Scope * FOSSology Data Backup and Restore Design * FOSSology Data Backup and Restore Testing * FOSSology Data Backup and Restore Instruction - All Files * FOSSology Data Backup and Restore Instruction - Gold Files text/html 2009-10-14T14:41:58-06:00 http://www.fossology.org/task:define_test_implement_full_backup_recovery_process_for_rfo?rev=1255552918&do=diff FOSSology Backup and Restore Scope Implement and document backup and restore Fully implement and document how to backup and restore a running fossology system including database, repository, and any necessary system configuration specific to fossology. text/html 2008-07-16T10:24:36-06:00 http://www.fossology.org/task:develop_automated_test_suite?rev=1216225476&do=diff Develop Automated Test Suite This task captures our need for automated test tools that can be released with FOSSology. (HP has a handful of tests/tools that we use internally, but either we're unable to release, or they're very immature and need cleaning up/growing up). text/html 2009-02-25T14:28:21-06:00 http://www.fossology.org/task:e-mail_notification?rev=1235597301&do=diff Problem Discovering licenses, or any other FOSSology analysis, is usually done as a set of background processes managed by the scheduler. Because of this, there needs to be a way of notifying users when their job is done. Continually checking the jobs display does not meet this need today. text/html 2009-01-29T12:24:19-06:00 http://www.fossology.org/task:enabling_plugins?rev=1233257059&do=diff To facilitate more plugin selectivity, create plugins-available/ and plugins-enabled directories. Like apache, the enabled plugins should be a symlink from plugins-available/. An admin > plugins ui could make it easy to create/delete the symlinks (enable/disable plugins). This ui could eventually have some smarts on what plugins are available and make it easy to install them. text/html 2008-05-06T10:44:44-06:00 http://www.fossology.org/task:fix_for_large_repositories?rev=1210092284&do=diff Fix for large reposTaskImplement bug fixes for very large reposOwnerBob GobeilleTarget0.8.0 This task will implement the collection of bugfixes we've identified that prevent database timeouts and other issues with jobs not being run when the file repository grows extremely large (on the order of several Linux distros, or around 100+GB of stuff). text/html 2010-04-09T11:50:16-06:00 http://www.fossology.org/task:fo_permission_scheme_needs_improvement?rev=1270835416&do=diff This enhancement was prompted by an email query from a FO user about how to give full analysis access without allowing the user to change job prioritization. See the thread here for details. text/html 2009-11-11T02:21:43-06:00 http://www.fossology.org/task:fossology_data_backup_and_restore_design?rev=1257931303&do=diff Backup and restore entire repository solution tasks This solution implement a full backup strategy, will backup entire repository include gold, file, license directory. Suggest user if you have enough disk space, we recommend user to use this backup solution. text/html 2010-01-21T10:59:52-06:00 http://www.fossology.org/task:fossology_data_backup_and_restore_instruction_-_all_files?rev=1264096792&do=diff Introduction This document is designed to help you backup and restore the FOSSology repository and Postgres database for FOSSology. It's intended audience is the system administrator who wants to quickly backup and restore a FOSSology system. This document is arranged as follows: text/html 2009-11-20T02:22:15-06:00 http://www.fossology.org/task:fossology_data_backup_and_restore_instruction_-_gold_files?rev=1258708935&do=diff Introduction This document is designed to help you backup and restore FOSSology system use backup only gold files repository solution. Its intended audience is the system administrator who wants to quickly backup and restore a FOSSology system. This document is arranged as follows: text/html 2009-11-12T10:01:34-06:00 http://www.fossology.org/task:fossology_data_backup_and_restore_testing?rev=1258045294&do=diff What is the test plan for testing backup & restore? text/html 2009-07-20T11:31:04-06:00 http://www.fossology.org/task:generate_meaningful_urls?rev=1248111064&do=diff Generate meaningful URLs (from paw) ---------- Let me find software files by using the URL and pasting in the path I want to see e.g. here are three different ways a URL can locate identical resources, the bottom two are useful to humans: * This is the current way, and tells me nothing: text/html 2008-07-09T10:02:24-06:00 http://www.fossology.org/task:group_authentication?rev=1215619344&do=diff If we have user accounts, we need user groups. User accounts let the user have their own top of browse tree. Group owners see all the browse trees of all the users in their group. This one needs more thinking about since it may involve a new data access layer in fossology. text/html 2009-02-27T14:55:37-06:00 http://www.fossology.org/task:how_to_write_agents_plugins_tutorial_with_examples?rev=1235771737&do=diff Notes for tutorial section A module is some functionality that is added to FOSSology. To get started extending FOSSology, let's go through a series of working examples: * Hello World UI plugin (mary) * UI plugin - more detailed description of FO-plugin and referring the reader to docs for additional functionality * Advanced UI plugin (mary) * Explanation of API (rando) * Add agent to Advanced UI plugin (mary) * Explanation of wc agent (mary) * Explanation of SQL Agent and She… text/html 2008-09-16T18:20:14-06:00 http://www.fossology.org/task:implement_automated_nightly_builds?rev=1221610814&do=diff In addition to the obvious (run the build, run the test suite, report the status), taggart added this suggestion: 2008.08.18: We [should] setup a machine at OSU for doing automated build/install/ test and that machine can also run schemaspy on a HEAD install via cron on a regular basis. text/html 2010-01-29T15:47:56-06:00 http://www.fossology.org/task:implement_nomos_license_analysis_agent_in_fossology?rev=1264805276&do=diff Nomos is a new heuristic based license analyzer. It is based on small phrases and phrases relative to other phrases. Preliminary benchmark results show nomos to be significantly faster than our current algorithm, bsam. text/html 2010-07-29T11:48:25-06:00 http://www.fossology.org/task:implement_single_sign-on?rev=1280425705&do=diff Update: Talked with Scott on 7/27/2010. This requirement is not needed for 1.3. It is a longer term requirement that could be part of 2.0. Some scheme will be needed in the future when fossology is opened up to the general HP population. The requirement can be restated as follows: text/html 2010-08-02T16:19:44-06:00 http://www.fossology.org/task:integrate_distrodb_distro_package_reports?rev=1280787584&do=diff The goal of this tool (web page) is to compare one file tree to another. This needs some pictures, but imagine that you are browsing a file tree (iso, bz2, single file, ...). Call it treeA. * Pick another tree to compare it to. Call it treeB. BTW, this only makes sense if you are comparing two versions of the same package/iso/etc. * Apply a subtraction filter to reduce the items you are viewing. Four filters are immediately useful: * Subtract all files that are unchanged (have same … text/html 2008-05-02T10:12:43-06:00 http://www.fossology.org/task:investigate_license_matches_for_invariant_sections?rev=1209744763&do=diff I'm going to want to analyze all of our license matches to find out if there are invariant parts of each license. For example, for all the “GPL v2 ref” matches, are there tokens that are in all (or most of) the matches. Some uses for this are: text/html 2008-06-05T14:06:22-06:00 http://www.fossology.org/task:license_terms_agent?rev=1212696382&do=diff License Terms will refine the set of results produced by the bSAM agent. 6/5 - about 40% currently finds terms; need to populate terms needs to store rsults in db modify existing UI to display results needs to be incorporated into one-shot analysis text/html 2008-06-19T14:19:25-06:00 http://www.fossology.org/task:load_test_the_ui?rev=1213906765&do=diff How many concurrent users, connections can the UI sustain? text/html 2010-07-14T15:54:00-06:00 http://www.fossology.org/task:nomos?rev=1279144440&do=diff Heuristic based license analyzer (based on small phrases and phrases relative to other phrases). We are porting the nomos code developed by Glen Foster into FOSSology. * Preliminary results show nomos to be 20x faster than bsam. * Need a way to add licenses to nomos without recompiling text/html 2008-05-29T14:01:32-06:00 http://www.fossology.org/task:package_search?rev=1212091292&do=diff Package search initially to be based on Fedora; (later we can incorporate Debian control files) text/html 2008-11-20T11:58:37-06:00 http://www.fossology.org/task:provide_analysis_to_osi_license_proliferation_sub-group?rev=1227207517&do=diff This is an engagement bobg is working on with the Open Source Initiative, see <http://www.opensource.org/proliferation-report> According to bobg, “We can help them out with some specific queries – not something FO needs to do itself, but helpful for the usage of FO; High priority (NOW is when this stuff is being discussed)” text/html 2008-05-22T13:29:23-06:00 http://www.fossology.org/task:re-structure_documentation_for_0.8.0?rev=1211484563&do=diff Re-structure docsTask Re-structure and update docs for the 0.8 releaseOwner MikeRTarget 0.8.0 The project documentation on the website are only current to 0.6.1 and do not adequately document the new UI as of 0.7.0, or license groups as of 0.8.0. This will require updating the docs, as well as organizing them a little better for more intuitive reading. text/html 2008-07-17T12:10:56-06:00 http://www.fossology.org/task:re-write_build_install_system?rev=1216318256&do=diff Re-write build & install system Task Re-write the build & install systems Owner Matt Taggart Target 0.10.0 The current makefile structure and all the installation scripts were cooked up by the project with the intent of getting a working build & install in place, rather than necessarily doing the “right thing” from the start. text/html 2008-04-11T11:37:27-06:00 http://www.fossology.org/task:re-write_web_gui?rev=1207935447&do=diff Re-write Web GUI Task Re-write the entire web-gui Owner Neal Krawetz Notes see below The GUI released in versions 0.6.0 and 0.6.1 leaves a lot to be desired. For one thing, it is totally heterogeneous, non-modular and difficult to maintain and customize. text/html 2008-07-09T10:17:00-06:00 http://www.fossology.org/task:report_a_package_s_declared_license?rev=1215620220&do=diff Report a package's declared license (from paw) Provide the declared license for a given package. e.g. * what is the declared license for apache2? Ans: Apache Software License v2.0 * what is the version of the latest stable release of gcc, and what is the license? Ans: March 5, 2008 GCC 4.3.0, GPL v3.0 or later * show me a coverage tree that represents both the structure and the licenses that are found text/html 2009-01-06T11:53:20-06:00 http://www.fossology.org/task:report_on_a_slice_of_the_repo?rev=1231268000&do=diff Report on a 'slice' of the repo (from paw) Search for a 'set' of files, such as 'all/some/one changelog.Debian.gz in Ubuntu Edgy', or show the results of a license analysis of all/some/one the files in the Debian directory /usr/source/doc/'somepackage'/copyright. text/html 2010-05-17T15:46:44-06:00 http://www.fossology.org/task:rest?rev=1274132804&do=diff Goal: Provide a simple HTTP interface for those needing to do their own data access. This is not an sql replacement, or even a simple grammar, but rather a simple method to do common queries while hiding the complexities of sql data retrieval. So far, the only input has been for the need to post a file to a fossology server and return a comma separated list of licenses. You can do that in v 1.2 like this: wget -O - --post-file=myfile.c http://myserv.com/?mod=agent_nomos_once 1) Does the … text/html 2009-01-13T16:11:58-06:00 http://www.fossology.org/task:rpm_for_rhel5?rev=1231888318&do=diff 'requested by:' mattm58 RHEL5u2 was requested, but probably any RHEL5 will suffice. Include RHEl4 support? (Can we rely on packages from yum on RHEL4? probably not...) text/html 2010-07-29T14:33:41-06:00 http://www.fossology.org/task:run_util_on_file?rev=1280435621&do=diff Update from Mark: talked with Scott on 7/27/2010, he could not remember why he was asking for this. It appears that the ability to run a system command from the mini-menu is not really needed. There is still a need to improve/change the way the mini-menu is displayed and constructed. text/html 2009-08-04T16:03:45-06:00 http://www.fossology.org/task:share_data?rev=1249423425&do=diff From Tom Murray: For archive reference/sharing: There are multiple barriers for collecting source code from a dozen locations/product teams (e.g. security, control, network issues, reporting, etc.) throughout a company. But the product teams do not have a problem with sending an archive of their fossology database. Unfortunately the database only contains the analysis and not the actual source code. This is problematic when trying to create a company-wide inventory since the files cannot… text/html 2009-07-20T11:47:11-06:00 http://www.fossology.org/task:stop_running_filter_clean?rev=1248112031&do=diff Notes from bobg, 2008-10-25... The first thing we do in a license analysis is a filter_license. When we’re all done we delete them (in filter_clean). What if we add a new license or make changes? DO we always have to start over with a new filter_license? Bobg thinks the answer is not always… But filter_license runs pretty quickly, in some cases it does need to be re-run. The model we have now works, but may not be the most efficient. Also this is very bSAM-specific. text/html 2009-11-12T09:19:19-06:00 http://www.fossology.org/task:testing_1.2?rev=1258042759&do=diff svn 2368: removed popup and replaced with displayMessage, pass text/html 2008-08-18T13:52:48-06:00 http://www.fossology.org/task:update_release_notes_and_documentation?rev=1219089168&do=diff Notes for 0.10.0 Release Notes: need to include information for existing installations to add 2 new agents (adj2nest and selftest) to the scheduler.conf file. text/html 2009-06-08T13:33:54-06:00 http://www.fossology.org/task:willebrand?rev=1244489634&do=diff The Automated Collection and Presentation of FOSS Notices The following is a collection of requirements from Martin von Willebrand, and others for improving license and copyright reports. * Change “List Files base on License” to display the match % text/html 2009-07-27T09:01:32-06:00 http://www.fossology.org/task:write_comment_plugin?rev=1248706892&do=diff Comment plugin This feature allows people to associate searchable comments to database records: pfile, uploadtree file, upload, license. Possibly any record. Any time a these records are used in a report (eg. license analysis) there would be a link to show the comments (or automatically show the comments) text/html 2008-09-16T18:11:22-06:00 http://www.fossology.org/task:write_dependency_analysis_agent?rev=1221610282&do=diff Some work has been done on this during GSoC 2008 by Kurt Maier (kfx). Bobg says... (from 2008.08.07 email) As some of you know, Kurt (kfx on IRC) has been working on an algorithm for fossology to use in a dependency agent. Here are some of the questions that such an agent (by looking at autoconf files, and source) should be able to answer: 1. what packages use library/file/package X 2. what dependencies (library/file/ package) are not included in package Y 3. what library/file/packages are… text/html 2008-06-19T14:22:57-06:00 http://www.fossology.org/task:write_tar_agent_-_re-tar_arbitrary_parts_of_repo?rev=1213906977&do=diff Given any location in the repository, generate a tarball of everything under it. (JUST the files, not metadata) Why? sometimes users get a file they don't know what to do with... fossology could repackage it for them (thanks to the thoroughness of ununpack)