Bug #1977

duplicate key value violates when upload a package multiple times sequentially

Added by larry shi about 1 year ago. Updated 8 months ago.

Status:Feedback Start date:05/16/2012
Priority:Normal Due date:
Assignee:Dan Stangel % Done:

0%
Category:Scheduler
Target version:- Estimated time:16.00 hours
Rank:99 Tester:

Description

tested in svn 5862.

using cp2foss to upload a package(kind of 150 M) 3 times sequentially.
several miniutes laster, found 2 packages and one mimetype are failed, several miniutes later, all other agents complete sucessfully execpt these 3 agents.

error msg as following:
pkgagent for upload 1:
2012-05-16 16:55:57 scheduler [17136] :: JOB75.pkgagent[4350.localhost]: "ERROR: pkgagent.c:855, ERROR: duplicate key value violates unique constraint "pkg_deb_pfile_fk_key""
2012-05-16 16:55:57 scheduler [17136] :: JOB75.pkgagent[4350.localhost]: "On: INSERT INTO pkg_deb (pkg_name,pkg_arch,version,maintainer,installed_size,section,priority,homepage,source,summary,description,format,uploaders,standards_version,pfile_fk) values (E'partman-basicmethods',E'all',E'47',E'Debian Install System Team ',296,E'debian-installer',E'optional',E'',E'',E'Basic partition usage methods for partman',E'This package provides partman with two methods to use partitions."
2012-05-16 16:55:57 scheduler [17136] :: JOB75.pkgagent[4350.localhost]: " The first is to format the partition. The second is to keep and use"
2012-05-16 16:55:57 scheduler [17136] :: JOB75.pkgagent[4350.localhost]: " the existing data in the partition as it is.',E'',E'',E'',8506);"
2012-05-16 16:55:57 scheduler [17136] :: JOB75.pkgagent[4350.localhost]: agent failed, code: 255

pkgagent upload 2:
2012-05-16 16:55:57 scheduler [17136] :: JOB68.pkgagent[4320.localhost]: "ERROR: pkgagent.c:855, ERROR: duplicate key value violates unique constraint "pkg_deb_pfile_fk_key""
2012-05-16 16:55:57 scheduler [17136] :: JOB68.pkgagent[4320.localhost]: "On: INSERT INTO pkg_deb (pkg_name,pkg_arch,version,maintainer,installed_size,section,priority,homepage,source,summary,description,format,uploaders,standards_version,pfile_fk) values (E'openssh-client',E'i386',E'1:5.5p1-6',E'Debian OpenSSH Maintainers ',2092,E'net',E'standard',E'http://www.openssh.org/',E'openssh',E'secure shell (SSH) client, for secure access to remote machines',E'This is the portable version of OpenSSH, a free implementation of"
2012-05-16 16:55:57 scheduler [17136] :: JOB68.pkgagent[4320.localhost]: " the Secure Shell protocol as specified by the IETF secsh working"
2012-05-16 16:55:57 scheduler [17136] :: JOB68.pkgagent[4320.localhost]: " group."
2012-05-16 16:55:57 scheduler [17136] :: JOB68.pkgagent[4320.localhost]: " ."
2012-05-16 16:55:57 scheduler [17136] :: JOB68.pkgagent[4320.localhost]: " Ssh (Secure Shell) is a program for logging into a remote machine"
2012-05-16 16:55:57 scheduler [17136] :: JOB68.pkgagent[4320.localhost]: " and for executing commands on a remote machine."
2012-05-16 16:55:57 scheduler [17136] :: JOB68.pkgagent[4320.localhost]: " It provides secure encrypted communications between two untrusted"
2012-05-16 16:55:57 scheduler [17136] :: JOB68.pkgagent[4320.localhost]: " hosts over an insecure network. X11 connections and arbitrary TCP/IP"
2012-05-16 16:55:57 scheduler [17136] :: JOB68.pkgagent[4320.localhost]: " ports can also be forwarded over the secure channel."
2012-05-16 16:55:57 scheduler [17136] :: JOB68.pkgagent[4320.localhost]: " It can be used to provide applications with a secure communication"
2012-05-16 16:55:57 scheduler [17136] :: JOB68.pkgagent[4320.localhost]: " channel."
2012-05-16 16:55:57 scheduler [17136] :: JOB68.pkgagent[4320.localhost]: " ."
2012-05-16 16:55:57 scheduler [17136] :: JOB68.pkgagent[4320.localhost]: " This package provides the ssh, scp and sftp clients, the ssh-agent"
2012-05-16 16:55:57 scheduler [17136] :: JOB68.pkgagent[4320.localhost]: " and ssh-add programs to make public key authentication more convenient,"
2012-05-16 16:55:57 scheduler [17136] :: JOB68.pkgagent[4320.localhost]: " and the ssh-keygen, ssh-keyscan, ssh-copy-id and ssh-argv0 utilities."
2012-05-16 16:55:57 scheduler [17136] :: JOB68.pkgagent[4320.localhost]: " ."
2012-05-16 16:55:57 scheduler [17136] :: JOB68.pkgagent[4320.localhost]: " In some countries it may be illegal to use any encryption at all"
2012-05-16 16:55:57 scheduler [17136] :: JOB68.pkgagent[4320.localhost]: " without a special permit."
2012-05-16 16:55:57 scheduler [17136] :: JOB68.pkgagent[4320.localhost]: " ."
2012-05-16 16:55:57 scheduler [17136] :: JOB68.pkgagent[4320.localhost]: " ssh replaces the insecure rsh, rcp and rlogin programs, which are"
2012-05-16 16:55:57 scheduler [17136] :: JOB68.pkgagent[4320.localhost]: " obsolete for most purposes.',E'',E'',E'',13546);"
2012-05-16 16:55:57 scheduler [17136] :: JOB68.pkgagent[4320.localhost]: agent failed, code: 255

mimtype for upload 3:
2012-05-16 16:55:49 scheduler [17136] :: JOB59.mimetype[4338.localhost]: "ERROR: finder.c:121, ERROR: duplicate key value violates unique constraint "dirmodemask""
2012-05-16 16:55:49 scheduler [17136] :: JOB59.mimetype[4338.localhost]: "On: INSERT INTO mimetype (mimetype_name) VALUES ('text/x-c++');"
2012-05-16 16:55:49 scheduler [17136] :: JOB59.mimetype[4338.localhost]: agent failed, code: 255

duplicate_key_violate.png (54.8 kB) larry shi, 05/16/2012 03:49 pm

History

#1
Updated by larry shi about 1 year ago

#2
Updated by larry shi about 1 year ago

  • Target version changed from 2.1.0 to 2.0.1

tested in 5862.
also I uploaded more than 20 uploads at the same time via run phpunit src/cli/tests/test_cp2foss.php many times.
after a while the scheduler stopped,
found one msg in /var/log/messages, I mentioned it in monday meeting,
it is :
May 16 23:32:32 bl460c-10 kernel: [42060.420118] fo_scheduler17136: segfault at 1c ip 0000000000409a70 sp 00007fffb6d2ddb8 error 4 in fo_scheduler[400000+15000]

at this timeļ¼Œ if you try to restart scheduler, error msg
from the command line, 

kernel:[  586.060524] Call Trace:

Message from syslogd@bl460c-10 at May 15 15:29:45 ...
kernel:[ 586.060524] Code: 24 20 48 8b 6f 10 48 89 f7 4c 8b b5 58 02 00 00 f3 ab 8a 45 41 88 44 24 50 49 8d 46 20 48 89 44 24 08 49 8b 46 20 48 8b 54 24 08 <48> 89 44 24 2c 48 8b 42 08 48 89 46 14 49 8b 06 48 89 44 24 3c

have to kill all the agents in ps -ef manually, then drop the db and recreate db.
any clue?

#3
Updated by Paul Holland 12 months ago

  • Assignee set to larry shi
  • IterNum set to 2

#4
Updated by larry shi 12 months ago

  • Status changed from New to In Progress

#5
Updated by larry shi 12 months ago

  • Estimated time set to 16.00

#6
Updated by larry shi 12 months ago

  • Status changed from In Progress to Resolved

fixed in svn 5929.

#7
Updated by larry shi 10 months ago

  • Status changed from Resolved to Feedback
  • Assignee changed from larry shi to Dan Stangel
  • IterNum changed from 2 to 6

thanks for your testing and verify.

#8
Updated by Dan Stangel 10 months ago

  • Estimate set to 2

#9
Updated by Mary Laser 9 months ago

  • Target version deleted (2.0.1)

#10
Updated by Bob Gobeille 8 months ago

  • Rank set to 99

Change unranked issues to rank 99 so they show up in a ranking report at the bottom. Otherwise, they show up on top.

Also available in: Atom PDF