The Puppet Labs Issue Tracker has Moved: https://tickets.puppetlabs.com

Bug #12857

Mirroring the apt repository with rsync not working properly

Added by Max Mueller about 2 years ago. Updated about 2 years ago.

Status:ClosedStart date:02/28/2012
Priority:LowDue date:
Assignee:Matthaus Owens% Done:

0%

Category:RepositorySpent time:-
Target version:-
Patch:None Branch:
Keywords:

We've Moved!

Ticket tracking is now hosted in JIRA: https://tickets.puppetlabs.com

This issue is currently not available for export. If you are experiencing the issue described below, please file a new ticket in JIRA. Once a new ticket has been created, please add a link to it that points back to this Redmine ticket.


Description

Ubuntu LTS 10.04


root@repo:~# rsync --version
rsync  version 3.0.7  protocol version 30
Copyright (C) 1996-2009 by Andrew Tridgell, Wayne Davison, and others.
Web site: http://rsync.samba.org/
Capabilities:
    64-bit files, 64-bit inums, 64-bit timestamps, 64-bit long ints,
    socketpairs, hardlinks, symlinks, IPv6, batchfiles, inplace,
    append, ACLs, xattrs, iconv, symtimes

rsync comes with ABSOLUTELY NO WARRANTY.  This is free software, and you
are welcome to redistribute it under certain conditions.  See the GNU
General Public Licence for details

Trying to mirror the apt repository results in the following (commandline from http://apt.puppetlabs.com/README.txt) :



root@repo:~# rsync -av --stats --progress --copy-links --del rsync://apt.puppetlabs.com/packages/apt/ /package-mirror/puppetlabs/
receiving incremental file list
symlink has no referent: "/apt/enterprise/dists/1.1/lenny" (in packages)
symlink has no referent: "/apt/enterprise/dists/1.1/lucid" (in packages)
symlink has no referent: "/apt/enterprise/dists/1.2/lenny" (in packages)
symlink has no referent: "/apt/enterprise/dists/1.2/squeeze" (in packages)
symlink has no referent: "/apt/enterprise/dists/1.2/lucid" (in packages)
IO error encountered -- skipping file deletion

Number of files: 1691
Number of files transferred: 0
Total file size: 927314794 bytes
Total transferred file size: 0 bytes
Literal data: 0 bytes
Matched data: 0 bytes
File list size: 52190
File list generation time: 0.001 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 260
Total bytes received: 53547

sent 260 bytes  received 53547 bytes  15373.43 bytes/sec
total size is 927314794  speedup is 17234.09
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1526) [generator=3.0.7]

History

#1 Updated by Kelsey Hightower about 2 years ago

  • Category set to Repository
  • Status changed from Unreviewed to Investigating
  • Assignee set to Kelsey Hightower
  • Priority changed from Normal to Low

Max,

Thanks for reporting this issue. I’ll get this over to our release management team as a feature request.

#2 Updated by Kelsey Hightower about 2 years ago

  • Assignee changed from Kelsey Hightower to Matthaus Owens

Reassigning for better visibility.

#3 Updated by Zach Leslie about 2 years ago

It appears to mirror more than necessary, but the rsync command in the README.txt seems to work well for me.

#4 Updated by Matthaus Owens about 2 years ago

  • Status changed from Investigating to Closed

Thanks for the report. We’ve updated our rysnc daemon to exclude more of that directory, so you shouldn’t see those errors. Please let us know if you’re still experiencing issues.

Also available in: Atom PDF