Mercurial > treepkg
annotate bin/publishpackages.py @ 440:383d23c6bfde
Merged revisions 346-386 via svnmerge from
svn+ssh://svn.wald.intevation.org/treepkg/branches/treepkg-status
........
r346 | bricks | 2010-07-07 17:40:48 +0200 (Mi, 07 Jul 2010) | 2 lines
added classed for treepkg status xml generation
........
r347 | bricks | 2010-07-08 12:07:39 +0200 (Do, 08 Jul 2010) | 10 lines
renamed new status dir to info because of a naming conflict with status.py
let the user specify a treepkg name in the config
the name is propagated to PackagerGroup
[treepkg]
name: <treepkgname>
becomes:
pg = PackagerGroup(...)
pg.name
........
r348 | bricks | 2010-07-08 15:25:07 +0200 (Do, 08 Jul 2010) | 3 lines
moved test file to test main dir
fixed missing : after def statement
........
r349 | bricks | 2010-07-08 17:59:52 +0200 (Do, 08 Jul 2010) | 2 lines
added treepkg_dir andd tracks_dir attributes to PackageGroup
........
r350 | bricks | 2010-07-08 18:00:32 +0200 (Do, 08 Jul 2010) | 2 lines
changed <millpath> to <trackspath>
........
r351 | bricks | 2010-07-08 18:08:39 +0200 (Do, 08 Jul 2010) | 2 lines
check if config file exists to get usefull error output
........
r352 | bricks | 2010-07-08 18:11:13 +0200 (Do, 08 Jul 2010) | 2 lines
write first info about tracks
........
r353 | bricks | 2010-07-09 12:20:49 +0200 (Fr, 09 Jul 2010) | 2 lines
get all log files
........
r354 | bricks | 2010-07-09 14:42:42 +0200 (Fr, 09 Jul 2010) | 2 lines
added md5sum function
........
r355 | bricks | 2010-07-09 15:15:15 +0200 (Fr, 09 Jul 2010) | 4 lines
implemented nearly all info
only arch and os info are missing
........
r356 | bricks | 2010-07-09 16:19:17 +0200 (Fr, 09 Jul 2010) | 2 lines
Bugfix: source was not defined
........
r357 | bricks | 2010-07-09 16:44:52 +0200 (Fr, 09 Jul 2010) | 3 lines
fixed some typos
added missing add_checksum methond
........
r358 | bricks | 2010-07-09 17:06:15 +0200 (Fr, 09 Jul 2010) | 2 lines
fixed status line for revision
........
r359 | bricks | 2010-07-12 14:10:34 +0200 (Mo, 12 Jul 2010) | 2 lines
let the user specify num revisions that should be shown in the info
........
r360 | bricks | 2010-07-12 14:21:39 +0200 (Mo, 12 Jul 2010) | 2 lines
missed in last commit
........
r361 | bricks | 2010-07-12 17:06:22 +0200 (Mo, 12 Jul 2010) | 2 lines
add os config statement
........
r362 | bricks | 2010-07-12 17:47:42 +0200 (Mo, 12 Jul 2010) | 3 lines
moved packages and logs to revision tag
implemented os and arch info
........
r363 | bricks | 2010-07-13 14:23:28 +0200 (Di, 13 Jul 2010) | 2 lines
updated test readconfig for os config variable
........
r364 | bricks | 2010-07-13 14:24:14 +0200 (Di, 13 Jul 2010) | 2 lines
moved common publish functions to a seperate module
........
r365 | bricks | 2010-07-13 16:26:11 +0200 (Di, 13 Jul 2010) | 2 lines
moved arch info to each package info
........
r366 | bricks | 2010-07-13 18:46:17 +0200 (Di, 13 Jul 2010) | 2 lines
inital checkin for new publishpackages processing
........
r367 | bricks | 2010-07-21 17:52:15 +0200 (Mi, 21 Jul 2010) | 2 lines
implemented parsing from xml string
........
r368 | bricks | 2010-07-22 12:17:42 +0200 (Do, 22 Jul 2010) | 2 lines
copy binary-all packages in all binary-xyz dirs
........
r369 | bricks | 2010-07-22 12:26:40 +0200 (Do, 22 Jul 2010) | 2 lines
fixed small bugs
........
r370 | bricks | 2010-07-22 13:02:36 +0200 (Do, 22 Jul 2010) | 2 lines
added a new root element which is called TreepkgRoot for Treepkg Info classes
........
r371 | bricks | 2010-07-22 13:09:52 +0200 (Do, 22 Jul 2010) | 3 lines
fixed some small issues
remember: run pychecker BEFORE the commit
........
r372 | bricks | 2010-07-22 18:01:43 +0200 (Do, 22 Jul 2010) | 2 lines
improved publishdebianpackages and fixed a lot of bugs in the xml info parsing part
........
r373 | bricks | 2010-07-23 18:40:38 +0200 (Fr, 23 Jul 2010) | 2 lines
implemented CacheDb to store copied Packages from build host
........
r374 | bricks | 2010-07-26 10:28:48 +0200 (Mo, 26 Jul 2010) | 2 lines
moved data handling in publishdebianpackages into seperate module
........
r375 | bricks | 2010-07-26 11:42:07 +0200 (Mo, 26 Jul 2010) | 2 lines
fixed some typos
........
r376 | bricks | 2010-07-26 12:12:40 +0200 (Mo, 26 Jul 2010) | 2 lines
first version of incremental copying debian packages to cachedir
........
r377 | bricks | 2010-07-26 14:58:50 +0200 (Mo, 26 Jul 2010) | 2 lines
incremental copying only changed debian packages
........
r378 | bricks | 2010-07-26 15:39:10 +0200 (Mo, 26 Jul 2010) | 3 lines
use md5 instead of hashlib module
(md5 is deprecated in favour of hashlib in python 2.5)
........
r379 | bricks | 2010-07-26 15:46:19 +0200 (Mo, 26 Jul 2010) | 2 lines
make treepkg compatible to python 2.4
........
r380 | bricks | 2010-07-26 15:50:49 +0200 (Mo, 26 Jul 2010) | 2 lines
fixed last commit (db instead of sqlite3)
........
r381 | bricks | 2010-07-27 10:54:15 +0200 (Di, 27 Jul 2010) | 2 lines
fixed wrong import statement
........
r382 | bricks | 2010-07-27 10:54:34 +0200 (Di, 27 Jul 2010) | 2 lines
removed unnecessary debug output
........
r383 | bricks | 2010-07-27 18:28:22 +0200 (Di, 27 Jul 2010) | 2 lines
check if upload hook is empty
........
r384 | bricks | 2010-07-28 09:35:21 +0200 (Mi, 28 Jul 2010) | 2 lines
run rsync only an arch dirs that are present in the current treepkg
........
r385 | bricks | 2010-07-28 09:35:54 +0200 (Mi, 28 Jul 2010) | 2 lines
add helper tool to list content of a cache db
........
r386 | bricks | 2010-07-28 10:33:48 +0200 (Mi, 28 Jul 2010) | 3 lines
fixed a typo
regex fails if option is empty
........
| author | Bjoern Ricks <bricks@intevation.de> |
|---|---|
| date | Fri, 06 Aug 2010 13:28:47 +0000 |
| parents | 25d702bb13f9 c7f4da26f1d4 |
| children | eadcb1bb54e2 |
| rev | line source |
|---|---|
|
287
1fcdffbeb9de
Make the #! line in the commands more portable. Use /usr/bin/python
Bernhard Herzog <bh@intevation.de>
parents:
263
diff
changeset
|
1 #! /usr/bin/python |
|
247
55337021fe5b
Mention rules revision in text of --revision parameter of bin/publishpackages.py
Bernhard Herzog <bh@intevation.de>
parents:
200
diff
changeset
|
2 # Copyright (C) 2007, 2008, 2009 by Intevation GmbH |
|
89
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
3 # Authors: |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
4 # Bernhard Herzog <bh@intevation.de> |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
5 # |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
6 # This program is free software under the GPL (>=v2) |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
7 # Read the file COPYING coming with the software for details. |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
8 |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
9 """Publishes selected packages created by treepkg""" |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
10 |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
11 import sys |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
12 import os |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
13 import shutil |
|
256
8052aabada8b
Make publishpackages.py work for automated regular publishing of the
Bernhard Herzog <bh@intevation.de>
parents:
249
diff
changeset
|
14 import shlex |
|
89
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
15 from optparse import OptionParser |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
16 from ConfigParser import SafeConfigParser |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
17 |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
18 import treepkgcmd |
|
256
8052aabada8b
Make publishpackages.py work for automated regular publishing of the
Bernhard Herzog <bh@intevation.de>
parents:
249
diff
changeset
|
19 from treepkg.readconfig import read_config_section, convert_bool |
|
89
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
20 from treepkg.run import call, capture_output |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
21 from treepkg.cmdexpand import cmdexpand |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
22 from treepkg.util import ensure_directory, listdir_abs |
|
421
c7f4da26f1d4
fixed wrong import statement
Bjoern Ricks <bricks@intevation.de>
parents:
404
diff
changeset
|
23 from treepkg.publish import remove_trailing_slashes, expand_filename |
|
c7f4da26f1d4
fixed wrong import statement
Bjoern Ricks <bricks@intevation.de>
parents:
404
diff
changeset
|
24 from treepkg.publish import prefix_for_remote_command, copy_to_publishdir |
|
89
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
25 |
|
256
8052aabada8b
Make publishpackages.py work for automated regular publishing of the
Bernhard Herzog <bh@intevation.de>
parents:
249
diff
changeset
|
26 config_desc = ["distribution", "section", "num_newest", |
|
249
a3f106580525
Add config settings "distribution" and "section" so that they don't have
Bernhard Herzog <bh@intevation.de>
parents:
247
diff
changeset
|
27 "build_user", "build_host", "build_listpackages", |
|
256
8052aabada8b
Make publishpackages.py work for automated regular publishing of the
Bernhard Herzog <bh@intevation.de>
parents:
249
diff
changeset
|
28 "publish_user", "publish_host", |
|
8052aabada8b
Make publishpackages.py work for automated regular publishing of the
Bernhard Herzog <bh@intevation.de>
parents:
249
diff
changeset
|
29 ("after_upload_hook", shlex.split), |
|
8052aabada8b
Make publishpackages.py work for automated regular publishing of the
Bernhard Herzog <bh@intevation.de>
parents:
249
diff
changeset
|
30 ("publish_remove_old_packages", convert_bool), |
|
89
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
31 ("publish_dir", remove_trailing_slashes), |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
32 ("cachedir", |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
33 lambda s: expand_filename(remove_trailing_slashes(s)))] |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
34 |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
35 def read_config(filename): |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
36 parser = SafeConfigParser() |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
37 parser.read([filename]) |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
38 return read_config_section(parser, "publishpackages", config_desc) |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
39 |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
40 def parse_commandline(): |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
41 parser = OptionParser() |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
42 parser.set_defaults(config_file=os.path.join(treepkgcmd.topdir, |
|
263
acf6c0ce2014
Add --quiet option so that publishpackages.py can be run without any output.
Bernhard Herzog <bh@intevation.de>
parents:
256
diff
changeset
|
43 "publishpackages.cfg"), |
|
acf6c0ce2014
Add --quiet option so that publishpackages.py can be run without any output.
Bernhard Herzog <bh@intevation.de>
parents:
256
diff
changeset
|
44 quiet=False) |
|
89
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
45 parser.add_option("--config-file", |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
46 help=("The configuration file." |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
47 " Default is publishpackages.cfg")) |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
48 parser.add_option("--revision", |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
49 help=("The revision whose files are to be published." |
|
247
55337021fe5b
Mention rules revision in text of --revision parameter of bin/publishpackages.py
Bernhard Herzog <bh@intevation.de>
parents:
200
diff
changeset
|
50 " If not given, the latest revision is used" |
|
55337021fe5b
Mention rules revision in text of --revision parameter of bin/publishpackages.py
Bernhard Herzog <bh@intevation.de>
parents:
200
diff
changeset
|
51 " The value may be given as REV-RULESREV to specify" |
|
55337021fe5b
Mention rules revision in text of --revision parameter of bin/publishpackages.py
Bernhard Herzog <bh@intevation.de>
parents:
200
diff
changeset
|
52 " both the main source revision and the revision of" |
|
55337021fe5b
Mention rules revision in text of --revision parameter of bin/publishpackages.py
Bernhard Herzog <bh@intevation.de>
parents:
200
diff
changeset
|
53 " the packaging rules")) |
|
89
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
54 parser.add_option("--dist", |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
55 help=("The debian distribution name to use on" |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
56 " the publishing system")) |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
57 parser.add_option("--section", |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
58 help=("The debian distribution section name to use on" |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
59 " the publishing system")) |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
60 parser.add_option("--track", |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
61 help=("The package track whose files are to be" |
|
200
ce03e24f6d0f
publishpackages command: if --track is omitted, publish files of all tracks.
Bernhard Herzog <bh@intevation.de>
parents:
89
diff
changeset
|
62 " published. If not given, files of all tracks" |
|
ce03e24f6d0f
publishpackages command: if --track is omitted, publish files of all tracks.
Bernhard Herzog <bh@intevation.de>
parents:
89
diff
changeset
|
63 " will be published")) |
|
263
acf6c0ce2014
Add --quiet option so that publishpackages.py can be run without any output.
Bernhard Herzog <bh@intevation.de>
parents:
256
diff
changeset
|
64 parser.add_option("--quiet", action="store_true", |
|
acf6c0ce2014
Add --quiet option so that publishpackages.py can be run without any output.
Bernhard Herzog <bh@intevation.de>
parents:
256
diff
changeset
|
65 help=("Do not print progress meters or other" |
|
acf6c0ce2014
Add --quiet option so that publishpackages.py can be run without any output.
Bernhard Herzog <bh@intevation.de>
parents:
256
diff
changeset
|
66 " informational output")) |
|
89
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
67 return parser.parse_args() |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
68 |
|
263
acf6c0ce2014
Add --quiet option so that publishpackages.py can be run without any output.
Bernhard Herzog <bh@intevation.de>
parents:
256
diff
changeset
|
69 def copy_to_cache(variables, track, revision, arch, quiet): |
|
200
ce03e24f6d0f
publishpackages command: if --track is omitted, publish files of all tracks.
Bernhard Herzog <bh@intevation.de>
parents:
89
diff
changeset
|
70 listpackages_vars = variables.copy() |
|
ce03e24f6d0f
publishpackages command: if --track is omitted, publish files of all tracks.
Bernhard Herzog <bh@intevation.de>
parents:
89
diff
changeset
|
71 |
|
89
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
72 if arch == "source": |
|
200
ce03e24f6d0f
publishpackages command: if --track is omitted, publish files of all tracks.
Bernhard Herzog <bh@intevation.de>
parents:
89
diff
changeset
|
73 listpackages_vars["pkgtype"] = "--source" |
|
89
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
74 else: |
|
200
ce03e24f6d0f
publishpackages command: if --track is omitted, publish files of all tracks.
Bernhard Herzog <bh@intevation.de>
parents:
89
diff
changeset
|
75 listpackages_vars["pkgtype"] = "--binary" |
|
ce03e24f6d0f
publishpackages command: if --track is omitted, publish files of all tracks.
Bernhard Herzog <bh@intevation.de>
parents:
89
diff
changeset
|
76 |
|
ce03e24f6d0f
publishpackages command: if --track is omitted, publish files of all tracks.
Bernhard Herzog <bh@intevation.de>
parents:
89
diff
changeset
|
77 if track: |
|
ce03e24f6d0f
publishpackages command: if --track is omitted, publish files of all tracks.
Bernhard Herzog <bh@intevation.de>
parents:
89
diff
changeset
|
78 listpackages_vars["track"] = ["--track", track] |
|
ce03e24f6d0f
publishpackages command: if --track is omitted, publish files of all tracks.
Bernhard Herzog <bh@intevation.de>
parents:
89
diff
changeset
|
79 else: |
|
ce03e24f6d0f
publishpackages command: if --track is omitted, publish files of all tracks.
Bernhard Herzog <bh@intevation.de>
parents:
89
diff
changeset
|
80 listpackages_vars["track"] = [] |
|
ce03e24f6d0f
publishpackages command: if --track is omitted, publish files of all tracks.
Bernhard Herzog <bh@intevation.de>
parents:
89
diff
changeset
|
81 |
|
ce03e24f6d0f
publishpackages command: if --track is omitted, publish files of all tracks.
Bernhard Herzog <bh@intevation.de>
parents:
89
diff
changeset
|
82 if revision: |
|
ce03e24f6d0f
publishpackages command: if --track is omitted, publish files of all tracks.
Bernhard Herzog <bh@intevation.de>
parents:
89
diff
changeset
|
83 listpackages_vars["revision"] = ["--revision", revision] |
|
ce03e24f6d0f
publishpackages command: if --track is omitted, publish files of all tracks.
Bernhard Herzog <bh@intevation.de>
parents:
89
diff
changeset
|
84 else: |
|
ce03e24f6d0f
publishpackages command: if --track is omitted, publish files of all tracks.
Bernhard Herzog <bh@intevation.de>
parents:
89
diff
changeset
|
85 listpackages_vars["revision"] = [] |
|
89
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
86 |
|
256
8052aabada8b
Make publishpackages.py work for automated regular publishing of the
Bernhard Herzog <bh@intevation.de>
parents:
249
diff
changeset
|
87 runremote = prefix_for_remote_command(variables["build_user"], |
|
8052aabada8b
Make publishpackages.py work for automated regular publishing of the
Bernhard Herzog <bh@intevation.de>
parents:
249
diff
changeset
|
88 variables["build_host"]) |
|
8052aabada8b
Make publishpackages.py work for automated regular publishing of the
Bernhard Herzog <bh@intevation.de>
parents:
249
diff
changeset
|
89 files = capture_output(cmdexpand("@runremote $build_listpackages" |
|
8052aabada8b
Make publishpackages.py work for automated regular publishing of the
Bernhard Herzog <bh@intevation.de>
parents:
249
diff
changeset
|
90 " @track @revision $pkgtype" |
|
8052aabada8b
Make publishpackages.py work for automated regular publishing of the
Bernhard Herzog <bh@intevation.de>
parents:
249
diff
changeset
|
91 " --newest=$num_newest", |
|
8052aabada8b
Make publishpackages.py work for automated regular publishing of the
Bernhard Herzog <bh@intevation.de>
parents:
249
diff
changeset
|
92 runremote=runremote, |
|
318
f70cee73a7ec
Only try to copy package files when there actually are files to copy
Bernhard Herzog <bh@intevation.de>
parents:
287
diff
changeset
|
93 **listpackages_vars)).splitlines() |
|
200
ce03e24f6d0f
publishpackages command: if --track is omitted, publish files of all tracks.
Bernhard Herzog <bh@intevation.de>
parents:
89
diff
changeset
|
94 |
|
89
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
95 # scp the packages to the cache dir |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
96 cachedir = variables["cachedir"] |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
97 shutil.rmtree(cachedir, ignore_errors=True) |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
98 ensure_directory(cachedir) |
|
318
f70cee73a7ec
Only try to copy package files when there actually are files to copy
Bernhard Herzog <bh@intevation.de>
parents:
287
diff
changeset
|
99 if files: |
|
f70cee73a7ec
Only try to copy package files when there actually are files to copy
Bernhard Herzog <bh@intevation.de>
parents:
287
diff
changeset
|
100 if variables["build_host"]: |
|
f70cee73a7ec
Only try to copy package files when there actually are files to copy
Bernhard Herzog <bh@intevation.de>
parents:
287
diff
changeset
|
101 userhost = "%(build_user)s@%(build_host)s:" % variables |
|
f70cee73a7ec
Only try to copy package files when there actually are files to copy
Bernhard Herzog <bh@intevation.de>
parents:
287
diff
changeset
|
102 files = [userhost + filename for filename in files] |
|
f70cee73a7ec
Only try to copy package files when there actually are files to copy
Bernhard Herzog <bh@intevation.de>
parents:
287
diff
changeset
|
103 scp_flags = [] |
|
f70cee73a7ec
Only try to copy package files when there actually are files to copy
Bernhard Herzog <bh@intevation.de>
parents:
287
diff
changeset
|
104 if quiet: |
|
f70cee73a7ec
Only try to copy package files when there actually are files to copy
Bernhard Herzog <bh@intevation.de>
parents:
287
diff
changeset
|
105 scp_flags.append("-q") |
|
f70cee73a7ec
Only try to copy package files when there actually are files to copy
Bernhard Herzog <bh@intevation.de>
parents:
287
diff
changeset
|
106 call(cmdexpand("scp -p @scp_flags @files $cachedir/", files=files, |
|
f70cee73a7ec
Only try to copy package files when there actually are files to copy
Bernhard Herzog <bh@intevation.de>
parents:
287
diff
changeset
|
107 scp_flags=scp_flags, **variables)) |
|
256
8052aabada8b
Make publishpackages.py work for automated regular publishing of the
Bernhard Herzog <bh@intevation.de>
parents:
249
diff
changeset
|
108 |
|
263
acf6c0ce2014
Add --quiet option so that publishpackages.py can be run without any output.
Bernhard Herzog <bh@intevation.de>
parents:
256
diff
changeset
|
109 def publish_packages_arch(variables, track, revision, dist, section, arch, |
|
acf6c0ce2014
Add --quiet option so that publishpackages.py can be run without any output.
Bernhard Herzog <bh@intevation.de>
parents:
256
diff
changeset
|
110 quiet): |
|
acf6c0ce2014
Add --quiet option so that publishpackages.py can be run without any output.
Bernhard Herzog <bh@intevation.de>
parents:
256
diff
changeset
|
111 copy_to_cache(variables, track, revision, arch, quiet) |
|
acf6c0ce2014
Add --quiet option so that publishpackages.py can be run without any output.
Bernhard Herzog <bh@intevation.de>
parents:
256
diff
changeset
|
112 copy_to_publishdir(variables, dist, section, arch, quiet) |
|
89
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
113 |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
114 |
|
263
acf6c0ce2014
Add --quiet option so that publishpackages.py can be run without any output.
Bernhard Herzog <bh@intevation.de>
parents:
256
diff
changeset
|
115 def publish_packages(config_filename, track, revision, dist, section, quiet): |
|
89
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
116 config = read_config(config_filename) |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
117 |
|
249
a3f106580525
Add config settings "distribution" and "section" so that they don't have
Bernhard Herzog <bh@intevation.de>
parents:
247
diff
changeset
|
118 if dist is None: |
|
a3f106580525
Add config settings "distribution" and "section" so that they don't have
Bernhard Herzog <bh@intevation.de>
parents:
247
diff
changeset
|
119 dist = config["distribution"] |
|
a3f106580525
Add config settings "distribution" and "section" so that they don't have
Bernhard Herzog <bh@intevation.de>
parents:
247
diff
changeset
|
120 if section is None: |
|
a3f106580525
Add config settings "distribution" and "section" so that they don't have
Bernhard Herzog <bh@intevation.de>
parents:
247
diff
changeset
|
121 section = config["section"] |
|
a3f106580525
Add config settings "distribution" and "section" so that they don't have
Bernhard Herzog <bh@intevation.de>
parents:
247
diff
changeset
|
122 |
|
89
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
123 for arch in ["binary-i386", "source"]: |
|
263
acf6c0ce2014
Add --quiet option so that publishpackages.py can be run without any output.
Bernhard Herzog <bh@intevation.de>
parents:
256
diff
changeset
|
124 publish_packages_arch(config, track, revision, dist, section, arch, |
|
acf6c0ce2014
Add --quiet option so that publishpackages.py can be run without any output.
Bernhard Herzog <bh@intevation.de>
parents:
256
diff
changeset
|
125 quiet) |
|
89
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
126 |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
127 # update apt archive |
|
427
25d702bb13f9
only run upload hook if it is not empty
Bjoern Ricks <bricks@intevation.de>
parents:
320
diff
changeset
|
128 if config["after_upload_hook"]: |
|
25d702bb13f9
only run upload hook if it is not empty
Bjoern Ricks <bricks@intevation.de>
parents:
320
diff
changeset
|
129 call(config["after_upload_hook"]) |
|
89
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
130 |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
131 def main(): |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
132 options, args = parse_commandline() |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
133 publish_packages(options.config_file, options.track, options.revision, |
|
263
acf6c0ce2014
Add --quiet option so that publishpackages.py can be run without any output.
Bernhard Herzog <bh@intevation.de>
parents:
256
diff
changeset
|
134 options.dist, options.section, options.quiet) |
|
89
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
135 |
|
3caf4a5ecbf0
Add scripts that help publish the packages produced by the tree packager
Bernhard Herzog <bh@intevation.de>
parents:
diff
changeset
|
136 main() |