treepkg: bin/runtreepkg.py annotate

annotate bin/runtreepkg.py @ 440:383d23c6bfde

Merged revisions 346-386 via svnmerge from svn+ssh://svn.wald.intevation.org/treepkg/branches/treepkg-status ........ r346 | bricks | 2010-07-07 17:40:48 +0200 (Mi, 07 Jul 2010) | 2 lines added classed for treepkg status xml generation ........ r347 | bricks | 2010-07-08 12:07:39 +0200 (Do, 08 Jul 2010) | 10 lines renamed new status dir to info because of a naming conflict with status.py let the user specify a treepkg name in the config the name is propagated to PackagerGroup [treepkg] name: <treepkgname> becomes: pg = PackagerGroup(...) pg.name ........ r348 | bricks | 2010-07-08 15:25:07 +0200 (Do, 08 Jul 2010) | 3 lines moved test file to test main dir fixed missing : after def statement ........ r349 | bricks | 2010-07-08 17:59:52 +0200 (Do, 08 Jul 2010) | 2 lines added treepkg_dir andd tracks_dir attributes to PackageGroup ........ r350 | bricks | 2010-07-08 18:00:32 +0200 (Do, 08 Jul 2010) | 2 lines changed <millpath> to <trackspath> ........ r351 | bricks | 2010-07-08 18:08:39 +0200 (Do, 08 Jul 2010) | 2 lines check if config file exists to get usefull error output ........ r352 | bricks | 2010-07-08 18:11:13 +0200 (Do, 08 Jul 2010) | 2 lines write first info about tracks ........ r353 | bricks | 2010-07-09 12:20:49 +0200 (Fr, 09 Jul 2010) | 2 lines get all log files ........ r354 | bricks | 2010-07-09 14:42:42 +0200 (Fr, 09 Jul 2010) | 2 lines added md5sum function ........ r355 | bricks | 2010-07-09 15:15:15 +0200 (Fr, 09 Jul 2010) | 4 lines implemented nearly all info only arch and os info are missing ........ r356 | bricks | 2010-07-09 16:19:17 +0200 (Fr, 09 Jul 2010) | 2 lines Bugfix: source was not defined ........ r357 | bricks | 2010-07-09 16:44:52 +0200 (Fr, 09 Jul 2010) | 3 lines fixed some typos added missing add_checksum methond ........ r358 | bricks | 2010-07-09 17:06:15 +0200 (Fr, 09 Jul 2010) | 2 lines fixed status line for revision ........ r359 | bricks | 2010-07-12 14:10:34 +0200 (Mo, 12 Jul 2010) | 2 lines let the user specify num revisions that should be shown in the info ........ r360 | bricks | 2010-07-12 14:21:39 +0200 (Mo, 12 Jul 2010) | 2 lines missed in last commit ........ r361 | bricks | 2010-07-12 17:06:22 +0200 (Mo, 12 Jul 2010) | 2 lines add os config statement ........ r362 | bricks | 2010-07-12 17:47:42 +0200 (Mo, 12 Jul 2010) | 3 lines moved packages and logs to revision tag implemented os and arch info ........ r363 | bricks | 2010-07-13 14:23:28 +0200 (Di, 13 Jul 2010) | 2 lines updated test readconfig for os config variable ........ r364 | bricks | 2010-07-13 14:24:14 +0200 (Di, 13 Jul 2010) | 2 lines moved common publish functions to a seperate module ........ r365 | bricks | 2010-07-13 16:26:11 +0200 (Di, 13 Jul 2010) | 2 lines moved arch info to each package info ........ r366 | bricks | 2010-07-13 18:46:17 +0200 (Di, 13 Jul 2010) | 2 lines inital checkin for new publishpackages processing ........ r367 | bricks | 2010-07-21 17:52:15 +0200 (Mi, 21 Jul 2010) | 2 lines implemented parsing from xml string ........ r368 | bricks | 2010-07-22 12:17:42 +0200 (Do, 22 Jul 2010) | 2 lines copy binary-all packages in all binary-xyz dirs ........ r369 | bricks | 2010-07-22 12:26:40 +0200 (Do, 22 Jul 2010) | 2 lines fixed small bugs ........ r370 | bricks | 2010-07-22 13:02:36 +0200 (Do, 22 Jul 2010) | 2 lines added a new root element which is called TreepkgRoot for Treepkg Info classes ........ r371 | bricks | 2010-07-22 13:09:52 +0200 (Do, 22 Jul 2010) | 3 lines fixed some small issues remember: run pychecker BEFORE the commit ........ r372 | bricks | 2010-07-22 18:01:43 +0200 (Do, 22 Jul 2010) | 2 lines improved publishdebianpackages and fixed a lot of bugs in the xml info parsing part ........ r373 | bricks | 2010-07-23 18:40:38 +0200 (Fr, 23 Jul 2010) | 2 lines implemented CacheDb to store copied Packages from build host ........ r374 | bricks | 2010-07-26 10:28:48 +0200 (Mo, 26 Jul 2010) | 2 lines moved data handling in publishdebianpackages into seperate module ........ r375 | bricks | 2010-07-26 11:42:07 +0200 (Mo, 26 Jul 2010) | 2 lines fixed some typos ........ r376 | bricks | 2010-07-26 12:12:40 +0200 (Mo, 26 Jul 2010) | 2 lines first version of incremental copying debian packages to cachedir ........ r377 | bricks | 2010-07-26 14:58:50 +0200 (Mo, 26 Jul 2010) | 2 lines incremental copying only changed debian packages ........ r378 | bricks | 2010-07-26 15:39:10 +0200 (Mo, 26 Jul 2010) | 3 lines use md5 instead of hashlib module (md5 is deprecated in favour of hashlib in python 2.5) ........ r379 | bricks | 2010-07-26 15:46:19 +0200 (Mo, 26 Jul 2010) | 2 lines make treepkg compatible to python 2.4 ........ r380 | bricks | 2010-07-26 15:50:49 +0200 (Mo, 26 Jul 2010) | 2 lines fixed last commit (db instead of sqlite3) ........ r381 | bricks | 2010-07-27 10:54:15 +0200 (Di, 27 Jul 2010) | 2 lines fixed wrong import statement ........ r382 | bricks | 2010-07-27 10:54:34 +0200 (Di, 27 Jul 2010) | 2 lines removed unnecessary debug output ........ r383 | bricks | 2010-07-27 18:28:22 +0200 (Di, 27 Jul 2010) | 2 lines check if upload hook is empty ........ r384 | bricks | 2010-07-28 09:35:21 +0200 (Mi, 28 Jul 2010) | 2 lines run rsync only an arch dirs that are present in the current treepkg ........ r385 | bricks | 2010-07-28 09:35:54 +0200 (Mi, 28 Jul 2010) | 2 lines add helper tool to list content of a cache db ........ r386 | bricks | 2010-07-28 10:33:48 +0200 (Mi, 28 Jul 2010) | 3 lines fixed a typo regex fails if option is empty ........

author	Bjoern Ricks <bricks@intevation.de>
date	Fri, 06 Aug 2010 13:28:47 +0000
parents	5f442b0cf3a4
children	de78084fcbce

rev	line source
287 1fcdffbeb9de Make the #! line in the commands more portable. Use /usr/bin/python Bernhard Herzog <bh@intevation.de> parents: 191 diff changeset	1 #! /usr/bin/python
1fcdffbeb9de Make the #! line in the commands more portable. Use /usr/bin/python Bernhard Herzog <bh@intevation.de> parents: 191 diff changeset	2 # Copyright (C) 2007, 2008, 2009 by Intevation GmbH
78 9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	3 # Authors:
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	4 # Bernhard Herzog <bh@intevation.de>
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	5 #
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	6 # This program is free software under the GPL (>=v2)
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	7 # Read the file COPYING coming with the software for details.
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	8
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	9 """Starts the tree packager"""
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	10
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	11 import sys
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	12 import os
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	13 import logging
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	14 from optparse import OptionParser
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	15
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	16 import treepkgcmd
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	17 from treepkg.options import create_parser
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	18 from treepkg.packager import create_package_track, PackagerGroup
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	19 from treepkg.readconfig import read_config
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	20
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	21 def initialize_logging():
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	22 """Initializes the logging system"""
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	23 root = logging.getLogger()
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	24 root.setLevel(logging.DEBUG)
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	25 hdlr = logging.StreamHandler()
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	26 fmt = logging.Formatter("%(asctime)s %(levelname)s %(message)s")
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	27 hdlr.setFormatter(fmt)
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	28 root.addHandler(hdlr)
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	29
290 97c17fb0ca19 Add --track-option command line option to set track-specific options. Bernhard Herzog <bh@intevation.de> parents: 287 diff changeset	30 def handle_track_option(option, opt_str, value, parser):
97c17fb0ca19 Add --track-option command line option to set track-specific options. Bernhard Herzog <bh@intevation.de> parents: 287 diff changeset	31 parsed_options = parser.values.track_options
97c17fb0ca19 Add --track-option command line option to set track-specific options. Bernhard Herzog <bh@intevation.de> parents: 287 diff changeset	32 track_optname, value = value.split("=", 1)
97c17fb0ca19 Add --track-option command line option to set track-specific options. Bernhard Herzog <bh@intevation.de> parents: 287 diff changeset	33 trackname, optname = track_optname.split(".")
97c17fb0ca19 Add --track-option command line option to set track-specific options. Bernhard Herzog <bh@intevation.de> parents: 287 diff changeset	34 track_options = parsed_options.setdefault(trackname, dict())
97c17fb0ca19 Add --track-option command line option to set track-specific options. Bernhard Herzog <bh@intevation.de> parents: 287 diff changeset	35 track_options[optname] = value
97c17fb0ca19 Add --track-option command line option to set track-specific options. Bernhard Herzog <bh@intevation.de> parents: 287 diff changeset	36
78 9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	37 def parse_commandline():
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	38 parser = create_parser()
290 97c17fb0ca19 Add --track-option command line option to set track-specific options. Bernhard Herzog <bh@intevation.de> parents: 287 diff changeset	39 parser.set_defaults(track_options=dict())
78 9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	40 parser.add_option("--once", action="store_true",
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	41 help=("Check the packagers only once and exit afterwards."
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	42 " Without this option, the tree packager will"
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	43 " check periodically."))
307 5f442b0cf3a4 New command line argument --stop-on-error for runtreepkg.py and Bernhard Herzog <bh@intevation.de> parents: 290 diff changeset	44 parser.add_option("--stop-on-error", action="store_true",
5f442b0cf3a4 New command line argument --stop-on-error for runtreepkg.py and Bernhard Herzog <bh@intevation.de> parents: 290 diff changeset	45 help=("Stop the tree packager when a packaging"
5f442b0cf3a4 New command line argument --stop-on-error for runtreepkg.py and Bernhard Herzog <bh@intevation.de> parents: 290 diff changeset	46 " attempt fails."))
81 2630a1c18816 Add command line option --revision to package a specific revision. Bernhard Herzog <bh@intevation.de> parents: 78 diff changeset	47 parser.add_option("--revision",
2630a1c18816 Add command line option --revision to package a specific revision. Bernhard Herzog <bh@intevation.de> parents: 78 diff changeset	48 help=("SVN revision to update to before attempting"
2630a1c18816 Add command line option --revision to package a specific revision. Bernhard Herzog <bh@intevation.de> parents: 78 diff changeset	49 " to package."))
190 e83db4482aab Add runtreepkg.py command line option --no-svn-update to inhibit updates Bernhard Herzog <bh@intevation.de> parents: 81 diff changeset	50 parser.add_option("--no-svn-update", action="store_true",
e83db4482aab Add runtreepkg.py command line option --no-svn-update to inhibit updates Bernhard Herzog <bh@intevation.de> parents: 81 diff changeset	51 help=("Do not update the SVN workingcopy before"
e83db4482aab Add runtreepkg.py command line option --no-svn-update to inhibit updates Bernhard Herzog <bh@intevation.de> parents: 81 diff changeset	52 " attempting to package."))
290 97c17fb0ca19 Add --track-option command line option to set track-specific options. Bernhard Herzog <bh@intevation.de> parents: 287 diff changeset	53 parser.add_option("--track-option", action="callback", type="string",
97c17fb0ca19 Add --track-option command line option to set track-specific options. Bernhard Herzog <bh@intevation.de> parents: 287 diff changeset	54 callback=handle_track_option,
97c17fb0ca19 Add --track-option command line option to set track-specific options. Bernhard Herzog <bh@intevation.de> parents: 287 diff changeset	55 help=("Sets a track-specific option."
97c17fb0ca19 Add --track-option command line option to set track-specific options. Bernhard Herzog <bh@intevation.de> parents: 287 diff changeset	56 " The argument should be of the form"
97c17fb0ca19 Add --track-option command line option to set track-specific options. Bernhard Herzog <bh@intevation.de> parents: 287 diff changeset	57 " TRACKNAME.OPTION=VALUE"))
78 9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	58 return parser.parse_args()
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	59
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	60 def main():
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	61 options, args = parse_commandline()
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	62
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	63 initialize_logging()
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	64
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	65 treepkg_opts, packager_opts = read_config(options.config_file)
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	66
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	67 if args:
191 94fb3f3ab58b When building a subset of tracks, make sure new packages are added to Bernhard Herzog <bh@intevation.de> parents: 190 diff changeset	68 selected_tracks = set(args)
94fb3f3ab58b When building a subset of tracks, make sure new packages are added to Bernhard Herzog <bh@intevation.de> parents: 190 diff changeset	69 else:
94fb3f3ab58b When building a subset of tracks, make sure new packages are added to Bernhard Herzog <bh@intevation.de> parents: 190 diff changeset	70 selected_tracks = set(opts["name"] for opts in packager_opts)
94fb3f3ab58b When building a subset of tracks, make sure new packages are added to Bernhard Herzog <bh@intevation.de> parents: 190 diff changeset	71
94fb3f3ab58b When building a subset of tracks, make sure new packages are added to Bernhard Herzog <bh@intevation.de> parents: 190 diff changeset	72 for opts in packager_opts:
94fb3f3ab58b When building a subset of tracks, make sure new packages are added to Bernhard Herzog <bh@intevation.de> parents: 190 diff changeset	73 name = opts["name"]
94fb3f3ab58b When building a subset of tracks, make sure new packages are added to Bernhard Herzog <bh@intevation.de> parents: 190 diff changeset	74 opts["do_build"] = name in selected_tracks
94fb3f3ab58b When building a subset of tracks, make sure new packages are added to Bernhard Herzog <bh@intevation.de> parents: 190 diff changeset	75 selected_tracks.discard(name)
290 97c17fb0ca19 Add --track-option command line option to set track-specific options. Bernhard Herzog <bh@intevation.de> parents: 287 diff changeset	76 if name in options.track_options:
97c17fb0ca19 Add --track-option command line option to set track-specific options. Bernhard Herzog <bh@intevation.de> parents: 287 diff changeset	77 opts.update(options.track_options[name])
191 94fb3f3ab58b When building a subset of tracks, make sure new packages are added to Bernhard Herzog <bh@intevation.de> parents: 190 diff changeset	78 for name in selected_tracks:
94fb3f3ab58b When building a subset of tracks, make sure new packages are added to Bernhard Herzog <bh@intevation.de> parents: 190 diff changeset	79 print >>sys.stderr, "No package track found named %r" % name
78 9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	80
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	81 if packager_opts:
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	82 group = PackagerGroup([create_package_track(**opts)
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	83 for opts in packager_opts],
81 2630a1c18816 Add command line option --revision to package a specific revision. Bernhard Herzog <bh@intevation.de> parents: 78 diff changeset	84 revision=options.revision,
190 e83db4482aab Add runtreepkg.py command line option --no-svn-update to inhibit updates Bernhard Herzog <bh@intevation.de> parents: 81 diff changeset	85 do_svn_update=not options.no_svn_update,
307 5f442b0cf3a4 New command line argument --stop-on-error for runtreepkg.py and Bernhard Herzog <bh@intevation.de> parents: 290 diff changeset	86 stop_on_error=options.stop_on_error,
78 9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	87 **treepkg_opts)
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	88 if options.once:
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	89 group.check_package_tracks()
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	90 else:
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	91 group.run()
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	92
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: diff changeset	93 main()

Mercurial > treepkg

annotate bin/runtreepkg.py @ 440:383d23c6bfde