treepkg: bin/updatetreepkg.py annotate

annotate bin/updatetreepkg.py @ 440:383d23c6bfde

Merged revisions 346-386 via svnmerge from svn+ssh://svn.wald.intevation.org/treepkg/branches/treepkg-status ........ r346 | bricks | 2010-07-07 17:40:48 +0200 (Mi, 07 Jul 2010) | 2 lines added classed for treepkg status xml generation ........ r347 | bricks | 2010-07-08 12:07:39 +0200 (Do, 08 Jul 2010) | 10 lines renamed new status dir to info because of a naming conflict with status.py let the user specify a treepkg name in the config the name is propagated to PackagerGroup [treepkg] name: <treepkgname> becomes: pg = PackagerGroup(...) pg.name ........ r348 | bricks | 2010-07-08 15:25:07 +0200 (Do, 08 Jul 2010) | 3 lines moved test file to test main dir fixed missing : after def statement ........ r349 | bricks | 2010-07-08 17:59:52 +0200 (Do, 08 Jul 2010) | 2 lines added treepkg_dir andd tracks_dir attributes to PackageGroup ........ r350 | bricks | 2010-07-08 18:00:32 +0200 (Do, 08 Jul 2010) | 2 lines changed <millpath> to <trackspath> ........ r351 | bricks | 2010-07-08 18:08:39 +0200 (Do, 08 Jul 2010) | 2 lines check if config file exists to get usefull error output ........ r352 | bricks | 2010-07-08 18:11:13 +0200 (Do, 08 Jul 2010) | 2 lines write first info about tracks ........ r353 | bricks | 2010-07-09 12:20:49 +0200 (Fr, 09 Jul 2010) | 2 lines get all log files ........ r354 | bricks | 2010-07-09 14:42:42 +0200 (Fr, 09 Jul 2010) | 2 lines added md5sum function ........ r355 | bricks | 2010-07-09 15:15:15 +0200 (Fr, 09 Jul 2010) | 4 lines implemented nearly all info only arch and os info are missing ........ r356 | bricks | 2010-07-09 16:19:17 +0200 (Fr, 09 Jul 2010) | 2 lines Bugfix: source was not defined ........ r357 | bricks | 2010-07-09 16:44:52 +0200 (Fr, 09 Jul 2010) | 3 lines fixed some typos added missing add_checksum methond ........ r358 | bricks | 2010-07-09 17:06:15 +0200 (Fr, 09 Jul 2010) | 2 lines fixed status line for revision ........ r359 | bricks | 2010-07-12 14:10:34 +0200 (Mo, 12 Jul 2010) | 2 lines let the user specify num revisions that should be shown in the info ........ r360 | bricks | 2010-07-12 14:21:39 +0200 (Mo, 12 Jul 2010) | 2 lines missed in last commit ........ r361 | bricks | 2010-07-12 17:06:22 +0200 (Mo, 12 Jul 2010) | 2 lines add os config statement ........ r362 | bricks | 2010-07-12 17:47:42 +0200 (Mo, 12 Jul 2010) | 3 lines moved packages and logs to revision tag implemented os and arch info ........ r363 | bricks | 2010-07-13 14:23:28 +0200 (Di, 13 Jul 2010) | 2 lines updated test readconfig for os config variable ........ r364 | bricks | 2010-07-13 14:24:14 +0200 (Di, 13 Jul 2010) | 2 lines moved common publish functions to a seperate module ........ r365 | bricks | 2010-07-13 16:26:11 +0200 (Di, 13 Jul 2010) | 2 lines moved arch info to each package info ........ r366 | bricks | 2010-07-13 18:46:17 +0200 (Di, 13 Jul 2010) | 2 lines inital checkin for new publishpackages processing ........ r367 | bricks | 2010-07-21 17:52:15 +0200 (Mi, 21 Jul 2010) | 2 lines implemented parsing from xml string ........ r368 | bricks | 2010-07-22 12:17:42 +0200 (Do, 22 Jul 2010) | 2 lines copy binary-all packages in all binary-xyz dirs ........ r369 | bricks | 2010-07-22 12:26:40 +0200 (Do, 22 Jul 2010) | 2 lines fixed small bugs ........ r370 | bricks | 2010-07-22 13:02:36 +0200 (Do, 22 Jul 2010) | 2 lines added a new root element which is called TreepkgRoot for Treepkg Info classes ........ r371 | bricks | 2010-07-22 13:09:52 +0200 (Do, 22 Jul 2010) | 3 lines fixed some small issues remember: run pychecker BEFORE the commit ........ r372 | bricks | 2010-07-22 18:01:43 +0200 (Do, 22 Jul 2010) | 2 lines improved publishdebianpackages and fixed a lot of bugs in the xml info parsing part ........ r373 | bricks | 2010-07-23 18:40:38 +0200 (Fr, 23 Jul 2010) | 2 lines implemented CacheDb to store copied Packages from build host ........ r374 | bricks | 2010-07-26 10:28:48 +0200 (Mo, 26 Jul 2010) | 2 lines moved data handling in publishdebianpackages into seperate module ........ r375 | bricks | 2010-07-26 11:42:07 +0200 (Mo, 26 Jul 2010) | 2 lines fixed some typos ........ r376 | bricks | 2010-07-26 12:12:40 +0200 (Mo, 26 Jul 2010) | 2 lines first version of incremental copying debian packages to cachedir ........ r377 | bricks | 2010-07-26 14:58:50 +0200 (Mo, 26 Jul 2010) | 2 lines incremental copying only changed debian packages ........ r378 | bricks | 2010-07-26 15:39:10 +0200 (Mo, 26 Jul 2010) | 3 lines use md5 instead of hashlib module (md5 is deprecated in favour of hashlib in python 2.5) ........ r379 | bricks | 2010-07-26 15:46:19 +0200 (Mo, 26 Jul 2010) | 2 lines make treepkg compatible to python 2.4 ........ r380 | bricks | 2010-07-26 15:50:49 +0200 (Mo, 26 Jul 2010) | 2 lines fixed last commit (db instead of sqlite3) ........ r381 | bricks | 2010-07-27 10:54:15 +0200 (Di, 27 Jul 2010) | 2 lines fixed wrong import statement ........ r382 | bricks | 2010-07-27 10:54:34 +0200 (Di, 27 Jul 2010) | 2 lines removed unnecessary debug output ........ r383 | bricks | 2010-07-27 18:28:22 +0200 (Di, 27 Jul 2010) | 2 lines check if upload hook is empty ........ r384 | bricks | 2010-07-28 09:35:21 +0200 (Mi, 28 Jul 2010) | 2 lines run rsync only an arch dirs that are present in the current treepkg ........ r385 | bricks | 2010-07-28 09:35:54 +0200 (Mi, 28 Jul 2010) | 2 lines add helper tool to list content of a cache db ........ r386 | bricks | 2010-07-28 10:33:48 +0200 (Mi, 28 Jul 2010) | 3 lines fixed a typo regex fails if option is empty ........

author	Bjoern Ricks <bricks@intevation.de>
date	Fri, 06 Aug 2010 13:28:47 +0000
parents	5fa56edeb606
children

rev	line source
287 1fcdffbeb9de Make the #! line in the commands more portable. Use /usr/bin/python Bernhard Herzog <bh@intevation.de> parents: 233 diff changeset	1 #! /usr/bin/python
233 757e5504f46a Extend bin/updatetreepkg.py to rename the revision directories if they Bernhard Herzog <bh@intevation.de> parents: 144 diff changeset	2 # Copyright (C) 2007, 2008, 2009 by Intevation GmbH
144 dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	3 # Authors:
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	4 # Bernhard Herzog <bh@intevation.de>
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	5 #
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	6 # This program is free software under the GPL (>=v2)
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	7 # Read the file COPYING coming with the software for details.
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	8
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	9 """Script to help update a tree packager installation to the current
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	10 version. The script updates the information stored in the filesystem
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	11 for the individual revisions in the following ways:
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	12
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	13 - Rename the build log from build.log to log/build_log.txt
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	14
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	15 - Rename the build log from build_log.txt to log/build_log.txt
233 757e5504f46a Extend bin/updatetreepkg.py to rename the revision directories if they Bernhard Herzog <bh@intevation.de> parents: 144 diff changeset	16
757e5504f46a Extend bin/updatetreepkg.py to rename the revision directories if they Bernhard Herzog <bh@intevation.de> parents: 144 diff changeset	17 - Rename the directory name of the revision from <revision>-1 to <revision>-0
757e5504f46a Extend bin/updatetreepkg.py to rename the revision directories if they Bernhard Herzog <bh@intevation.de> parents: 144 diff changeset	18
757e5504f46a Extend bin/updatetreepkg.py to rename the revision directories if they Bernhard Herzog <bh@intevation.de> parents: 144 diff changeset	19 The second number is now the revision of the packaging rules if
757e5504f46a Extend bin/updatetreepkg.py to rename the revision directories if they Bernhard Herzog <bh@intevation.de> parents: 144 diff changeset	20 they're managed by SVN and always 0 for manual management of the
757e5504f46a Extend bin/updatetreepkg.py to rename the revision directories if they Bernhard Herzog <bh@intevation.de> parents: 144 diff changeset	21 rules.
144 dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	22 """
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	23
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	24 import os
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	25
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	26 import treepkgcmd
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	27 from treepkg.options import create_parser
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	28 from treepkg.packager import create_package_track, PackagerGroup
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	29 from treepkg.readconfig import read_config
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	30
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	31 def rename_file(old_name, new_name, dry_run):
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	32 if os.path.exists(old_name):
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	33 new_dir = os.path.dirname(new_name)
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	34 if not os.path.isdir(new_dir):
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	35 print "mkdir %s" % (new_dir,)
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	36 if not dry_run:
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	37 os.mkdir(new_dir)
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	38 print "mv %s %s" % (old_name, new_name)
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	39 if not dry_run:
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	40 os.rename(old_name, new_name)
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	41
233 757e5504f46a Extend bin/updatetreepkg.py to rename the revision directories if they Bernhard Herzog <bh@intevation.de> parents: 144 diff changeset	42 def update_rules_revision_in_directory_names(track, dry_run):
757e5504f46a Extend bin/updatetreepkg.py to rename the revision directories if they Bernhard Herzog <bh@intevation.de> parents: 144 diff changeset	43 revisions = track.get_revisions()
757e5504f46a Extend bin/updatetreepkg.py to rename the revision directories if they Bernhard Herzog <bh@intevation.de> parents: 144 diff changeset	44 rules_revisions = set(revision.rules_revision for revision in revisions)
757e5504f46a Extend bin/updatetreepkg.py to rename the revision directories if they Bernhard Herzog <bh@intevation.de> parents: 144 diff changeset	45 if rules_revisions == set([1]):
757e5504f46a Extend bin/updatetreepkg.py to rename the revision directories if they Bernhard Herzog <bh@intevation.de> parents: 144 diff changeset	46 for revision in revisions:
757e5504f46a Extend bin/updatetreepkg.py to rename the revision directories if they Bernhard Herzog <bh@intevation.de> parents: 144 diff changeset	47 rename_file(revision.base_dir,
757e5504f46a Extend bin/updatetreepkg.py to rename the revision directories if they Bernhard Herzog <bh@intevation.de> parents: 144 diff changeset	48 revision.base_dir[:-2] + "-0",
757e5504f46a Extend bin/updatetreepkg.py to rename the revision directories if they Bernhard Herzog <bh@intevation.de> parents: 144 diff changeset	49 dry_run)
757e5504f46a Extend bin/updatetreepkg.py to rename the revision directories if they Bernhard Herzog <bh@intevation.de> parents: 144 diff changeset	50
144 dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	51 def update_treepkg(config_file, dry_run):
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	52 treepkg_opts, packager_opts = read_config(config_file)
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	53 for opts in packager_opts:
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	54 opts["handle_dependencies"] = False
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	55 group = PackagerGroup([create_package_track(**opts)
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	56 for opts in packager_opts],
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	57 **treepkg_opts)
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	58 for track in group.get_package_tracks():
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	59 for revision in track.get_revisions():
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	60 # Originally, the build logs were called build.log and were
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	61 # in the base directory of a revision
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	62 rename_file(os.path.join(revision.base_dir, "build.log"),
336 5fa56edeb606 Changed the Build Logs to be gziped before they are published Andre Heinecke <aheinecke@intevation.de> parents: 287 diff changeset	63 revision.get_build_log(), dry_run)
144 dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	64 # for a while, the build logs were called build_log.txt but
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	65 # still were in the base directory
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	66 rename_file(os.path.join(revision.base_dir, "build_log.txt"),
336 5fa56edeb606 Changed the Build Logs to be gziped before they are published Andre Heinecke <aheinecke@intevation.de> parents: 287 diff changeset	67 revision.get_build_log(), dry_run)
233 757e5504f46a Extend bin/updatetreepkg.py to rename the revision directories if they Bernhard Herzog <bh@intevation.de> parents: 144 diff changeset	68 # Revision directories used to end with "-1". Now that number
757e5504f46a Extend bin/updatetreepkg.py to rename the revision directories if they Bernhard Herzog <bh@intevation.de> parents: 144 diff changeset	69 # is the revision of the packaging rules which default to 0 for
757e5504f46a Extend bin/updatetreepkg.py to rename the revision directories if they Bernhard Herzog <bh@intevation.de> parents: 144 diff changeset	70 # the traditional manual rules management without a version
757e5504f46a Extend bin/updatetreepkg.py to rename the revision directories if they Bernhard Herzog <bh@intevation.de> parents: 144 diff changeset	71 # control system. Rename those directories if necessary
757e5504f46a Extend bin/updatetreepkg.py to rename the revision directories if they Bernhard Herzog <bh@intevation.de> parents: 144 diff changeset	72 update_rules_revision_in_directory_names(track, dry_run)
144 dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	73
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	74 def parse_commandline():
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	75 parser = create_parser()
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	76 parser.set_defaults(dry_run=False)
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	77 parser.add_option("-n", "--dry-run", action="store_true",
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	78 help="Do not actually change anything")
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	79 return parser.parse_args()
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	80
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	81
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	82 def main():
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	83 options, args = parse_commandline()
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	84 update_treepkg(options.config_file, options.dry_run)
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	85
dd54ef8a9244 New file. Script to update an existing treepkg installation to the Bernhard Herzog <bh@intevation.de> parents: diff changeset	86 main()

Mercurial > treepkg

annotate bin/updatetreepkg.py @ 440:383d23c6bfde