treepkg/treepkg: treepkg/packager.py annotate

annotate treepkg/packager.py @ 207:b82fe4d25893

SourcePackager.create_tarball: add parameter to specify compression method

author	Bernhard Herzog <bh@intevation.de>
date	Thu, 06 Nov 2008 15:36:29 +0000
parents	b1929c11a020
children	01c043f13f13

rev	line source
99 7888fe374e11 Add support for notification mails in case of build errors Bernhard Herzog <bh@intevation.de> parents: 98 diff changeset	1 # Copyright (C) 2007, 2008 by Intevation GmbH
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	2 # Authors:
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	3 # Bernhard Herzog <bh@intevation.de>
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	4 #
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	5 # This program is free software under the GPL (>=v2)
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	6 # Read the file COPYING coming with the software for details.
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	7
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	8 """Classes to automatically build debian packages from subversion checkouts"""
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	9
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	10 import os
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	11 import time
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	12 import re
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	13 import logging
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	14 import shutil
16 7c55f3879c4d Use the new status class and report start/stop time too Bernhard Herzog <bh@intevation.de> parents: 14 diff changeset	15 import datetime
113 312949e7628d Add a smarter way to load the packager modules: Add the function Bernhard Herzog <bh@intevation.de> parents: 112 diff changeset	16 import new
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	17
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	18 import util
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	19 import subversion
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	20 import run
16 7c55f3879c4d Use the new status class and report start/stop time too Bernhard Herzog <bh@intevation.de> parents: 14 diff changeset	21 import status
128 5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	22 import debian
45 3e610233ccfe use cmdexpand when calling subprocesses Bernhard Herzog <bh@intevation.de> parents: 41 diff changeset	23 from cmdexpand import cmdexpand
112 cea98d4e4a6a Abstract the pbuilder calls into the new class treepkg.builder.PBuilder. Bernhard Herzog <bh@intevation.de> parents: 106 diff changeset	24 from builder import PBuilder
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	25
135 e5b4dea52297 Make more of RevisionPackager available to SourcePackager and Bernhard Herzog <bh@intevation.de> parents: 131 diff changeset	26 def _fromparent(attr):
e5b4dea52297 Make more of RevisionPackager available to SourcePackager and Bernhard Herzog <bh@intevation.de> parents: 131 diff changeset	27 """Creates a property that delegates its value to self.parent.<attr>"""
e5b4dea52297 Make more of RevisionPackager available to SourcePackager and Bernhard Herzog <bh@intevation.de> parents: 131 diff changeset	28 def get(self):
e5b4dea52297 Make more of RevisionPackager available to SourcePackager and Bernhard Herzog <bh@intevation.de> parents: 131 diff changeset	29 return getattr(self.parent, attr)
e5b4dea52297 Make more of RevisionPackager available to SourcePackager and Bernhard Herzog <bh@intevation.de> parents: 131 diff changeset	30 return property(get)
e5b4dea52297 Make more of RevisionPackager available to SourcePackager and Bernhard Herzog <bh@intevation.de> parents: 131 diff changeset	31
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	32
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	33 class SourcePackager(object):
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	34
4 fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	35 # Derived classes must supply the package basename
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	36 pkg_basename = None
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	37
135 e5b4dea52297 Make more of RevisionPackager available to SourcePackager and Bernhard Herzog <bh@intevation.de> parents: 131 diff changeset	38 track = _fromparent("track")
e5b4dea52297 Make more of RevisionPackager available to SourcePackager and Bernhard Herzog <bh@intevation.de> parents: 131 diff changeset	39 revision = _fromparent("revision")
e5b4dea52297 Make more of RevisionPackager available to SourcePackager and Bernhard Herzog <bh@intevation.de> parents: 131 diff changeset	40 status = _fromparent("status")
136 5598014b2a1d Add a log/ subdir for each revision. The filename is available as the Bernhard Herzog <bh@intevation.de> parents: 135 diff changeset	41 log_dir = _fromparent("log_dir")
135 e5b4dea52297 Make more of RevisionPackager available to SourcePackager and Bernhard Herzog <bh@intevation.de> parents: 131 diff changeset	42 work_dir = _fromparent("work_dir")
e5b4dea52297 Make more of RevisionPackager available to SourcePackager and Bernhard Herzog <bh@intevation.de> parents: 131 diff changeset	43 src_dir = _fromparent("src_dir")
e5b4dea52297 Make more of RevisionPackager available to SourcePackager and Bernhard Herzog <bh@intevation.de> parents: 131 diff changeset	44
e5b4dea52297 Make more of RevisionPackager available to SourcePackager and Bernhard Herzog <bh@intevation.de> parents: 131 diff changeset	45 def __init__(self, parent):
e5b4dea52297 Make more of RevisionPackager available to SourcePackager and Bernhard Herzog <bh@intevation.de> parents: 131 diff changeset	46 self.parent = parent
4 fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	47 assert(self.pkg_basename)
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	48
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	49 def determine_package_version(self, directory):
4 fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	50 """Returns the version number of the new package as a string
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	51
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	52 The directory parameter is the name of the directory containing
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	53 the newly exported sources. The sources were exported with the
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	54 export_sources method.
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	55
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	56 The default implementation simply returns the revision converted
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	57 to a string.
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	58 """
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	59 return str(self.revision)
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	60
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	61 def export_sources(self):
4 fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	62 """Export the sources from the subversion working directory
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	63
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	64 This method first exports the sources to a temporary directory
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	65 and then renames the directory. The new name is of the form
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	66
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	67 <pkg_basename>-<version>
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	68
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	69 Where pkg_basename is the value of self.pkg_basename and version
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	70 is the return value of the determine_package_version() method.
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	71 """
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	72 temp_dir = os.path.join(self.work_dir, "temp")
53 74cd21b6400b rename some variables from pkg_track to track Bernhard Herzog <bh@intevation.de> parents: 52 diff changeset	73 self.track.export_sources(temp_dir)
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	74
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	75 pkgbaseversion = self.determine_package_version(temp_dir)
4 fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	76 pkgbasedir = os.path.join(self.work_dir,
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	77 self.pkg_basename + "-" + pkgbaseversion)
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	78
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	79 os.rename(temp_dir, pkgbasedir)
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	80 return pkgbaseversion, pkgbasedir
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	81
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	82
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	83 def update_version_numbers(self, pkgbasedir):
4 fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	84 """Updates the version numbers in the code in pkgbasedir.
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	85
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	86 The default implementation does nothing. Derived classes should
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	87 override this method if necessary.
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	88 """
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	89
207 b82fe4d25893 SourcePackager.create_tarball: add parameter to specify compression method Bernhard Herzog <bh@intevation.de> parents: 202 diff changeset	90 def create_tarball(self, tarballname, workdir, basedir, compression="gz"):
4 fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	91 """Creates a new tarball.
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	92
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	93 Parameters:
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	94
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	95 tarballname -- the filename of the new tarball
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	96 workdir -- The directory into which to change before running tar.
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	97 (actually this is done with GNUI tar's -C option)
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	98 basedir -- The basedirectory of the files that are packaged
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	99 into the tarfile. This should be a relative
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	100 filename directly in workdir.
207 b82fe4d25893 SourcePackager.create_tarball: add parameter to specify compression method Bernhard Herzog <bh@intevation.de> parents: 202 diff changeset	101 compression -- The compression method to use as a string.
b82fe4d25893 SourcePackager.create_tarball: add parameter to specify compression method Bernhard Herzog <bh@intevation.de> parents: 202 diff changeset	102 Suported are 'gz' for gzip compression (the
b82fe4d25893 SourcePackager.create_tarball: add parameter to specify compression method Bernhard Herzog <bh@intevation.de> parents: 202 diff changeset	103 default) and 'bz2' for bzip2.
4 fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	104 """
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	105 logging.info("Creating tarball %r", tarballname)
207 b82fe4d25893 SourcePackager.create_tarball: add parameter to specify compression method Bernhard Herzog <bh@intevation.de> parents: 202 diff changeset	106 if compression == "gz":
b82fe4d25893 SourcePackager.create_tarball: add parameter to specify compression method Bernhard Herzog <bh@intevation.de> parents: 202 diff changeset	107 compression_flag = "z"
b82fe4d25893 SourcePackager.create_tarball: add parameter to specify compression method Bernhard Herzog <bh@intevation.de> parents: 202 diff changeset	108 elif compression == "bz2":
b82fe4d25893 SourcePackager.create_tarball: add parameter to specify compression method Bernhard Herzog <bh@intevation.de> parents: 202 diff changeset	109 compression_flag = "j"
b82fe4d25893 SourcePackager.create_tarball: add parameter to specify compression method Bernhard Herzog <bh@intevation.de> parents: 202 diff changeset	110 else:
b82fe4d25893 SourcePackager.create_tarball: add parameter to specify compression method Bernhard Herzog <bh@intevation.de> parents: 202 diff changeset	111 raise ValueError("Unknown compression method %r" % compression)
b82fe4d25893 SourcePackager.create_tarball: add parameter to specify compression method Bernhard Herzog <bh@intevation.de> parents: 202 diff changeset	112
b82fe4d25893 SourcePackager.create_tarball: add parameter to specify compression method Bernhard Herzog <bh@intevation.de> parents: 202 diff changeset	113 run.call(cmdexpand("tar c -$compression_flag -f $tarballname"
b82fe4d25893 SourcePackager.create_tarball: add parameter to specify compression method Bernhard Herzog <bh@intevation.de> parents: 202 diff changeset	114 " -C $workdir $basedir", **locals()))
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	115
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	116 def copy_debian_directory(self, pkgbasedir, pkgbaseversion, changemsg):
4 fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	117 """Copies the debian directory and updates the copy's changelog
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	118
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	119 Parameter:
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	120 pkgbasedir -- The directory holding the unpacked source package
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	121 pkgbaseversion -- The version to update the changelog to
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	122 changemsg -- The message for the changelog
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	123
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	124 When determining the actual version for the new package, this
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	125 function looks at the previous version in the changelog. If it
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	126 has a prefix separated from the version number by a colon this
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	127 prefix is prepended to the pkgbaseversion parameter. Debian
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	128 uses such prefixes for the kde packages.
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	129 """
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	130 debian_dir = os.path.join(pkgbasedir, "debian")
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	131 changelog = os.path.join(debian_dir, "changelog")
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	132
53 74cd21b6400b rename some variables from pkg_track to track Bernhard Herzog <bh@intevation.de> parents: 52 diff changeset	133 self.track.copy_debian_directory(debian_dir)
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	134
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	135 logging.info("Updating %r", changelog)
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	136 oldversion = util.debian_changelog_version(changelog)
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	137 if ":" in oldversion:
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	138 oldversionprefix = oldversion.split(":")[0] + ":"
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	139 else:
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	140 oldversionprefix = ""
93 73c67372c7f7 Make the prefix used in the debian revision number configurable. Bernhard Herzog <bh@intevation.de> parents: 91 diff changeset	141 debrev = self.track.debrevision_prefix + "1"
45 3e610233ccfe use cmdexpand when calling subprocesses Bernhard Herzog <bh@intevation.de> parents: 41 diff changeset	142 run.call(cmdexpand("debchange -c $changelog"
93 73c67372c7f7 Make the prefix used in the debian revision number configurable. Bernhard Herzog <bh@intevation.de> parents: 91 diff changeset	143 " -v ${oldversionprefix}${pkgbaseversion}-${debrev}"
45 3e610233ccfe use cmdexpand when calling subprocesses Bernhard Herzog <bh@intevation.de> parents: 41 diff changeset	144 " $changemsg", **locals()),
53 74cd21b6400b rename some variables from pkg_track to track Bernhard Herzog <bh@intevation.de> parents: 52 diff changeset	145 env=self.track.debian_environment())
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	146
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	147
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	148 def create_source_package(self, pkgbasedir, origtargz):
4 fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	149 """Creates a new source package from pkgbasedir and origtargz"""
194 86360f3d5611 Log the output of the dpkg-source call to dpkg_source.txt. Bernhard Herzog <bh@intevation.de> parents: 191 diff changeset	150 util.ensure_directory(self.log_dir)
86360f3d5611 Log the output of the dpkg-source call to dpkg_source.txt. Bernhard Herzog <bh@intevation.de> parents: 191 diff changeset	151 dpkg_source_log = os.path.join(self.log_dir, "dpkg_source.txt")
86360f3d5611 Log the output of the dpkg-source call to dpkg_source.txt. Bernhard Herzog <bh@intevation.de> parents: 191 diff changeset	152 logging.info("Creating new source package; logging to %s",
86360f3d5611 Log the output of the dpkg-source call to dpkg_source.txt. Bernhard Herzog <bh@intevation.de> parents: 191 diff changeset	153 dpkg_source_log)
45 3e610233ccfe use cmdexpand when calling subprocesses Bernhard Herzog <bh@intevation.de> parents: 41 diff changeset	154 run.call(cmdexpand("dpkg-source -b $directory $tarball",
3e610233ccfe use cmdexpand when calling subprocesses Bernhard Herzog <bh@intevation.de> parents: 41 diff changeset	155 directory=os.path.basename(pkgbasedir),
3e610233ccfe use cmdexpand when calling subprocesses Bernhard Herzog <bh@intevation.de> parents: 41 diff changeset	156 tarball=os.path.basename(origtargz)),
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	157 cwd=os.path.dirname(pkgbasedir),
194 86360f3d5611 Log the output of the dpkg-source call to dpkg_source.txt. Bernhard Herzog <bh@intevation.de> parents: 191 diff changeset	158 logfile=dpkg_source_log,
53 74cd21b6400b rename some variables from pkg_track to track Bernhard Herzog <bh@intevation.de> parents: 52 diff changeset	159 env=self.track.debian_environment())
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	160
4 fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	161 def move_source_package(self, pkgbasename):
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	162 """Moves the new source package from the work_dir to the src_dir"""
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	163 logging.info("Moving source package to %r", self.src_dir)
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	164 util.ensure_directory(self.src_dir)
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	165 for filename in [filename for filename in os.listdir(self.work_dir)
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	166 if filename.startswith(pkgbasename)]:
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	167 os.rename(os.path.join(self.work_dir, filename),
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	168 os.path.join(self.src_dir, filename))
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	169
179 952d366f7b14 Implement optional signing of .dsc and .changes files Bernhard Herzog <bh@intevation.de> parents: 176 diff changeset	170 def sign_package(self):
952d366f7b14 Implement optional signing of .dsc and .changes files Bernhard Herzog <bh@intevation.de> parents: 176 diff changeset	171 """Signs the .dsc file created buy the instance"""
952d366f7b14 Implement optional signing of .dsc and .changes files Bernhard Herzog <bh@intevation.de> parents: 176 diff changeset	172 self.track.sign_file(util.listdir_abs(self.src_dir, "*.dsc")[0])
952d366f7b14 Implement optional signing of .dsc and .changes files Bernhard Herzog <bh@intevation.de> parents: 176 diff changeset	173
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	174 def package(self):
4 fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	175 """Creates a source package from a subversion checkout.
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	176
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	177 After setting up the working directory, this method calls the
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	178 do_package method to do the actual packaging. Afterwards the
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	179 work directory is removed.
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	180 """
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	181 util.ensure_directory(self.work_dir)
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	182 try:
41 f7ec40638a06 use the enums for the status field of RevisionStatus Bernhard Herzog <bh@intevation.de> parents: 36 diff changeset	183 self.status.creating_source_package()
4 fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	184 self.do_package()
179 952d366f7b14 Implement optional signing of .dsc and .changes files Bernhard Herzog <bh@intevation.de> parents: 176 diff changeset	185 self.sign_package()
41 f7ec40638a06 use the enums for the status field of RevisionStatus Bernhard Herzog <bh@intevation.de> parents: 36 diff changeset	186 self.status.source_package_created()
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	187 finally:
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	188 logging.info("Removing workdir %r", self.work_dir)
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	189 shutil.rmtree(self.work_dir)
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	190
4 fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	191 def do_package(self):
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	192 """Does the work of creating a source package
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	193 This method must be overriden by derived classes.
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	194
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	195 The method should do the work in self.work_dir. When the
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	196 package is done, the source package files should be in
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	197 self.src_dir.
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	198 """
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	199 raise NotImplementedError
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	200
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	201
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	202 class BinaryPackager(object):
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	203
135 e5b4dea52297 Make more of RevisionPackager available to SourcePackager and Bernhard Herzog <bh@intevation.de> parents: 131 diff changeset	204 track = _fromparent("track")
e5b4dea52297 Make more of RevisionPackager available to SourcePackager and Bernhard Herzog <bh@intevation.de> parents: 131 diff changeset	205 status = _fromparent("status")
136 5598014b2a1d Add a log/ subdir for each revision. The filename is available as the Bernhard Herzog <bh@intevation.de> parents: 135 diff changeset	206 log_dir = _fromparent("log_dir")
135 e5b4dea52297 Make more of RevisionPackager available to SourcePackager and Bernhard Herzog <bh@intevation.de> parents: 131 diff changeset	207 binary_dir = _fromparent("binary_dir")
e5b4dea52297 Make more of RevisionPackager available to SourcePackager and Bernhard Herzog <bh@intevation.de> parents: 131 diff changeset	208
e5b4dea52297 Make more of RevisionPackager available to SourcePackager and Bernhard Herzog <bh@intevation.de> parents: 131 diff changeset	209 def __init__(self, parent, dsc_file, logfile):
e5b4dea52297 Make more of RevisionPackager available to SourcePackager and Bernhard Herzog <bh@intevation.de> parents: 131 diff changeset	210 self.parent = parent
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	211 self.dsc_file = dsc_file
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	212 self.logfile = logfile
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	213
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	214 def package(self):
41 f7ec40638a06 use the enums for the status field of RevisionStatus Bernhard Herzog <bh@intevation.de> parents: 36 diff changeset	215 self.status.creating_binary_package()
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	216 util.ensure_directory(self.binary_dir)
149 4526105f81a7 Make sure the log dir exists before attempting to run pbuilder build Bernhard Herzog <bh@intevation.de> parents: 143 diff changeset	217 util.ensure_directory(self.log_dir)
54 b0014b8f6029 fix typo in log message Bernhard Herzog <bh@intevation.de> parents: 53 diff changeset	218 logging.info("Building binary package; logging to %r", self.logfile)
112 cea98d4e4a6a Abstract the pbuilder calls into the new class treepkg.builder.PBuilder. Bernhard Herzog <bh@intevation.de> parents: 106 diff changeset	219 self.track.builder.build(self.dsc_file, self.binary_dir, self.logfile)
179 952d366f7b14 Implement optional signing of .dsc and .changes files Bernhard Herzog <bh@intevation.de> parents: 176 diff changeset	220 self.sign_package()
41 f7ec40638a06 use the enums for the status field of RevisionStatus Bernhard Herzog <bh@intevation.de> parents: 36 diff changeset	221 self.status.binary_package_created()
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	222
179 952d366f7b14 Implement optional signing of .dsc and .changes files Bernhard Herzog <bh@intevation.de> parents: 176 diff changeset	223 def sign_package(self):
952d366f7b14 Implement optional signing of .dsc and .changes files Bernhard Herzog <bh@intevation.de> parents: 176 diff changeset	224 """Signs the .changes file created buy the instance"""
952d366f7b14 Implement optional signing of .dsc and .changes files Bernhard Herzog <bh@intevation.de> parents: 176 diff changeset	225 self.track.sign_file(util.listdir_abs(self.binary_dir, "*.changes")[0])
952d366f7b14 Implement optional signing of .dsc and .changes files Bernhard Herzog <bh@intevation.de> parents: 176 diff changeset	226
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	227
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	228 class RevisionPackager(object):
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	229
4 fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	230 source_packager_cls = SourcePackager
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	231 binary_packager_cls = BinaryPackager
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	232
53 74cd21b6400b rename some variables from pkg_track to track Bernhard Herzog <bh@intevation.de> parents: 52 diff changeset	233 def __init__(self, track, revision):
74cd21b6400b rename some variables from pkg_track to track Bernhard Herzog <bh@intevation.de> parents: 52 diff changeset	234 self.track = track
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	235 self.revision = revision
53 74cd21b6400b rename some variables from pkg_track to track Bernhard Herzog <bh@intevation.de> parents: 52 diff changeset	236 self.base_dir = self.track.pkg_dir_for_revision(self.revision, 1)
36 086c68ca51d2 rename Status to RevisionStatus Bernhard Herzog <bh@intevation.de> parents: 26 diff changeset	237 self.status = status.RevisionStatus(os.path.join(self.base_dir,
086c68ca51d2 rename Status to RevisionStatus Bernhard Herzog <bh@intevation.de> parents: 26 diff changeset	238 "status"))
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	239
172 06af36f915f2 Move the filenameproperty factory from treepkg/packager.py to Bernhard Herzog <bh@intevation.de> parents: 168 diff changeset	240 log_dir = util.filenameproperty("log")
06af36f915f2 Move the filenameproperty factory from treepkg/packager.py to Bernhard Herzog <bh@intevation.de> parents: 168 diff changeset	241 work_dir = util.filenameproperty("work")
06af36f915f2 Move the filenameproperty factory from treepkg/packager.py to Bernhard Herzog <bh@intevation.de> parents: 168 diff changeset	242 binary_dir = util.filenameproperty("binary")
06af36f915f2 Move the filenameproperty factory from treepkg/packager.py to Bernhard Herzog <bh@intevation.de> parents: 168 diff changeset	243 src_dir = util.filenameproperty("src")
06af36f915f2 Move the filenameproperty factory from treepkg/packager.py to Bernhard Herzog <bh@intevation.de> parents: 168 diff changeset	244 build_log = util.filenameproperty("build_log.txt", dir_attr="log_dir")
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	245
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	246 def find_dsc_file(self):
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	247 for filename in os.listdir(self.src_dir):
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	248 if filename.endswith(".dsc"):
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	249 return os.path.join(self.src_dir, filename)
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	250 return None
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	251
18 d5c24cfce05e Improve access to a RevisionPackager's build_log Bernhard Herzog <bh@intevation.de> parents: 16 diff changeset	252 def has_build_log(self):
d5c24cfce05e Improve access to a RevisionPackager's build_log Bernhard Herzog <bh@intevation.de> parents: 16 diff changeset	253 return os.path.exists(self.build_log)
d5c24cfce05e Improve access to a RevisionPackager's build_log Bernhard Herzog <bh@intevation.de> parents: 16 diff changeset	254
140 0da76aee8035 Add RevisionPackager method list_log_files which returns a description Bernhard Herzog <bh@intevation.de> parents: 139 diff changeset	255 def list_log_files(self):
0da76aee8035 Add RevisionPackager method list_log_files which returns a description Bernhard Herzog <bh@intevation.de> parents: 139 diff changeset	256 """Returns a list describing the logfiles available for the revision.
0da76aee8035 Add RevisionPackager method list_log_files which returns a description Bernhard Herzog <bh@intevation.de> parents: 139 diff changeset	257 Each list item is a tuple of the form (TITLE, FILENAME) where
0da76aee8035 Add RevisionPackager method list_log_files which returns a description Bernhard Herzog <bh@intevation.de> parents: 139 diff changeset	258 TITLE is a string with a title usable in e. g. a web-page, and
0da76aee8035 Add RevisionPackager method list_log_files which returns a description Bernhard Herzog <bh@intevation.de> parents: 139 diff changeset	259 FILENAME is the absolute filename of the log file.
0da76aee8035 Add RevisionPackager method list_log_files which returns a description Bernhard Herzog <bh@intevation.de> parents: 139 diff changeset	260 """
0da76aee8035 Add RevisionPackager method list_log_files which returns a description Bernhard Herzog <bh@intevation.de> parents: 139 diff changeset	261 files = []
0da76aee8035 Add RevisionPackager method list_log_files which returns a description Bernhard Herzog <bh@intevation.de> parents: 139 diff changeset	262 if self.has_build_log():
0da76aee8035 Add RevisionPackager method list_log_files which returns a description Bernhard Herzog <bh@intevation.de> parents: 139 diff changeset	263 files.append(("build log", self.build_log))
0da76aee8035 Add RevisionPackager method list_log_files which returns a description Bernhard Herzog <bh@intevation.de> parents: 139 diff changeset	264 return files
0da76aee8035 Add RevisionPackager method list_log_files which returns a description Bernhard Herzog <bh@intevation.de> parents: 139 diff changeset	265
88 3ae54f99db26 Add methods RevisionPackager.list_source_files and Bernhard Herzog <bh@intevation.de> parents: 85 diff changeset	266 def list_source_files(self):
3ae54f99db26 Add methods RevisionPackager.list_source_files and Bernhard Herzog <bh@intevation.de> parents: 85 diff changeset	267 """Returns a list with the names of the files of the source package.
3ae54f99db26 Add methods RevisionPackager.list_source_files and Bernhard Herzog <bh@intevation.de> parents: 85 diff changeset	268 The implementation assumes that all files in self.src_dir belong
3ae54f99db26 Add methods RevisionPackager.list_source_files and Bernhard Herzog <bh@intevation.de> parents: 85 diff changeset	269 to the source package.
3ae54f99db26 Add methods RevisionPackager.list_source_files and Bernhard Herzog <bh@intevation.de> parents: 85 diff changeset	270 """
3ae54f99db26 Add methods RevisionPackager.list_source_files and Bernhard Herzog <bh@intevation.de> parents: 85 diff changeset	271 return sorted(util.listdir_abs(self.src_dir))
3ae54f99db26 Add methods RevisionPackager.list_source_files and Bernhard Herzog <bh@intevation.de> parents: 85 diff changeset	272
3ae54f99db26 Add methods RevisionPackager.list_source_files and Bernhard Herzog <bh@intevation.de> parents: 85 diff changeset	273 def list_binary_files(self):
3ae54f99db26 Add methods RevisionPackager.list_source_files and Bernhard Herzog <bh@intevation.de> parents: 85 diff changeset	274 """Returns a list with the names of the files of the binary packages.
3ae54f99db26 Add methods RevisionPackager.list_source_files and Bernhard Herzog <bh@intevation.de> parents: 85 diff changeset	275 The implementation assumes that all files in self.binary_dir belong
3ae54f99db26 Add methods RevisionPackager.list_source_files and Bernhard Herzog <bh@intevation.de> parents: 85 diff changeset	276 to the binary packages.
3ae54f99db26 Add methods RevisionPackager.list_source_files and Bernhard Herzog <bh@intevation.de> parents: 85 diff changeset	277 """
3ae54f99db26 Add methods RevisionPackager.list_source_files and Bernhard Herzog <bh@intevation.de> parents: 85 diff changeset	278 return sorted(util.listdir_abs(self.binary_dir))
3ae54f99db26 Add methods RevisionPackager.list_source_files and Bernhard Herzog <bh@intevation.de> parents: 85 diff changeset	279
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	280 def package(self):
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	281 try:
16 7c55f3879c4d Use the new status class and report start/stop time too Bernhard Herzog <bh@intevation.de> parents: 14 diff changeset	282 util.ensure_directory(self.work_dir)
7c55f3879c4d Use the new status class and report start/stop time too Bernhard Herzog <bh@intevation.de> parents: 14 diff changeset	283 self.status.start = datetime.datetime.utcnow()
135 e5b4dea52297 Make more of RevisionPackager available to SourcePackager and Bernhard Herzog <bh@intevation.de> parents: 131 diff changeset	284 src_packager = self.source_packager_cls(self)
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	285 src_packager.package()
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	286
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	287 dsc_file = self.find_dsc_file()
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	288 if dsc_file is None:
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	289 raise RuntimeError("Cannot find dsc File in %r" % self.src_dir)
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	290
135 e5b4dea52297 Make more of RevisionPackager available to SourcePackager and Bernhard Herzog <bh@intevation.de> parents: 131 diff changeset	291 bin_packager = self.binary_packager_cls(self, dsc_file,
18 d5c24cfce05e Improve access to a RevisionPackager's build_log Bernhard Herzog <bh@intevation.de> parents: 16 diff changeset	292 self.build_log)
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	293 bin_packager.package()
16 7c55f3879c4d Use the new status class and report start/stop time too Bernhard Herzog <bh@intevation.de> parents: 14 diff changeset	294 self.status.stop = datetime.datetime.utcnow()
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	295 except:
41 f7ec40638a06 use the enums for the status field of RevisionStatus Bernhard Herzog <bh@intevation.de> parents: 36 diff changeset	296 self.status.error()
16 7c55f3879c4d Use the new status class and report start/stop time too Bernhard Herzog <bh@intevation.de> parents: 14 diff changeset	297 self.status.stop = datetime.datetime.utcnow()
99 7888fe374e11 Add support for notification mails in case of build errors Bernhard Herzog <bh@intevation.de> parents: 98 diff changeset	298 # set the notification status last to avoid race conditions.
7888fe374e11 Add support for notification mails in case of build errors Bernhard Herzog <bh@intevation.de> parents: 98 diff changeset	299 # The pending notification is for now the only situation
7888fe374e11 Add support for notification mails in case of build errors Bernhard Herzog <bh@intevation.de> parents: 98 diff changeset	300 # where another process might modify the status file (the
7888fe374e11 Add support for notification mails in case of build errors Bernhard Herzog <bh@intevation.de> parents: 98 diff changeset	301 # listpendingnotifications program will set it to
7888fe374e11 Add support for notification mails in case of build errors Bernhard Herzog <bh@intevation.de> parents: 98 diff changeset	302 # "notification_sent")
7888fe374e11 Add support for notification mails in case of build errors Bernhard Herzog <bh@intevation.de> parents: 98 diff changeset	303 self.status.notification_pending()
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	304 raise
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	305
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	306 def remove_package_dir(self):
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	307 logging.info("Removing pkgdir %r", self.base_dir)
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	308 shutil.rmtree(self.base_dir)
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	309
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	310
52 78cf5f6778ec Rename 'packagel ine' -> 'package track' Bernhard Herzog <bh@intevation.de> parents: 49 diff changeset	311 class PackageTrack(object):
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	312
4 fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	313 revision_packager_cls = RevisionPackager
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	314
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	315 svn_external_subdirs = []
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	316
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	317 extra_config_desc = []
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	318
47 2802be410156 add config options pbuilderrc and use it when calling pbuilder Bernhard Herzog <bh@intevation.de> parents: 16 diff changeset	319 def __init__(self, name, base_dir, svn_url, root_cmd, pbuilderrc, deb_email,
93 73c67372c7f7 Make the prefix used in the debian revision number configurable. Bernhard Herzog <bh@intevation.de> parents: 91 diff changeset	320 deb_fullname, packager_class="treepkg.packager",
167 36004ee0b3a1 Introduce package track config option signing_key_id to specify the Bernhard Herzog <bh@intevation.de> parents: 149 diff changeset	321 debrevision_prefix="treepkg", handle_dependencies=False,
191 94fb3f3ab58b When building a subset of tracks, make sure new packages are added to Bernhard Herzog <bh@intevation.de> parents: 190 diff changeset	322 signing_key_id="", do_build=True):
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	323 self.name = name
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	324 self.base_dir = base_dir
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	325 self.svn_url = svn_url
176 7bde59aa611e Make PBuilder.update_extra_pkg_dir create Release and Release.gpg files Bernhard Herzog <bh@intevation.de> parents: 172 diff changeset	326 self.builder = PBuilder(pbuilderrc, root_cmd,
7bde59aa611e Make PBuilder.update_extra_pkg_dir create Release and Release.gpg files Bernhard Herzog <bh@intevation.de> parents: 172 diff changeset	327 release_signing_keyid=signing_key_id)
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	328 self.deb_email = deb_email
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	329 self.deb_fullname = deb_fullname
93 73c67372c7f7 Make the prefix used in the debian revision number configurable. Bernhard Herzog <bh@intevation.de> parents: 91 diff changeset	330 self.debrevision_prefix = debrevision_prefix
167 36004ee0b3a1 Introduce package track config option signing_key_id to specify the Bernhard Herzog <bh@intevation.de> parents: 149 diff changeset	331 self.signing_key_id = signing_key_id
191 94fb3f3ab58b When building a subset of tracks, make sure new packages are added to Bernhard Herzog <bh@intevation.de> parents: 190 diff changeset	332 self.do_build = do_build
128 5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	333 self.handle_dependencies = handle_dependencies
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	334 self.dependencies = None
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	335 self.pkg_dir_template = "%(revision)d-%(increment)d"
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	336 self.pkg_dir_regex \
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	337 = re.compile(r"(?P<revision>[0-9]+)-(?P<increment>[0-9]+)$")
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	338
172 06af36f915f2 Move the filenameproperty factory from treepkg/packager.py to Bernhard Herzog <bh@intevation.de> parents: 168 diff changeset	339 checkout_dir = util.filenameproperty("checkout")
06af36f915f2 Move the filenameproperty factory from treepkg/packager.py to Bernhard Herzog <bh@intevation.de> parents: 168 diff changeset	340 debian_dir = util.filenameproperty("debian")
06af36f915f2 Move the filenameproperty factory from treepkg/packager.py to Bernhard Herzog <bh@intevation.de> parents: 168 diff changeset	341 pkg_dir = util.filenameproperty("pkg")
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	342
106 66cbfc772f84 Add bin/inittreepkg.py, a script to automate some of the installation Bernhard Herzog <bh@intevation.de> parents: 99 diff changeset	343 def init_treepkg(self):
66cbfc772f84 Add bin/inittreepkg.py, a script to automate some of the installation Bernhard Herzog <bh@intevation.de> parents: 99 diff changeset	344 print "Initializing", self.name
66cbfc772f84 Add bin/inittreepkg.py, a script to automate some of the installation Bernhard Herzog <bh@intevation.de> parents: 99 diff changeset	345 if not os.path.exists(self.base_dir):
66cbfc772f84 Add bin/inittreepkg.py, a script to automate some of the installation Bernhard Herzog <bh@intevation.de> parents: 99 diff changeset	346 print "creating %s" % (self.base_dir,)
66cbfc772f84 Add bin/inittreepkg.py, a script to automate some of the installation Bernhard Herzog <bh@intevation.de> parents: 99 diff changeset	347 util.ensure_directory(self.base_dir)
66cbfc772f84 Add bin/inittreepkg.py, a script to automate some of the installation Bernhard Herzog <bh@intevation.de> parents: 99 diff changeset	348 if not os.path.exists(self.debian_dir):
66cbfc772f84 Add bin/inittreepkg.py, a script to automate some of the installation Bernhard Herzog <bh@intevation.de> parents: 99 diff changeset	349 print ("TODO: the debian directory %s still has to be created"
66cbfc772f84 Add bin/inittreepkg.py, a script to automate some of the installation Bernhard Herzog <bh@intevation.de> parents: 99 diff changeset	350 % (self.debian_dir,))
66cbfc772f84 Add bin/inittreepkg.py, a script to automate some of the installation Bernhard Herzog <bh@intevation.de> parents: 99 diff changeset	351
128 5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	352 def determine_dependencies(self):
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	353 if self.dependencies is not None:
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	354 return
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	355
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	356 requires = ()
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	357 provides = ()
131 bea9f1cc0bef Try to determine dependencies only when treepkg is fully configured. Bernhard Herzog <bh@intevation.de> parents: 128 diff changeset	358 # only try to parse the control file if the debian directory
bea9f1cc0bef Try to determine dependencies only when treepkg is fully configured. Bernhard Herzog <bh@intevation.de> parents: 128 diff changeset	359 # exists. If the debian directory doesn't exist yet, the tree
bea9f1cc0bef Try to determine dependencies only when treepkg is fully configured. Bernhard Herzog <bh@intevation.de> parents: 128 diff changeset	360 # packager is likely still being configured and this code may be
bea9f1cc0bef Try to determine dependencies only when treepkg is fully configured. Bernhard Herzog <bh@intevation.de> parents: 128 diff changeset	361 # run indirectly from e. g. bin/inittreepkg.py in which case the
bea9f1cc0bef Try to determine dependencies only when treepkg is fully configured. Bernhard Herzog <bh@intevation.de> parents: 128 diff changeset	362 # init_treepkg method will report the missing debian
bea9f1cc0bef Try to determine dependencies only when treepkg is fully configured. Bernhard Herzog <bh@intevation.de> parents: 128 diff changeset	363 if self.handle_dependencies and os.path.exists(self.debian_dir):
128 5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	364 control = debian.DebianControlFile(os.path.join(self.debian_dir,
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	365 "control"))
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	366 requires = control.build_depends
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	367 provides = (pkg[0] for pkg in control.packages)
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	368 self.dependencies = (set(requires), set(provides))
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	369 logging.debug("Track %s: build depends: %s", self.name,
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	370 " ".join(self.dependencies[0]))
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	371 logging.debug("Track %s: provides: %s", self.name,
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	372 " ".join(self.dependencies[1]))
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	373
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	374 def dependencies_required(self):
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	375 """Returns a list of required packages"""
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	376 self.determine_dependencies()
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	377 return self.dependencies[0]
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	378
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	379 def dependencies_provided(self):
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	380 """Returns a list of provided packages"""
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	381 self.determine_dependencies()
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	382 return self.dependencies[1]
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	383
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	384 def pkg_dir_for_revision(self, revision, increment):
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	385 return os.path.join(self.pkg_dir,
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	386 self.pkg_dir_template % locals())
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	387
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	388 def last_changed_revision(self):
4 fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	389 revisions = []
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	390 for directory in [self.checkout_dir] + self.svn_external_subdirs:
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	391 directory = os.path.join(self.checkout_dir, directory)
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	392 revisions.append(subversion.last_changed_revision(directory))
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	393 return max(revisions)
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	394
11 6efe0bd3d8c1 Add method RevisionPackager.get_revision_numbers Bernhard Herzog <bh@intevation.de> parents: 10 diff changeset	395 def get_revision_numbers(self):
6efe0bd3d8c1 Add method RevisionPackager.get_revision_numbers Bernhard Herzog <bh@intevation.de> parents: 10 diff changeset	396 """Returns a list of the numbers of the packaged revisions"""
6efe0bd3d8c1 Add method RevisionPackager.get_revision_numbers Bernhard Herzog <bh@intevation.de> parents: 10 diff changeset	397 revisions = []
6efe0bd3d8c1 Add method RevisionPackager.get_revision_numbers Bernhard Herzog <bh@intevation.de> parents: 10 diff changeset	398 if os.path.exists(self.pkg_dir):
6efe0bd3d8c1 Add method RevisionPackager.get_revision_numbers Bernhard Herzog <bh@intevation.de> parents: 10 diff changeset	399 for filename in os.listdir(self.pkg_dir):
6efe0bd3d8c1 Add method RevisionPackager.get_revision_numbers Bernhard Herzog <bh@intevation.de> parents: 10 diff changeset	400 match = self.pkg_dir_regex.match(filename)
6efe0bd3d8c1 Add method RevisionPackager.get_revision_numbers Bernhard Herzog <bh@intevation.de> parents: 10 diff changeset	401 if match:
6efe0bd3d8c1 Add method RevisionPackager.get_revision_numbers Bernhard Herzog <bh@intevation.de> parents: 10 diff changeset	402 revisions.append(int(match.group("revision")))
85 31b0567df051 Make PackageTrack.get_revision_numbers return the revisions as a sorted Bernhard Herzog <bh@intevation.de> parents: 84 diff changeset	403 revisions.sort()
11 6efe0bd3d8c1 Add method RevisionPackager.get_revision_numbers Bernhard Herzog <bh@intevation.de> parents: 10 diff changeset	404 return revisions
6efe0bd3d8c1 Add method RevisionPackager.get_revision_numbers Bernhard Herzog <bh@intevation.de> parents: 10 diff changeset	405
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	406 def last_packaged_revision(self):
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	407 """Returns the revision number of the highest packaged revision.
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	408
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	409 If the revision cannot be determined because no already packaged
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	410 revisions can be found, the function returns -1.
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	411 """
11 6efe0bd3d8c1 Add method RevisionPackager.get_revision_numbers Bernhard Herzog <bh@intevation.de> parents: 10 diff changeset	412 return max([-1] + self.get_revision_numbers())
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	413
80 0af2fa3790e0 Add revision parameter to PackagerGroup.__init__ and some other methods Bernhard Herzog <bh@intevation.de> parents: 78 diff changeset	414 def update_checkout(self, revision=None):
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	415 """Updates the working copy of self.svn_url in self.checkout_dir.
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	416
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	417 If self.checkout_dir doesn't exist yet, self.svn_url is checked
80 0af2fa3790e0 Add revision parameter to PackagerGroup.__init__ and some other methods Bernhard Herzog <bh@intevation.de> parents: 78 diff changeset	418 out into that directory. The value of the revision parameter is
0af2fa3790e0 Add revision parameter to PackagerGroup.__init__ and some other methods Bernhard Herzog <bh@intevation.de> parents: 78 diff changeset	419 passed through to subversion.update.
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	420 """
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	421 localdir = self.checkout_dir
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	422 if os.path.exists(localdir):
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	423 logging.info("Updating the working copy in %r", localdir)
80 0af2fa3790e0 Add revision parameter to PackagerGroup.__init__ and some other methods Bernhard Herzog <bh@intevation.de> parents: 78 diff changeset	424 subversion.update(localdir, revision=revision)
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	425 else:
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	426 logging.info("The working copy in %r doesn't exist yet."
26 06fba656dde8 fix typo Bernhard Herzog <bh@intevation.de> parents: 18 diff changeset	427 " Checking out from %r", localdir,
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	428 self.svn_url)
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	429 subversion.checkout(self.svn_url, localdir)
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	430
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	431 def export_sources(self, to_dir):
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	432 logging.info("Exporting sources for tarball to %r", to_dir)
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	433 subversion.export(self.checkout_dir, to_dir)
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	434 # some versions of svn (notably version 1.4.2 shipped with etch)
202 b1929c11a020 Fix comment Bernhard Herzog <bh@intevation.de> parents: 194 diff changeset	435 # do not export externals such as the admin subdirectory. We
b1929c11a020 Fix comment Bernhard Herzog <bh@intevation.de> parents: 194 diff changeset	436 # may have to do that in an extra step.
4 fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	437 for subdir in self.svn_external_subdirs:
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	438 absdir = os.path.join(to_dir, subdir)
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	439 if not os.path.isdir(absdir):
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	440 subversion.export(os.path.join(self.checkout_dir, subdir),
fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	441 absdir)
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	442
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	443 def copy_debian_directory(self, to_dir):
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	444 logging.info("Copying debian directory to %r", to_dir)
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	445 shutil.copytree(self.debian_dir, to_dir)
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	446
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	447 def debian_environment(self):
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	448 """Returns the environment variables for the debian commands"""
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	449 env = os.environ.copy()
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	450 env["DEBFULLNAME"] = self.deb_fullname
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	451 env["DEBEMAIL"] = self.deb_email
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	452 return env
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	453
190 e83db4482aab Add runtreepkg.py command line option --no-svn-update to inhibit updates Bernhard Herzog <bh@intevation.de> parents: 179 diff changeset	454 def package_if_updated(self, revision=None, do_svn_update=True):
e83db4482aab Add runtreepkg.py command line option --no-svn-update to inhibit updates Bernhard Herzog <bh@intevation.de> parents: 179 diff changeset	455 """Returns a new packager if the working copy has not been packaged yet.
e83db4482aab Add runtreepkg.py command line option --no-svn-update to inhibit updates Bernhard Herzog <bh@intevation.de> parents: 179 diff changeset	456 If do_svn_update is true -- the default -- update the working
e83db4482aab Add runtreepkg.py command line option --no-svn-update to inhibit updates Bernhard Herzog <bh@intevation.de> parents: 179 diff changeset	457 copy to the the revision specified with the revision parameter
e83db4482aab Add runtreepkg.py command line option --no-svn-update to inhibit updates Bernhard Herzog <bh@intevation.de> parents: 179 diff changeset	458 or if revision is None, the latest revision in the repository."""
191 94fb3f3ab58b When building a subset of tracks, make sure new packages are added to Bernhard Herzog <bh@intevation.de> parents: 190 diff changeset	459 if not self.do_build:
94fb3f3ab58b When building a subset of tracks, make sure new packages are added to Bernhard Herzog <bh@intevation.de> parents: 190 diff changeset	460 return None
190 e83db4482aab Add runtreepkg.py command line option --no-svn-update to inhibit updates Bernhard Herzog <bh@intevation.de> parents: 179 diff changeset	461 if do_svn_update:
e83db4482aab Add runtreepkg.py command line option --no-svn-update to inhibit updates Bernhard Herzog <bh@intevation.de> parents: 179 diff changeset	462 self.update_checkout(revision=revision)
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	463 current_revision = self.last_changed_revision()
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	464 logging.info("New revision is %d", current_revision)
98 f7b9c7113c46 Make packaging a specific revision work even if newer revisions have already Bernhard Herzog <bh@intevation.de> parents: 93 diff changeset	465 if current_revision not in self.get_revision_numbers():
f7b9c7113c46 Make packaging a specific revision work even if newer revisions have already Bernhard Herzog <bh@intevation.de> parents: 93 diff changeset	466 logging.info("Revision %d has not been packaged yet",
f7b9c7113c46 Make packaging a specific revision work even if newer revisions have already Bernhard Herzog <bh@intevation.de> parents: 93 diff changeset	467 current_revision)
4 fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	468 return self.revision_packager_cls(self, current_revision)
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	469 else:
98 f7b9c7113c46 Make packaging a specific revision work even if newer revisions have already Bernhard Herzog <bh@intevation.de> parents: 93 diff changeset	470 logging.info("Revision %d has already been packaged.",
f7b9c7113c46 Make packaging a specific revision work even if newer revisions have already Bernhard Herzog <bh@intevation.de> parents: 93 diff changeset	471 current_revision)
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	472
14 dfd89f81e66c Add simple status report tool. Still using the old status files Bernhard Herzog <bh@intevation.de> parents: 11 diff changeset	473 def get_revisions(self):
dfd89f81e66c Add simple status report tool. Still using the old status files Bernhard Herzog <bh@intevation.de> parents: 11 diff changeset	474 """Returns RevisionPackager objects for each packaged revision"""
dfd89f81e66c Add simple status report tool. Still using the old status files Bernhard Herzog <bh@intevation.de> parents: 11 diff changeset	475 return [self.revision_packager_cls(self, revision)
dfd89f81e66c Add simple status report tool. Still using the old status files Bernhard Herzog <bh@intevation.de> parents: 11 diff changeset	476 for revision in self.get_revision_numbers()]
dfd89f81e66c Add simple status report tool. Still using the old status files Bernhard Herzog <bh@intevation.de> parents: 11 diff changeset	477
179 952d366f7b14 Implement optional signing of .dsc and .changes files Bernhard Herzog <bh@intevation.de> parents: 176 diff changeset	478 def sign_file(self, filename):
952d366f7b14 Implement optional signing of .dsc and .changes files Bernhard Herzog <bh@intevation.de> parents: 176 diff changeset	479 """Signs a file using the debian.sign_file function.
952d366f7b14 Implement optional signing of .dsc and .changes files Bernhard Herzog <bh@intevation.de> parents: 176 diff changeset	480 The file is signed with the key indicated by the track's
952d366f7b14 Implement optional signing of .dsc and .changes files Bernhard Herzog <bh@intevation.de> parents: 176 diff changeset	481 signing_key_id attribute. If that is empty, the file is not
952d366f7b14 Implement optional signing of .dsc and .changes files Bernhard Herzog <bh@intevation.de> parents: 176 diff changeset	482 signed.
952d366f7b14 Implement optional signing of .dsc and .changes files Bernhard Herzog <bh@intevation.de> parents: 176 diff changeset	483 """
952d366f7b14 Implement optional signing of .dsc and .changes files Bernhard Herzog <bh@intevation.de> parents: 176 diff changeset	484 if self.signing_key_id:
952d366f7b14 Implement optional signing of .dsc and .changes files Bernhard Herzog <bh@intevation.de> parents: 176 diff changeset	485 logging.info("Signing %r with key %r", filename,
952d366f7b14 Implement optional signing of .dsc and .changes files Bernhard Herzog <bh@intevation.de> parents: 176 diff changeset	486 self.signing_key_id)
952d366f7b14 Implement optional signing of .dsc and .changes files Bernhard Herzog <bh@intevation.de> parents: 176 diff changeset	487 debian.sign_file(filename, self.signing_key_id)
952d366f7b14 Implement optional signing of .dsc and .changes files Bernhard Herzog <bh@intevation.de> parents: 176 diff changeset	488
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	489
113 312949e7628d Add a smarter way to load the packager modules: Add the function Bernhard Herzog <bh@intevation.de> parents: 112 diff changeset	490 def import_packager_module(packager_class):
312949e7628d Add a smarter way to load the packager modules: Add the function Bernhard Herzog <bh@intevation.de> parents: 112 diff changeset	491 """Import the packager module named by packager_class.
312949e7628d Add a smarter way to load the packager modules: Add the function Bernhard Herzog <bh@intevation.de> parents: 112 diff changeset	492
312949e7628d Add a smarter way to load the packager modules: Add the function Bernhard Herzog <bh@intevation.de> parents: 112 diff changeset	493 The packager_class must be the full absolute module name for the
125 34e08d52956e Make the import_packager_module function more flexible. The modules may Bernhard Herzog <bh@intevation.de> parents: 113 diff changeset	494 packager. The function tries to find or create a suitable
34e08d52956e Make the import_packager_module function more flexible. The modules may Bernhard Herzog <bh@intevation.de> parents: 113 diff changeset	495 PackageTrack class from this module using the following rules:
34e08d52956e Make the import_packager_module function more flexible. The modules may Bernhard Herzog <bh@intevation.de> parents: 113 diff changeset	496
34e08d52956e Make the import_packager_module function more flexible. The modules may Bernhard Herzog <bh@intevation.de> parents: 113 diff changeset	497 - If the module contains a class called PackageTrack, use that.
34e08d52956e Make the import_packager_module function more flexible. The modules may Bernhard Herzog <bh@intevation.de> parents: 113 diff changeset	498
34e08d52956e Make the import_packager_module function more flexible. The modules may Bernhard Herzog <bh@intevation.de> parents: 113 diff changeset	499 - Otherwise create one using the module's RevisionPackager class,
34e08d52956e Make the import_packager_module function more flexible. The modules may Bernhard Herzog <bh@intevation.de> parents: 113 diff changeset	500 creating RevisionPackager if necessary.
34e08d52956e Make the import_packager_module function more flexible. The modules may Bernhard Herzog <bh@intevation.de> parents: 113 diff changeset	501
34e08d52956e Make the import_packager_module function more flexible. The modules may Bernhard Herzog <bh@intevation.de> parents: 113 diff changeset	502 - If RevisionPackager needs to be created, it uses the module's
34e08d52956e Make the import_packager_module function more flexible. The modules may Bernhard Herzog <bh@intevation.de> parents: 113 diff changeset	503 SourcePackager as source_packager_cls and if present also the
34e08d52956e Make the import_packager_module function more flexible. The modules may Bernhard Herzog <bh@intevation.de> parents: 113 diff changeset	504 module's BinaryPackager as binary_packager_cls. If the module
34e08d52956e Make the import_packager_module function more flexible. The modules may Bernhard Herzog <bh@intevation.de> parents: 113 diff changeset	505 does not have a BinaryPackager, the default BinaryPackager is
34e08d52956e Make the import_packager_module function more flexible. The modules may Bernhard Herzog <bh@intevation.de> parents: 113 diff changeset	506 used.
113 312949e7628d Add a smarter way to load the packager modules: Add the function Bernhard Herzog <bh@intevation.de> parents: 112 diff changeset	507 """
312949e7628d Add a smarter way to load the packager modules: Add the function Bernhard Herzog <bh@intevation.de> parents: 112 diff changeset	508 module = util.import_dotted_name(packager_class)
312949e7628d Add a smarter way to load the packager modules: Add the function Bernhard Herzog <bh@intevation.de> parents: 112 diff changeset	509 if not hasattr(module, "PackageTrack"):
125 34e08d52956e Make the import_packager_module function more flexible. The modules may Bernhard Herzog <bh@intevation.de> parents: 113 diff changeset	510 if not hasattr(module, "RevisionPackager"):
34e08d52956e Make the import_packager_module function more flexible. The modules may Bernhard Herzog <bh@intevation.de> parents: 113 diff changeset	511 binary_packager = getattr(module, "BinaryPackager", BinaryPackager)
34e08d52956e Make the import_packager_module function more flexible. The modules may Bernhard Herzog <bh@intevation.de> parents: 113 diff changeset	512 module.RevisionPackager \
34e08d52956e Make the import_packager_module function more flexible. The modules may Bernhard Herzog <bh@intevation.de> parents: 113 diff changeset	513 = new.classobj("RevisionPackager", (RevisionPackager,),
34e08d52956e Make the import_packager_module function more flexible. The modules may Bernhard Herzog <bh@intevation.de> parents: 113 diff changeset	514 dict(source_packager_cls=module.SourcePackager,
34e08d52956e Make the import_packager_module function more flexible. The modules may Bernhard Herzog <bh@intevation.de> parents: 113 diff changeset	515 binary_packager_cls=binary_packager))
113 312949e7628d Add a smarter way to load the packager modules: Add the function Bernhard Herzog <bh@intevation.de> parents: 112 diff changeset	516 module.PackageTrack \
312949e7628d Add a smarter way to load the packager modules: Add the function Bernhard Herzog <bh@intevation.de> parents: 112 diff changeset	517 = new.classobj("PackageTrack", (PackageTrack,),
312949e7628d Add a smarter way to load the packager modules: Add the function Bernhard Herzog <bh@intevation.de> parents: 112 diff changeset	518 dict(revision_packager_cls=module.RevisionPackager))
312949e7628d Add a smarter way to load the packager modules: Add the function Bernhard Herzog <bh@intevation.de> parents: 112 diff changeset	519 return module
312949e7628d Add a smarter way to load the packager modules: Add the function Bernhard Herzog <bh@intevation.de> parents: 112 diff changeset	520
52 78cf5f6778ec Rename 'packagel ine' -> 'package track' Bernhard Herzog <bh@intevation.de> parents: 49 diff changeset	521 def create_package_track(packager_class, **kw):
113 312949e7628d Add a smarter way to load the packager modules: Add the function Bernhard Herzog <bh@intevation.de> parents: 112 diff changeset	522 module = import_packager_module(packager_class)
52 78cf5f6778ec Rename 'packagel ine' -> 'package track' Bernhard Herzog <bh@intevation.de> parents: 49 diff changeset	523 return module.PackageTrack(**kw)
4 fee641fec94e Separate the kolab specific parts. Bernhard Herzog <bh@intevation.de> parents: 2 diff changeset	524
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	525
128 5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	526 class CyclicDependencyError(Exception):
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	527
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	528 """Exception thrown when a cycle is detected in the track dependencies"""
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	529
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	530 def __init__(self, tracks):
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	531 Exception.__init__(self,
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	532 "Cyclic dependencies between" " tracks (%s)"
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	533 % ", ".join([track.name for track in tracks]))
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	534
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	535
7 96f4f58c62b5 Rename the Packager class to PackagerGroup Bernhard Herzog <bh@intevation.de> parents: 4 diff changeset	536 class PackagerGroup(object):
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	537
91 3ed079a7174a Implement a way to stop a running treepackager. Bernhard Herzog <bh@intevation.de> parents: 90 diff changeset	538 def __init__(self, package_tracks, check_interval, revision=None,
190 e83db4482aab Add runtreepkg.py command line option --no-svn-update to inhibit updates Bernhard Herzog <bh@intevation.de> parents: 179 diff changeset	539 instructions_file=None, do_svn_update=True):
52 78cf5f6778ec Rename 'packagel ine' -> 'package track' Bernhard Herzog <bh@intevation.de> parents: 49 diff changeset	540 self.package_tracks = package_tracks
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	541 self.check_interval = check_interval
80 0af2fa3790e0 Add revision parameter to PackagerGroup.__init__ and some other methods Bernhard Herzog <bh@intevation.de> parents: 78 diff changeset	542 self.revision = revision
190 e83db4482aab Add runtreepkg.py command line option --no-svn-update to inhibit updates Bernhard Herzog <bh@intevation.de> parents: 179 diff changeset	543 self.do_svn_update = do_svn_update
91 3ed079a7174a Implement a way to stop a running treepackager. Bernhard Herzog <bh@intevation.de> parents: 90 diff changeset	544 self.instructions_file = instructions_file
3ed079a7174a Implement a way to stop a running treepackager. Bernhard Herzog <bh@intevation.de> parents: 90 diff changeset	545 self.instructions_file_removed = False
128 5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	546 self.sort_tracks()
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	547
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	548 def sort_tracks(self):
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	549 """Sorts tracks for dependency handling"""
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	550 todo = self.package_tracks[:]
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	551 sorted = []
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	552 seen = set()
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	553
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	554 # dependencies that can be solved by one of the tracks
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	555 known = set()
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	556 for track in todo:
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	557 known \|= track.dependencies_provided()
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	558
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	559 while todo:
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	560 todo_again = []
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	561 for track in todo:
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	562 if not track.handle_dependencies:
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	563 sorted.append(track)
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	564 continue
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	565
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	566 unmet = (track.dependencies_required() & known) - seen
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	567 if unmet:
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	568 todo_again.append(track)
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	569 else:
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	570 sorted.append(track)
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	571 seen \|= track.dependencies_provided()
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	572 if todo_again == todo:
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	573 raise CyclicDependencyError(todo)
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	574 todo = todo_again
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	575
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	576 self.package_tracks = sorted
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	577 self.needed_binaries = set()
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	578 for track in self.package_tracks:
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	579 self.needed_binaries \|= track.dependencies_required()
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	580 self.needed_binaries &= known
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	581
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	582 logging.info("sorted track order: %s",
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	583 " ".join(track.name for track in sorted))
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	584 logging.info("binary packages needed as build dependencies: %s",
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	585 " ".join(self.needed_binaries))
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	586
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	587
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	588 def run(self):
7 96f4f58c62b5 Rename the Packager class to PackagerGroup Bernhard Herzog <bh@intevation.de> parents: 4 diff changeset	589 """Runs the packager group indefinitely"""
78 9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: 55 diff changeset	590 logging.info("Starting in periodic check mode."
9a602d8eaa60 initial revision of the subversion repository Thomas Arendsen Hein <thomas@intevation.de> parents: 55 diff changeset	591 " Will check every %d seconds", self.check_interval)
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	592 last_check = -1
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	593 while 1:
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	594 now = time.time()
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	595 if now > last_check + self.check_interval:
91 3ed079a7174a Implement a way to stop a running treepackager. Bernhard Herzog <bh@intevation.de> parents: 90 diff changeset	596 if self.check_package_tracks():
3ed079a7174a Implement a way to stop a running treepackager. Bernhard Herzog <bh@intevation.de> parents: 90 diff changeset	597 break
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	598 last_check = now
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	599 next_check = now + self.check_interval
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	600 to_sleep = next_check - time.time()
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	601 if to_sleep > 0:
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	602 logging.info("Next check at %s",
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	603 time.strftime("%Y-%m-%d %H:%M:%S",
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	604 time.localtime(next_check)))
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	605 time.sleep(to_sleep)
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	606 else:
f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	607 logging.info("Next check now")
91 3ed079a7174a Implement a way to stop a running treepackager. Bernhard Herzog <bh@intevation.de> parents: 90 diff changeset	608 if self.should_stop():
3ed079a7174a Implement a way to stop a running treepackager. Bernhard Herzog <bh@intevation.de> parents: 90 diff changeset	609 logging.info("Received stop instruction. Stopping.")
3ed079a7174a Implement a way to stop a running treepackager. Bernhard Herzog <bh@intevation.de> parents: 90 diff changeset	610 return
0 f78a02e79c84 initial checkin Bernhard Herzog <bh@intevation.de> parents: diff changeset	611
52 78cf5f6778ec Rename 'packagel ine' -> 'package track' Bernhard Herzog <bh@intevation.de> parents: 49 diff changeset	612 def check_package_tracks(self):
78cf5f6778ec Rename 'packagel ine' -> 'package track' Bernhard Herzog <bh@intevation.de> parents: 49 diff changeset	613 logging.info("Checking package tracks")
91 3ed079a7174a Implement a way to stop a running treepackager. Bernhard Herzog <bh@intevation.de> parents: 90 diff changeset	614 self.clear_instruction()
128 5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	615 repeat = True
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	616 while repeat:
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	617 repeat = False
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	618 for track in self.package_tracks:
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	619 try:
190 e83db4482aab Add runtreepkg.py command line option --no-svn-update to inhibit updates Bernhard Herzog <bh@intevation.de> parents: 179 diff changeset	620 packager = track.package_if_updated(revision=self.revision,
e83db4482aab Add runtreepkg.py command line option --no-svn-update to inhibit updates Bernhard Herzog <bh@intevation.de> parents: 179 diff changeset	621 do_svn_update=self.do_svn_update)
128 5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	622 if packager:
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	623 packager.package()
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	624 repeat = self.install_dependencies(track, packager)
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	625 if self.should_stop():
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	626 logging.info("Received stop instruction. Stopping.")
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	627 return True
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	628 except:
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	629 logging.exception("An error occurred while"
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	630 " checking packager track %r", track.name)
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	631 if repeat:
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	632 logging.info("Built binaries needed by other tracks."
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	633 " Starting over to ensure all dependencies"
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	634 " are met")
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	635 break
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	636
52 78cf5f6778ec Rename 'packagel ine' -> 'package track' Bernhard Herzog <bh@intevation.de> parents: 49 diff changeset	637 logging.info("Checked all package tracks")
14 dfd89f81e66c Add simple status report tool. Still using the old status files Bernhard Herzog <bh@intevation.de> parents: 11 diff changeset	638
128 5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	639
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	640 def install_dependencies(self, track, packager):
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	641 """Add the binaries built by packager to the builder, if necessary.
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	642 It is necessary if any track depends on the packages. The
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	643 method simply installs all binary files built by the packger
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	644 instead of only those which are immediately required by a track.
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	645 This is done because tracks usually depend directly only on the
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	646 -dev packages which usually require another binary package built
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	647 at the same time.
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	648 """
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	649 if (track.handle_dependencies
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	650 and track.dependencies_provided() & self.needed_binaries):
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	651 # FIXME: this basically assumes that all tracks use the same
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	652 # builder. This is true for now, but it is possible to
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	653 # configure treepkg with different builders for different
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	654 # tracks and we really should be installing the newly built
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	655 # binaries into the builder of the tracks which depends on
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	656 # them
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	657 binaries = packager.list_binary_files()
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	658 track.builder.add_binaries_to_extra_pkg(binaries)
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	659 return True
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	660 return False
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	661
5155b4f9443d Add basic dependency handling to PackageTrack and PackagerGroup. Bernhard Herzog <bh@intevation.de> parents: 125 diff changeset	662
52 78cf5f6778ec Rename 'packagel ine' -> 'package track' Bernhard Herzog <bh@intevation.de> parents: 49 diff changeset	663 def get_package_tracks(self):
78cf5f6778ec Rename 'packagel ine' -> 'package track' Bernhard Herzog <bh@intevation.de> parents: 49 diff changeset	664 return self.package_tracks
91 3ed079a7174a Implement a way to stop a running treepackager. Bernhard Herzog <bh@intevation.de> parents: 90 diff changeset	665
3ed079a7174a Implement a way to stop a running treepackager. Bernhard Herzog <bh@intevation.de> parents: 90 diff changeset	666 def read_instruction(self):
3ed079a7174a Implement a way to stop a running treepackager. Bernhard Herzog <bh@intevation.de> parents: 90 diff changeset	667 if not self.instructions_file:
3ed079a7174a Implement a way to stop a running treepackager. Bernhard Herzog <bh@intevation.de> parents: 90 diff changeset	668 return ""
3ed079a7174a Implement a way to stop a running treepackager. Bernhard Herzog <bh@intevation.de> parents: 90 diff changeset	669 try:
3ed079a7174a Implement a way to stop a running treepackager. Bernhard Herzog <bh@intevation.de> parents: 90 diff changeset	670 f = open(self.instructions_file)
3ed079a7174a Implement a way to stop a running treepackager. Bernhard Herzog <bh@intevation.de> parents: 90 diff changeset	671 except (IOError, OSError):
3ed079a7174a Implement a way to stop a running treepackager. Bernhard Herzog <bh@intevation.de> parents: 90 diff changeset	672 return ""
3ed079a7174a Implement a way to stop a running treepackager. Bernhard Herzog <bh@intevation.de> parents: 90 diff changeset	673 try:
3ed079a7174a Implement a way to stop a running treepackager. Bernhard Herzog <bh@intevation.de> parents: 90 diff changeset	674 return f.read().strip()
3ed079a7174a Implement a way to stop a running treepackager. Bernhard Herzog <bh@intevation.de> parents: 90 diff changeset	675 finally:
3ed079a7174a Implement a way to stop a running treepackager. Bernhard Herzog <bh@intevation.de> parents: 90 diff changeset	676 f.close()
3ed079a7174a Implement a way to stop a running treepackager. Bernhard Herzog <bh@intevation.de> parents: 90 diff changeset	677 self.clear_instruction()
3ed079a7174a Implement a way to stop a running treepackager. Bernhard Herzog <bh@intevation.de> parents: 90 diff changeset	678
3ed079a7174a Implement a way to stop a running treepackager. Bernhard Herzog <bh@intevation.de> parents: 90 diff changeset	679 def clear_instruction(self, force=False):
3ed079a7174a Implement a way to stop a running treepackager. Bernhard Herzog <bh@intevation.de> parents: 90 diff changeset	680 if self.instructions_file and (not self.instructions_file_removed
3ed079a7174a Implement a way to stop a running treepackager. Bernhard Herzog <bh@intevation.de> parents: 90 diff changeset	681 or force):
3ed079a7174a Implement a way to stop a running treepackager. Bernhard Herzog <bh@intevation.de> parents: 90 diff changeset	682 util.writefile(self.instructions_file, "")
3ed079a7174a Implement a way to stop a running treepackager. Bernhard Herzog <bh@intevation.de> parents: 90 diff changeset	683 self.instructions_file_removed = True
3ed079a7174a Implement a way to stop a running treepackager. Bernhard Herzog <bh@intevation.de> parents: 90 diff changeset	684
3ed079a7174a Implement a way to stop a running treepackager. Bernhard Herzog <bh@intevation.de> parents: 90 diff changeset	685 def should_stop(self):
3ed079a7174a Implement a way to stop a running treepackager. Bernhard Herzog <bh@intevation.de> parents: 90 diff changeset	686 return self.read_instruction() == "stop"

Mercurial > treepkg > treepkg

annotate treepkg/packager.py @ 207:b82fe4d25893