dive4elements/framework: artifact-database/src/main/java/de/intevation/artifactdatabase/DatabaseCleaner.java annotate

annotate artifact-database/src/main/java/de/intevation/artifactdatabase/DatabaseCleaner.java @ 301:b0a949d3fe09

Moved StringUtils to common package. Added some Override annotations. artifacts/trunk@2394 c6561f87-3c4e-4783-a992-168aeb5c3f6f

author	Sascha L. Teichmann <sascha.teichmann@intevation.de>
date	Fri, 22 Jul 2011 09:36:04 +0000
parents	4253995c970e
children	f33401ea2a6c

rev	line source
100 933bbc9fc11f Added license file and license headers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 93 diff changeset	1 /*
933bbc9fc11f Added license file and license headers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 93 diff changeset	2 * Copyright (c) 2010 by Intevation GmbH
933bbc9fc11f Added license file and license headers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 93 diff changeset	3 *
933bbc9fc11f Added license file and license headers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 93 diff changeset	4 * This program is free software under the LGPL (>=v2.1)
933bbc9fc11f Added license file and license headers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 93 diff changeset	5 * Read the file LGPL.txt coming with the software for details
933bbc9fc11f Added license file and license headers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 93 diff changeset	6 * or visit http://www.gnu.org/licenses/ if it does not exist.
933bbc9fc11f Added license file and license headers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 93 diff changeset	7 */
933bbc9fc11f Added license file and license headers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 93 diff changeset	8
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	9 package de.intevation.artifactdatabase;
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	10
207 b2115f484edb Move Config and XMLUtils totally to commons package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 100 diff changeset	11 import de.intevation.artifacts.common.utils.Config;
301 b0a949d3fe09 Moved StringUtils to common package. Added some Override annotations. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 241 diff changeset	12 import de.intevation.artifacts.common.utils.StringUtils;
207 b2115f484edb Move Config and XMLUtils totally to commons package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 100 diff changeset	13
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	14 import de.intevation.artifacts.Artifact;
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	15
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	16 import java.sql.Connection;
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	17 import java.sql.PreparedStatement;
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	18 import java.sql.ResultSet;
93 e27cf9c84eb8 Unified imports. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 91 diff changeset	19 import java.sql.SQLException;
e27cf9c84eb8 Unified imports. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 91 diff changeset	20
e27cf9c84eb8 Unified imports. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 91 diff changeset	21 import java.util.ArrayList;
e27cf9c84eb8 Unified imports. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 91 diff changeset	22 import java.util.List;
230 fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	23 import java.util.Set;
fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	24 import java.util.Collections;
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	25
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	26 import javax.sql.DataSource;
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	27
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	28 import org.apache.log4j.Logger;
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	29
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	30 /**
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	31 * The database cleaner runs in background. It sleep for a configurable
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	32 * while and when it wakes up it removes outdated artifacts from the
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	33 * database. Outdated means that the the last access to the artifact
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	34 * is longer aga then the time to live of this artifact.<br>
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	35 * Before the artifact is finally removed from the system it is
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	36 * revived one last time an the #endOfLife() method of the artifact
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	37 * is called.<br>
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	38 * The artifact implementations may e.g. use this to remove some extrenal
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	39 * resources form the system.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	40 *
80 8447467cef86 Implementation to import artifacts from incoming xml documents (applied patch from issue208 by SLT). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 48 diff changeset	41 * @author <a href="mailto:sascha.teichmann@intevation.de">Sascha L. Teichmann</a>
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	42 */
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	43 public class DatabaseCleaner
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	44 extends Thread
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	45 {
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	46 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	47 * Implementors of this interface are able to create a
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	48 * living artifact from a given byte array.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	49 */
41 5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	50 public interface ArtifactReviver {
5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	51
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	52 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	53 * Called to revive an artifact from a given byte array.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	54 * @param factoryName The name of the factory which
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	55 * created this artifact.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	56 * @param bytes The bytes of the serialized artifact.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	57 * @return The revived artfiact.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	58 */
41 5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	59 Artifact reviveArtifact(String factoryName, byte [] bytes);
5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	60
5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	61 } // interface ArtifactReviver
5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	62
230 fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	63 public interface LockedIdsProvider {
fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	64 Set<Integer> getLockedIds();
fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	65 } // interface LockedIdsProvider
fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	66
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	67 private static Logger logger = Logger.getLogger(DatabaseCleaner.class);
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	68
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	69 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	70 * Number of artifacts to be loaded at once. Used to
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	71 * mitigate the problem of a massive denial of service
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	72 * if too many artifacts have died since last cleanup.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	73 */
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	74 public static final int MAX_ROWS = 50;
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	75
230 fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	76 public static final Set<Integer> EMPTY_IDS = Collections.emptySet();
fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	77
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	78 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	79 * The SQL statement to select the outdated artifacts.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	80 */
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	81 public static final String SQL_OUTDATED =
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	82 SQL.get("artifacts.outdated");
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	83
232 202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	84 public static final String SQL_OUTDATED_COLLECTIONS =
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	85 SQL.get("collections.outdated");
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	86
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	87 public static final String SQL_DELETE_COLLECTION_ITEMS =
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	88 SQL.get("delete.collection.items");
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	89
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	90 public static final String SQL_DELETE_COLLECTION =
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	91 SQL.get("delete.collection");
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	92
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	93 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	94 * The SQL statement to delete some artifacts from the database.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	95 */
232 202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	96 public static final String SQL_DELETE_ARTIFACT =
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	97 SQL.get("artifacts.delete");
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	98
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	99 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	100 * XPath to figure out how long the cleaner should sleep between
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	101 * cleanups. This is stored in the global configuration.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	102 */
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	103 public static final String SLEEP_XPATH =
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	104 "/artifact-database/cleaner/sleep-time/text()";
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	105
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	106 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	107 * Default nap time between cleanups: 5 minutes.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	108 */
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	109 public static final long SLEEP_DEFAULT =
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	110 5 * 60 * 1000L; // 5 minutes
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	111
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	112 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	113 * The configured nap time.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	114 */
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	115 protected long sleepTime;
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	116
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	117 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	118 * Internal locking mechanism to prevent some race conditions.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	119 */
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	120 protected Object sleepLock = new Object();
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	121
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	122 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	123 * A reference to the global context.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	124 */
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	125 protected Object context;
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	126
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	127 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	128 * A specialized Id filter which only delete some artifacts.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	129 * This is used to prevent deletion of living artifacts.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	130 */
230 fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	131 protected LockedIdsProvider lockedIdsProvider;
32 c2d53bd30ab8 Re-factored artifact API for better integration of background processing. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 30 diff changeset	132
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	133 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	134 * The reviver used to bring the dead artifact on last
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	135 * time back to live to call endOfLife() on them.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	136 */
41 5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	137 protected ArtifactReviver reviver;
5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	138
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	139 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	140 * Default constructor.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	141 */
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	142 public DatabaseCleaner() {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	143 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	144
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	145 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	146 * Constructor to create a cleaner with a given global context
91 730ff077a58c More javadoc, some code formatting. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 90 diff changeset	147 * and a given reviver.
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	148 * @param context The global context of the artifact database
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	149 * @param reviver The reviver to awake artifact one last time.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	150 */
41 5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	151 public DatabaseCleaner(Object context, ArtifactReviver reviver) {
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	152 setDaemon(true);
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	153 sleepTime = getSleepTime();
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	154 this.context = context;
41 5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	155 this.reviver = reviver;
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	156 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	157
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	158 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	159 * Sets the filter that prevents deletion of living artifacts.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	160 * Living artifacts are artifacts which are currently active
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	161 * inside the artifact database. Deleting them in this state
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	162 * would create severe internal problems.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	163 * @param filter
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	164 */
230 fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	165 public void setLockedIdsProvider(LockedIdsProvider lockedIdsProvider) {
fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	166 this.lockedIdsProvider = lockedIdsProvider;
32 c2d53bd30ab8 Re-factored artifact API for better integration of background processing. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 30 diff changeset	167 }
c2d53bd30ab8 Re-factored artifact API for better integration of background processing. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 30 diff changeset	168
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	169 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	170 * External hook to tell the cleaner to wake up before its
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	171 * regular nap time is over. This is the case when the artifact
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	172 * database finds an artifact which is already outdated.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	173 */
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	174 public void wakeup() {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	175 synchronized (sleepLock) {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	176 sleepLock.notify();
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	177 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	178 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	179
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	180 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	181 * Fetches the sleep time from the global configuration.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	182 * @return the time to sleep between database cleanups in ms.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	183 */
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	184 protected static long getSleepTime() {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	185 String sleepTimeString = Config.getStringXPath(SLEEP_XPATH);
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	186
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	187 if (sleepTimeString == null) {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	188 return SLEEP_DEFAULT;
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	189 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	190 try {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	191 // sleep at least one second
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	192 return Math.max(Long.parseLong(sleepTimeString), 1000L);
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	193 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	194 catch (NumberFormatException nfe) {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	195 logger.warn("Cleaner sleep time defaults to " + SLEEP_DEFAULT);
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	196 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	197 return SLEEP_DEFAULT;
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	198 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	199
230 fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	200 private static final class IdData {
fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	201
fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	202 int id;
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	203 byte [] data;
41 5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	204 String factoryName;
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	205
41 5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	206 public IdData(int id, String factoryName, byte [] data) {
230 fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	207 this.id = id;
41 5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	208 this.factoryName = factoryName;
5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	209 this.data = data;
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	210 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	211 } // class IdData
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	212
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	213 /**
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	214 * Cleaning is done in two phases. First we fetch a list of ids
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	215 * of artifacts. If there are artifacts the cleaning is done.
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	216 * Second we load the artifacts one by one one and call there
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	217 * endOfLife() method. In this loop we remove them from database, too.
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	218 * Each deletion is commited to ensure that a sudden failure
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	219 * of the artifact database server does delete artifacts twice
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	220 * or does not delete them at all. After this the first step
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	221 * is repeated.
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	222 */
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	223 protected void cleanup() {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	224 logger.info("database cleanup");
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	225
232 202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	226 Connection connection = null;
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	227 PreparedStatement fetchIds = null;
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	228 PreparedStatement stmnt = null;
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	229 ResultSet result = null;
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	230
232 202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	231 int removedCollections = 0;
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	232 int removedArtifacts = 0;
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	233
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	234 DataSource dataSource = DBConnection.getDataSource();
231 1ea35226a6de Database cleaner: Ignoring locked artifacts is now done on database level. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 230 diff changeset	235
1ea35226a6de Database cleaner: Ignoring locked artifacts is now done on database level. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 230 diff changeset	236 Set<Integer> lockedIds = lockedIdsProvider != null
1ea35226a6de Database cleaner: Ignoring locked artifacts is now done on database level. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 230 diff changeset	237 ? lockedIdsProvider.getLockedIds()
1ea35226a6de Database cleaner: Ignoring locked artifacts is now done on database level. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 230 diff changeset	238 : EMPTY_IDS;
1ea35226a6de Database cleaner: Ignoring locked artifacts is now done on database level. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 230 diff changeset	239
238 61b7041204a7 Fix for flys/issue8 (part 2) Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 232 diff changeset	240 String questionMarks = lockedIds.isEmpty()
241 4253995c970e Fix for flys/issue8 (part 3) Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 238 diff changeset	241 ? "-666" // XXX: A bit hackish.
238 61b7041204a7 Fix for flys/issue8 (part 2) Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 232 diff changeset	242 : StringUtils.repeat('?', lockedIds.size(), ',');
231 1ea35226a6de Database cleaner: Ignoring locked artifacts is now done on database level. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 230 diff changeset	243
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	244 try {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	245 connection = dataSource.getConnection();
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	246 connection.setAutoCommit(false);
231 1ea35226a6de Database cleaner: Ignoring locked artifacts is now done on database level. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 230 diff changeset	247
1ea35226a6de Database cleaner: Ignoring locked artifacts is now done on database level. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 230 diff changeset	248 fetchIds = connection.prepareStatement(
1ea35226a6de Database cleaner: Ignoring locked artifacts is now done on database level. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 230 diff changeset	249 SQL_OUTDATED.replace("$LOCKED_IDS$", questionMarks));
1ea35226a6de Database cleaner: Ignoring locked artifacts is now done on database level. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 230 diff changeset	250
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	251 // some dbms like derby do not support LIMIT
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	252 // in SQL statements.
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	253 fetchIds.setMaxRows(MAX_ROWS);
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	254
232 202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	255 // Fetch ids of outdated collections
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	256 stmnt = connection.prepareStatement(
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	257 SQL_OUTDATED_COLLECTIONS.replace(
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	258 "$LOCKED_IDS$", questionMarks));
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	259
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	260 // fill in the locked ids
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	261 int idx = 1;
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	262 for (Integer id: lockedIds) {
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	263 fetchIds.setInt(idx, id);
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	264 stmnt .setInt(idx, id);
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	265 ++idx;
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	266 }
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	267
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	268 ArrayList<Integer> cs = new ArrayList<Integer>();
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	269 result = stmnt.executeQuery();
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	270 while (result.next()) {
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	271 cs.add(result.getInt(1));
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	272 }
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	273
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	274 result.close(); result = null;
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	275 stmnt.close(); stmnt = null;
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	276
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	277 // delete collection items
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	278 stmnt = connection.prepareStatement(SQL_DELETE_COLLECTION_ITEMS);
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	279
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	280 for (Integer id: cs) {
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	281 stmnt.setInt(1, id);
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	282 stmnt.execute();
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	283 }
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	284
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	285 stmnt.close(); stmnt = null;
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	286
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	287 // delete collections
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	288 stmnt = connection.prepareStatement(SQL_DELETE_COLLECTION);
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	289
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	290 for (Integer id: cs) {
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	291 stmnt.setInt(1, id);
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	292 stmnt.execute();
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	293 }
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	294
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	295 stmnt.close(); stmnt = null;
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	296 connection.commit();
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	297
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	298 removedCollections = cs.size(); cs = null;
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	299
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	300 // remove artifacts
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	301 stmnt = connection.prepareStatement(SQL_DELETE_ARTIFACT);
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	302
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	303 for (;;) {
230 fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	304 List<IdData> ids = new ArrayList<IdData>();
fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	305
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	306 result = fetchIds.executeQuery();
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	307
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	308 while (result.next()) {
231 1ea35226a6de Database cleaner: Ignoring locked artifacts is now done on database level. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 230 diff changeset	309 ids.add(new IdData(
1ea35226a6de Database cleaner: Ignoring locked artifacts is now done on database level. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 230 diff changeset	310 result.getInt(1),
1ea35226a6de Database cleaner: Ignoring locked artifacts is now done on database level. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 230 diff changeset	311 result.getString(2),
1ea35226a6de Database cleaner: Ignoring locked artifacts is now done on database level. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 230 diff changeset	312 result.getBytes(3)));
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	313 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	314
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	315 result.close(); result = null;
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	316
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	317 if (ids.isEmpty()) {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	318 break;
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	319 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	320
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	321 for (int i = ids.size()-1; i >= 0; --i) {
230 fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	322 IdData idData = ids.get(i);
41 5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	323 Artifact artifact = reviver.reviveArtifact(
5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	324 idData.factoryName, idData.data);
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	325 idData.data = null;
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	326
232 202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	327 stmnt.setInt(1, idData.id);
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	328 stmnt.execute();
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	329 connection.commit();
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	330
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	331 try {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	332 if (artifact != null) {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	333 artifact.endOfLife(context);
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	334 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	335 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	336 catch (Exception e) {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	337 logger.error(e.getLocalizedMessage(), e);
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	338 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	339 } // for all fetched data
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	340
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	341 removedArtifacts += ids.size();
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	342 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	343 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	344 catch (SQLException sqle) {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	345 logger.error(sqle.getLocalizedMessage(), sqle);
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	346 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	347 finally {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	348 if (result != null) {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	349 try { result.close(); }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	350 catch (SQLException sqle) {}
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	351 }
232 202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	352 if (stmnt != null) {
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	353 try { stmnt.close(); }
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	354 catch (SQLException sqle) {}
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	355 }
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	356 if (fetchIds != null) {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	357 try { fetchIds.close(); }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	358 catch (SQLException sqle) {}
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	359 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	360 if (connection != null) {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	361 try { connection.close(); }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	362 catch (SQLException sqle) {}
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	363 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	364 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	365
232 202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	366 logger.info("collections removed: " + removedCollections);
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	367 logger.info("artifacts removed: " + removedArtifacts);
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	368 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	369
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	370 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	371 * The main code of the cleaner. It sleeps for the configured
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	372 * nap time, cleans up the database, sleeps again and so on.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	373 */
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	374 @Override
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	375 public void run() {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	376 logger.info("sleep time: " + sleepTime + "ms");
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	377 for (;;) {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	378 cleanup();
48 41c225c8bd41 Add i18n support via "Accept-Language" HTTP headers. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 47 diff changeset	379 long startTime = System.currentTimeMillis();
41c225c8bd41 Add i18n support via "Accept-Language" HTTP headers. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 47 diff changeset	380
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	381 try {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	382 synchronized (sleepLock) {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	383 sleepLock.wait(sleepTime);
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	384 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	385 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	386 catch (InterruptedException ie) {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	387 }
48 41c225c8bd41 Add i18n support via "Accept-Language" HTTP headers. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 47 diff changeset	388
41c225c8bd41 Add i18n support via "Accept-Language" HTTP headers. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 47 diff changeset	389 long stopTime = System.currentTimeMillis();
41c225c8bd41 Add i18n support via "Accept-Language" HTTP headers. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 47 diff changeset	390
41c225c8bd41 Add i18n support via "Accept-Language" HTTP headers. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 47 diff changeset	391 if (logger.isDebugEnabled()) {
41c225c8bd41 Add i18n support via "Accept-Language" HTTP headers. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 47 diff changeset	392 logger.debug("Cleaner slept " + (stopTime - startTime) + "ms");
41c225c8bd41 Add i18n support via "Accept-Language" HTTP headers. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 47 diff changeset	393 }
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	394 } // for (;;)
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	395 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	396 }
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	397 // vim:set ts=4 sw=4 si et sta sts=4 fenc=utf8 :

Mercurial > dive4elements > framework

annotate artifact-database/src/main/java/de/intevation/artifactdatabase/DatabaseCleaner.java @ 301:b0a949d3fe09