dive4elements/framework: artifact-database/src/main/java/de/intevation/artifactdatabase/DatabaseCleaner.java annotate

annotate artifact-database/src/main/java/de/intevation/artifactdatabase/DatabaseCleaner.java @ 235:3e29395ebac6

The XML documents stored aside users, collections and collection items are now compressed/decompressed transparently. artifacts/trunk@1642 c6561f87-3c4e-4783-a992-168aeb5c3f6f

author	Sascha L. Teichmann <sascha.teichmann@intevation.de>
date	Mon, 04 Apr 2011 09:28:54 +0000
parents	202b6ae2fcad
children	61b7041204a7

rev	line source
100 933bbc9fc11f Added license file and license headers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 93 diff changeset	1 /*
933bbc9fc11f Added license file and license headers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 93 diff changeset	2 * Copyright (c) 2010 by Intevation GmbH
933bbc9fc11f Added license file and license headers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 93 diff changeset	3 *
933bbc9fc11f Added license file and license headers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 93 diff changeset	4 * This program is free software under the LGPL (>=v2.1)
933bbc9fc11f Added license file and license headers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 93 diff changeset	5 * Read the file LGPL.txt coming with the software for details
933bbc9fc11f Added license file and license headers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 93 diff changeset	6 * or visit http://www.gnu.org/licenses/ if it does not exist.
933bbc9fc11f Added license file and license headers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 93 diff changeset	7 */
933bbc9fc11f Added license file and license headers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 93 diff changeset	8
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	9 package de.intevation.artifactdatabase;
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	10
207 b2115f484edb Move Config and XMLUtils totally to commons package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 100 diff changeset	11 import de.intevation.artifacts.common.utils.Config;
b2115f484edb Move Config and XMLUtils totally to commons package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 100 diff changeset	12
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	13 import de.intevation.artifacts.Artifact;
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	14
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	15 import java.sql.Connection;
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	16 import java.sql.PreparedStatement;
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	17 import java.sql.ResultSet;
93 e27cf9c84eb8 Unified imports. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 91 diff changeset	18 import java.sql.SQLException;
e27cf9c84eb8 Unified imports. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 91 diff changeset	19
e27cf9c84eb8 Unified imports. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 91 diff changeset	20 import java.util.ArrayList;
e27cf9c84eb8 Unified imports. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 91 diff changeset	21 import java.util.List;
230 fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	22 import java.util.Set;
fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	23 import java.util.Collections;
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	24
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	25 import javax.sql.DataSource;
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	26
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	27 import org.apache.log4j.Logger;
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	28
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	29 /**
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	30 * The database cleaner runs in background. It sleep for a configurable
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	31 * while and when it wakes up it removes outdated artifacts from the
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	32 * database. Outdated means that the the last access to the artifact
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	33 * is longer aga then the time to live of this artifact.<br>
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	34 * Before the artifact is finally removed from the system it is
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	35 * revived one last time an the #endOfLife() method of the artifact
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	36 * is called.<br>
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	37 * The artifact implementations may e.g. use this to remove some extrenal
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	38 * resources form the system.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	39 *
80 8447467cef86 Implementation to import artifacts from incoming xml documents (applied patch from issue208 by SLT). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 48 diff changeset	40 * @author <a href="mailto:sascha.teichmann@intevation.de">Sascha L. Teichmann</a>
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	41 */
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	42 public class DatabaseCleaner
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	43 extends Thread
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	44 {
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	45 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	46 * Implementors of this interface are able to create a
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	47 * living artifact from a given byte array.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	48 */
41 5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	49 public interface ArtifactReviver {
5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	50
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	51 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	52 * Called to revive an artifact from a given byte array.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	53 * @param factoryName The name of the factory which
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	54 * created this artifact.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	55 * @param bytes The bytes of the serialized artifact.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	56 * @return The revived artfiact.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	57 */
41 5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	58 Artifact reviveArtifact(String factoryName, byte [] bytes);
5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	59
5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	60 } // interface ArtifactReviver
5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	61
230 fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	62 public interface LockedIdsProvider {
fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	63 Set<Integer> getLockedIds();
fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	64 } // interface LockedIdsProvider
fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	65
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	66 private static Logger logger = Logger.getLogger(DatabaseCleaner.class);
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	67
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	68 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	69 * Number of artifacts to be loaded at once. Used to
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	70 * mitigate the problem of a massive denial of service
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	71 * if too many artifacts have died since last cleanup.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	72 */
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	73 public static final int MAX_ROWS = 50;
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	74
230 fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	75 public static final Set<Integer> EMPTY_IDS = Collections.emptySet();
fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	76
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	77 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	78 * The SQL statement to select the outdated artifacts.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	79 */
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	80 public static final String SQL_OUTDATED =
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	81 SQL.get("artifacts.outdated");
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	82
232 202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	83 public static final String SQL_OUTDATED_COLLECTIONS =
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	84 SQL.get("collections.outdated");
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	85
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	86 public static final String SQL_DELETE_COLLECTION_ITEMS =
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	87 SQL.get("delete.collection.items");
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	88
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	89 public static final String SQL_DELETE_COLLECTION =
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	90 SQL.get("delete.collection");
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	91
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	92 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	93 * The SQL statement to delete some artifacts from the database.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	94 */
232 202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	95 public static final String SQL_DELETE_ARTIFACT =
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	96 SQL.get("artifacts.delete");
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	97
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	98 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	99 * XPath to figure out how long the cleaner should sleep between
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	100 * cleanups. This is stored in the global configuration.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	101 */
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	102 public static final String SLEEP_XPATH =
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	103 "/artifact-database/cleaner/sleep-time/text()";
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	104
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	105 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	106 * Default nap time between cleanups: 5 minutes.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	107 */
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	108 public static final long SLEEP_DEFAULT =
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	109 5 * 60 * 1000L; // 5 minutes
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	110
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	111 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	112 * The configured nap time.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	113 */
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	114 protected long sleepTime;
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	115
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	116 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	117 * Internal locking mechanism to prevent some race conditions.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	118 */
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	119 protected Object sleepLock = new Object();
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	120
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	121 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	122 * A reference to the global context.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	123 */
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	124 protected Object context;
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	125
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	126 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	127 * A specialized Id filter which only delete some artifacts.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	128 * This is used to prevent deletion of living artifacts.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	129 */
230 fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	130 protected LockedIdsProvider lockedIdsProvider;
32 c2d53bd30ab8 Re-factored artifact API for better integration of background processing. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 30 diff changeset	131
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	132 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	133 * The reviver used to bring the dead artifact on last
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	134 * time back to live to call endOfLife() on them.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	135 */
41 5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	136 protected ArtifactReviver reviver;
5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	137
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	138 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	139 * Default constructor.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	140 */
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	141 public DatabaseCleaner() {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	142 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	143
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	144 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	145 * Constructor to create a cleaner with a given global context
91 730ff077a58c More javadoc, some code formatting. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 90 diff changeset	146 * and a given reviver.
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	147 * @param context The global context of the artifact database
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	148 * @param reviver The reviver to awake artifact one last time.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	149 */
41 5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	150 public DatabaseCleaner(Object context, ArtifactReviver reviver) {
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	151 setDaemon(true);
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	152 sleepTime = getSleepTime();
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	153 this.context = context;
41 5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	154 this.reviver = reviver;
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	155 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	156
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	157 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	158 * Sets the filter that prevents deletion of living artifacts.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	159 * Living artifacts are artifacts which are currently active
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	160 * inside the artifact database. Deleting them in this state
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	161 * would create severe internal problems.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	162 * @param filter
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	163 */
230 fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	164 public void setLockedIdsProvider(LockedIdsProvider lockedIdsProvider) {
fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	165 this.lockedIdsProvider = lockedIdsProvider;
32 c2d53bd30ab8 Re-factored artifact API for better integration of background processing. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 30 diff changeset	166 }
c2d53bd30ab8 Re-factored artifact API for better integration of background processing. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 30 diff changeset	167
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	168 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	169 * External hook to tell the cleaner to wake up before its
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	170 * regular nap time is over. This is the case when the artifact
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	171 * database finds an artifact which is already outdated.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	172 */
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	173 public void wakeup() {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	174 synchronized (sleepLock) {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	175 sleepLock.notify();
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	176 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	177 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	178
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	179 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	180 * Fetches the sleep time from the global configuration.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	181 * @return the time to sleep between database cleanups in ms.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	182 */
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	183 protected static long getSleepTime() {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	184 String sleepTimeString = Config.getStringXPath(SLEEP_XPATH);
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	185
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	186 if (sleepTimeString == null) {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	187 return SLEEP_DEFAULT;
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	188 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	189 try {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	190 // sleep at least one second
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	191 return Math.max(Long.parseLong(sleepTimeString), 1000L);
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	192 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	193 catch (NumberFormatException nfe) {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	194 logger.warn("Cleaner sleep time defaults to " + SLEEP_DEFAULT);
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	195 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	196 return SLEEP_DEFAULT;
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	197 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	198
230 fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	199 private static final class IdData {
fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	200
fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	201 int id;
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	202 byte [] data;
41 5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	203 String factoryName;
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	204
41 5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	205 public IdData(int id, String factoryName, byte [] data) {
230 fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	206 this.id = id;
41 5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	207 this.factoryName = factoryName;
5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	208 this.data = data;
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	209 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	210 } // class IdData
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	211
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	212 /**
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	213 * Cleaning is done in two phases. First we fetch a list of ids
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	214 * of artifacts. If there are artifacts the cleaning is done.
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	215 * Second we load the artifacts one by one one and call there
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	216 * endOfLife() method. In this loop we remove them from database, too.
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	217 * Each deletion is commited to ensure that a sudden failure
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	218 * of the artifact database server does delete artifacts twice
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	219 * or does not delete them at all. After this the first step
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	220 * is repeated.
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	221 */
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	222 protected void cleanup() {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	223 logger.info("database cleanup");
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	224
232 202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	225 Connection connection = null;
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	226 PreparedStatement fetchIds = null;
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	227 PreparedStatement stmnt = null;
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	228 ResultSet result = null;
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	229
232 202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	230 int removedCollections = 0;
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	231 int removedArtifacts = 0;
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	232
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	233 DataSource dataSource = DBConnection.getDataSource();
231 1ea35226a6de Database cleaner: Ignoring locked artifacts is now done on database level. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 230 diff changeset	234
1ea35226a6de Database cleaner: Ignoring locked artifacts is now done on database level. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 230 diff changeset	235 Set<Integer> lockedIds = lockedIdsProvider != null
1ea35226a6de Database cleaner: Ignoring locked artifacts is now done on database level. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 230 diff changeset	236 ? lockedIdsProvider.getLockedIds()
1ea35226a6de Database cleaner: Ignoring locked artifacts is now done on database level. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 230 diff changeset	237 : EMPTY_IDS;
1ea35226a6de Database cleaner: Ignoring locked artifacts is now done on database level. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 230 diff changeset	238
1ea35226a6de Database cleaner: Ignoring locked artifacts is now done on database level. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 230 diff changeset	239 String questionMarks = StringUtils.repeat('?', lockedIds.size(), ',');
1ea35226a6de Database cleaner: Ignoring locked artifacts is now done on database level. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 230 diff changeset	240
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	241 try {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	242 connection = dataSource.getConnection();
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	243 connection.setAutoCommit(false);
231 1ea35226a6de Database cleaner: Ignoring locked artifacts is now done on database level. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 230 diff changeset	244
1ea35226a6de Database cleaner: Ignoring locked artifacts is now done on database level. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 230 diff changeset	245 fetchIds = connection.prepareStatement(
1ea35226a6de Database cleaner: Ignoring locked artifacts is now done on database level. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 230 diff changeset	246 SQL_OUTDATED.replace("$LOCKED_IDS$", questionMarks));
1ea35226a6de Database cleaner: Ignoring locked artifacts is now done on database level. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 230 diff changeset	247
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	248 // some dbms like derby do not support LIMIT
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	249 // in SQL statements.
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	250 fetchIds.setMaxRows(MAX_ROWS);
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	251
232 202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	252 // Fetch ids of outdated collections
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	253 stmnt = connection.prepareStatement(
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	254 SQL_OUTDATED_COLLECTIONS.replace(
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	255 "$LOCKED_IDS$", questionMarks));
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	256
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	257 // fill in the locked ids
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	258 int idx = 1;
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	259 for (Integer id: lockedIds) {
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	260 fetchIds.setInt(idx, id);
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	261 stmnt .setInt(idx, id);
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	262 ++idx;
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	263 }
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	264
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	265 ArrayList<Integer> cs = new ArrayList<Integer>();
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	266 result = stmnt.executeQuery();
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	267 while (result.next()) {
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	268 cs.add(result.getInt(1));
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	269 }
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	270
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	271 result.close(); result = null;
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	272 stmnt.close(); stmnt = null;
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	273
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	274 // delete collection items
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	275 stmnt = connection.prepareStatement(SQL_DELETE_COLLECTION_ITEMS);
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	276
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	277 for (Integer id: cs) {
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	278 stmnt.setInt(1, id);
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	279 stmnt.execute();
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	280 }
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	281
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	282 stmnt.close(); stmnt = null;
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	283
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	284 // delete collections
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	285 stmnt = connection.prepareStatement(SQL_DELETE_COLLECTION);
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	286
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	287 for (Integer id: cs) {
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	288 stmnt.setInt(1, id);
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	289 stmnt.execute();
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	290 }
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	291
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	292 stmnt.close(); stmnt = null;
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	293 connection.commit();
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	294
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	295 removedCollections = cs.size(); cs = null;
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	296
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	297 // remove artifacts
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	298 stmnt = connection.prepareStatement(SQL_DELETE_ARTIFACT);
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	299
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	300 for (;;) {
230 fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	301 List<IdData> ids = new ArrayList<IdData>();
fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	302
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	303 result = fetchIds.executeQuery();
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	304
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	305 while (result.next()) {
231 1ea35226a6de Database cleaner: Ignoring locked artifacts is now done on database level. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 230 diff changeset	306 ids.add(new IdData(
1ea35226a6de Database cleaner: Ignoring locked artifacts is now done on database level. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 230 diff changeset	307 result.getInt(1),
1ea35226a6de Database cleaner: Ignoring locked artifacts is now done on database level. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 230 diff changeset	308 result.getString(2),
1ea35226a6de Database cleaner: Ignoring locked artifacts is now done on database level. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 230 diff changeset	309 result.getBytes(3)));
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	310 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	311
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	312 result.close(); result = null;
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	313
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	314 if (ids.isEmpty()) {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	315 break;
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	316 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	317
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	318 for (int i = ids.size()-1; i >= 0; --i) {
230 fbd57d2eeaef Changed semantics of locked artifact ids. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 207 diff changeset	319 IdData idData = ids.get(i);
41 5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	320 Artifact artifact = reviver.reviveArtifact(
5e4bc24ea438 Made serilization more flexible. DB update required!!! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 32 diff changeset	321 idData.factoryName, idData.data);
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	322 idData.data = null;
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	323
232 202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	324 stmnt.setInt(1, idData.id);
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	325 stmnt.execute();
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	326 connection.commit();
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	327
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	328 try {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	329 if (artifact != null) {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	330 artifact.endOfLife(context);
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	331 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	332 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	333 catch (Exception e) {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	334 logger.error(e.getLocalizedMessage(), e);
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	335 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	336 } // for all fetched data
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	337
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	338 removedArtifacts += ids.size();
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	339 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	340 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	341 catch (SQLException sqle) {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	342 logger.error(sqle.getLocalizedMessage(), sqle);
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	343 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	344 finally {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	345 if (result != null) {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	346 try { result.close(); }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	347 catch (SQLException sqle) {}
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	348 }
232 202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	349 if (stmnt != null) {
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	350 try { stmnt.close(); }
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	351 catch (SQLException sqle) {}
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	352 }
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	353 if (fetchIds != null) {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	354 try { fetchIds.close(); }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	355 catch (SQLException sqle) {}
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	356 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	357 if (connection != null) {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	358 try { connection.close(); }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	359 catch (SQLException sqle) {}
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	360 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	361 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	362
232 202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	363 logger.info("collections removed: " + removedCollections);
202b6ae2fcad Database cleaner: Removes outdated collections, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 231 diff changeset	364 logger.info("artifacts removed: " + removedArtifacts);
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	365 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	366
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	367 /**
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	368 * The main code of the cleaner. It sleeps for the configured
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	369 * nap time, cleans up the database, sleeps again and so on.
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	370 */
68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	371 @Override
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	372 public void run() {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	373 logger.info("sleep time: " + sleepTime + "ms");
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	374 for (;;) {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	375 cleanup();
48 41c225c8bd41 Add i18n support via "Accept-Language" HTTP headers. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 47 diff changeset	376 long startTime = System.currentTimeMillis();
41c225c8bd41 Add i18n support via "Accept-Language" HTTP headers. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 47 diff changeset	377
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	378 try {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	379 synchronized (sleepLock) {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	380 sleepLock.wait(sleepTime);
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	381 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	382 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	383 catch (InterruptedException ie) {
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	384 }
48 41c225c8bd41 Add i18n support via "Accept-Language" HTTP headers. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 47 diff changeset	385
41c225c8bd41 Add i18n support via "Accept-Language" HTTP headers. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 47 diff changeset	386 long stopTime = System.currentTimeMillis();
41c225c8bd41 Add i18n support via "Accept-Language" HTTP headers. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 47 diff changeset	387
41c225c8bd41 Add i18n support via "Accept-Language" HTTP headers. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 47 diff changeset	388 if (logger.isDebugEnabled()) {
41c225c8bd41 Add i18n support via "Accept-Language" HTTP headers. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 47 diff changeset	389 logger.debug("Cleaner slept " + (stopTime - startTime) + "ms");
41c225c8bd41 Add i18n support via "Accept-Language" HTTP headers. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 47 diff changeset	390 }
30 88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	391 } // for (;;)
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	392 }
88972c6daa4f Added a cleanup thread which periodically removes Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	393 }
90 68285f7bc476 More javadoc. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 80 diff changeset	394 // vim:set ts=4 sw=4 si et sta sts=4 fenc=utf8 :

Mercurial > dive4elements > framework

annotate artifact-database/src/main/java/de/intevation/artifactdatabase/DatabaseCleaner.java @ 235:3e29395ebac6