dive4elements/river: backend/src/main/java/org/dive4elements/river/importer/ImporterSession.java annotate

annotate backend/src/main/java/org/dive4elements/river/importer/ImporterSession.java @ 6955:94cb1845c667

(issue1452) Coalesce to zero to avoid NaN arithmetic.

author	Andre Heinecke <aheinecke@intevation.de>
date	Fri, 30 Aug 2013 15:45:14 +0200
parents	4c3ccf2b0304
children	1e327d86c898

rev	line source
5844 4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	1 /* Copyright (C) 2011, 2012, 2013 by Bundesanstalt für Gewässerkunde
4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	2 * Software engineering by Intevation GmbH
4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	3 *
5992 4c3ccf2b0304 Removed trailing whitespace. Sascha L. Teichmann <teichmann@intevation.de> parents: 5844 diff changeset	4 * This file is Free Software under the GNU AGPL (>=v3)
5844 4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	5 * and comes with ABSOLUTELY NO WARRANTY! Check out the
5992 4c3ccf2b0304 Removed trailing whitespace. Sascha L. Teichmann <teichmann@intevation.de> parents: 5844 diff changeset	6 * documentation coming with Dive4Elements River for details.
5844 4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	7 */
4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	8
5829 18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	9 package org.dive4elements.river.importer;
497 67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	10
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	11 import java.util.Iterator;
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	12 import java.util.Map;
503 bcc18293a547 Importer: Added unsharp lookup to avoid numerical problems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 502 diff changeset	13 import java.util.TreeMap;
497 67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	14
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	15 import java.math.BigDecimal;
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	16
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	17 import org.hibernate.SessionFactory;
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	18 import org.hibernate.Session;
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	19 import org.hibernate.Query;
499 cce054f27dac Importer: Only accept main value types 'Q', 'W', 'D' and 'T' by default. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 498 diff changeset	20 import org.hibernate.FlushMode;
497 67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	21
5829 18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	22 import org.dive4elements.river.backend.SessionFactoryProvider;
497 67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	23
5829 18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	24 import org.dive4elements.river.model.WstColumnValue;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	25 import org.dive4elements.river.model.WstColumn;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	26 import org.dive4elements.river.model.DischargeTableValue;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	27 import org.dive4elements.river.model.DischargeTable;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	28 import org.dive4elements.river.model.Range;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	29 import org.dive4elements.river.model.River;
500 d50cd3a632e0 Importer: Use BigDecimals in hashing to prevent numerical problems. Cache ranges globally, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 499 diff changeset	30
d50cd3a632e0 Importer: Use BigDecimals in hashing to prevent numerical problems. Cache ranges globally, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 499 diff changeset	31 import org.apache.log4j.Logger;
497 67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	32
5829 18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	33 import org.dive4elements.artifacts.common.utils.LRUCache;
1227 cdb35d96ca09 Importer session: Make use of the LRU cache from artifacts common. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 503 diff changeset	34
497 67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	35 public class ImporterSession
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	36 {
500 d50cd3a632e0 Importer: Use BigDecimals in hashing to prevent numerical problems. Cache ranges globally, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 499 diff changeset	37 private static Logger log = Logger.getLogger(ImporterSession.class);
d50cd3a632e0 Importer: Use BigDecimals in hashing to prevent numerical problems. Cache ranges globally, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 499 diff changeset	38
497 67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	39 private static final ThreadLocal<ImporterSession> SESSION =
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	40 new ThreadLocal<ImporterSession>() {
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	41 @Override
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	42 protected ImporterSession initialValue() {
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	43 return new ImporterSession();
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	44 }
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	45 };
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	46
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	47 protected Session databaseSession;
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	48
1227 cdb35d96ca09 Importer session: Make use of the LRU cache from artifacts common. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 503 diff changeset	49 protected LRUCache<Integer, Map<ValueKey, WstColumnValue>>
503 bcc18293a547 Importer: Added unsharp lookup to avoid numerical problems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 502 diff changeset	50 wstColumnValues;
498 8ab04de0b879 Importer: Cache the discharge table values, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 497 diff changeset	51
1227 cdb35d96ca09 Importer session: Make use of the LRU cache from artifacts common. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 503 diff changeset	52 protected LRUCache<Integer, Map<ValueKey, DischargeTableValue>>
501 04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	53 dischargeTableValues;
497 67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	54
1227 cdb35d96ca09 Importer session: Make use of the LRU cache from artifacts common. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 503 diff changeset	55 protected LRUCache<Integer, Map<ValueKey, Range>>
503 bcc18293a547 Importer: Added unsharp lookup to avoid numerical problems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 502 diff changeset	56 ranges;
500 d50cd3a632e0 Importer: Use BigDecimals in hashing to prevent numerical problems. Cache ranges globally, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 499 diff changeset	57
497 67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	58 public static ImporterSession getInstance() {
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	59 return SESSION.get();
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	60 }
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	61
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	62 public ImporterSession() {
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	63 SessionFactory sessionFactory =
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	64 SessionFactoryProvider.createSessionFactory();
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	65 databaseSession = sessionFactory.openSession();
502 c6889097f81f Importer: Fix silly bug and set Hibernate session flushing back to auto. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 501 diff changeset	66 //databaseSession.setFlushMode(FlushMode.MANUAL);
501 04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	67
04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	68 wstColumnValues =
1227 cdb35d96ca09 Importer session: Make use of the LRU cache from artifacts common. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 503 diff changeset	69 new LRUCache<Integer, Map<ValueKey, WstColumnValue>>();
501 04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	70
04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	71 dischargeTableValues =
1227 cdb35d96ca09 Importer session: Make use of the LRU cache from artifacts common. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 503 diff changeset	72 new LRUCache<Integer, Map<ValueKey, DischargeTableValue>>();
503 bcc18293a547 Importer: Added unsharp lookup to avoid numerical problems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 502 diff changeset	73
1227 cdb35d96ca09 Importer session: Make use of the LRU cache from artifacts common. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 503 diff changeset	74 ranges = new LRUCache<Integer, Map<ValueKey, Range>>();
497 67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	75 }
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	76
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	77 public Session getDatabaseSession() {
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	78 return databaseSession;
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	79 }
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	80
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	81 public WstColumnValue getWstColumnValue(
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	82 WstColumn column,
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	83 BigDecimal position,
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	84 BigDecimal w
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	85 ) {
501 04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	86 Integer c = column.getId();
04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	87
04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	88 Map<ValueKey, WstColumnValue> map = wstColumnValues.get(c);
04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	89
04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	90 if (map == null) {
503 bcc18293a547 Importer: Added unsharp lookup to avoid numerical problems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 502 diff changeset	91 map = new TreeMap<ValueKey, WstColumnValue>(
bcc18293a547 Importer: Added unsharp lookup to avoid numerical problems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 502 diff changeset	92 ValueKey.EPSILON_COMPARATOR);
501 04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	93 wstColumnValues.put(c, map);
04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	94 Query query = databaseSession.createQuery(
04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	95 "from WstColumnValue where wstColumn.id=:cid");
04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	96 query.setParameter("cid", c);
04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	97 for (Iterator iter = query.iterate(); iter.hasNext();) {
04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	98 WstColumnValue wcv = (WstColumnValue)iter.next();
04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	99 map.put(new ValueKey(wcv.getPosition(), wcv.getW()), wcv);
04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	100 }
497 67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	101 }
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	102
501 04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	103 ValueKey key = new ValueKey(position, w);
497 67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	104
501 04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	105 WstColumnValue wcv = map.get(key);
497 67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	106
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	107 if (wcv != null) {
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	108 return wcv;
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	109 }
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	110
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	111 wcv = new WstColumnValue(column, position, w);
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	112
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	113 databaseSession.save(wcv);
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	114
501 04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	115 map.put(key, wcv);
497 67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	116
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	117 return wcv;
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	118 }
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	119
498 8ab04de0b879 Importer: Cache the discharge table values, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 497 diff changeset	120 public DischargeTableValue getDischargeTableValue(
8ab04de0b879 Importer: Cache the discharge table values, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 497 diff changeset	121 DischargeTable table,
8ab04de0b879 Importer: Cache the discharge table values, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 497 diff changeset	122 BigDecimal q,
8ab04de0b879 Importer: Cache the discharge table values, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 497 diff changeset	123 BigDecimal w
8ab04de0b879 Importer: Cache the discharge table values, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 497 diff changeset	124 ) {
501 04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	125 Integer t = table.getId();
498 8ab04de0b879 Importer: Cache the discharge table values, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 497 diff changeset	126
501 04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	127 Map<ValueKey, DischargeTableValue> map =
04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	128 dischargeTableValues.get(t);
498 8ab04de0b879 Importer: Cache the discharge table values, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 497 diff changeset	129
501 04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	130 if (map == null) {
503 bcc18293a547 Importer: Added unsharp lookup to avoid numerical problems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 502 diff changeset	131 map = new TreeMap<ValueKey, DischargeTableValue>(
bcc18293a547 Importer: Added unsharp lookup to avoid numerical problems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 502 diff changeset	132 ValueKey.EPSILON_COMPARATOR);
501 04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	133 dischargeTableValues.put(t, map);
04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	134 Query query = databaseSession.createQuery(
04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	135 "from DischargeTableValue where dischargeTable.id=:tid");
04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	136 query.setParameter("tid", t);
04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	137 for (Iterator iter = query.iterate(); iter.hasNext();) {
04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	138 DischargeTableValue dctv = (DischargeTableValue)iter.next();
503 bcc18293a547 Importer: Added unsharp lookup to avoid numerical problems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 502 diff changeset	139 map.put(new ValueKey(dctv.getQ(), dctv.getW()), dctv);
501 04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	140 }
498 8ab04de0b879 Importer: Cache the discharge table values, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 497 diff changeset	141 }
8ab04de0b879 Importer: Cache the discharge table values, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 497 diff changeset	142
501 04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	143 ValueKey key = new ValueKey(q, w);
498 8ab04de0b879 Importer: Cache the discharge table values, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 497 diff changeset	144
501 04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	145 DischargeTableValue dctv = map.get(key);
498 8ab04de0b879 Importer: Cache the discharge table values, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 497 diff changeset	146
501 04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	147 if (dctv != null) {
04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	148 return dctv;
04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	149 }
498 8ab04de0b879 Importer: Cache the discharge table values, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 497 diff changeset	150
501 04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	151 dctv = new DischargeTableValue(table, q, w);
04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	152
04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	153 databaseSession.save(dctv);
04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	154
04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	155 map.put(key, dctv);
04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	156
04d449f7f0c9 Importer: Change caching strategy not to cause OOM any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 500 diff changeset	157 return dctv;
500 d50cd3a632e0 Importer: Use BigDecimals in hashing to prevent numerical problems. Cache ranges globally, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 499 diff changeset	158 }
d50cd3a632e0 Importer: Use BigDecimals in hashing to prevent numerical problems. Cache ranges globally, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 499 diff changeset	159
d50cd3a632e0 Importer: Use BigDecimals in hashing to prevent numerical problems. Cache ranges globally, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 499 diff changeset	160 public Range getRange(River river, BigDecimal a, BigDecimal b) {
503 bcc18293a547 Importer: Added unsharp lookup to avoid numerical problems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 502 diff changeset	161 Integer r = river.getId();
500 d50cd3a632e0 Importer: Use BigDecimals in hashing to prevent numerical problems. Cache ranges globally, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 499 diff changeset	162
503 bcc18293a547 Importer: Added unsharp lookup to avoid numerical problems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 502 diff changeset	163 Map<ValueKey, Range> map = ranges.get(r);
bcc18293a547 Importer: Added unsharp lookup to avoid numerical problems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 502 diff changeset	164
bcc18293a547 Importer: Added unsharp lookup to avoid numerical problems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 502 diff changeset	165 if (map == null) {
bcc18293a547 Importer: Added unsharp lookup to avoid numerical problems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 502 diff changeset	166 map = new TreeMap<ValueKey, Range>(
bcc18293a547 Importer: Added unsharp lookup to avoid numerical problems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 502 diff changeset	167 ValueKey.EPSILON_COMPARATOR);
bcc18293a547 Importer: Added unsharp lookup to avoid numerical problems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 502 diff changeset	168 ranges.put(r, map);
bcc18293a547 Importer: Added unsharp lookup to avoid numerical problems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 502 diff changeset	169 Query query = databaseSession.createQuery(
bcc18293a547 Importer: Added unsharp lookup to avoid numerical problems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 502 diff changeset	170 "from Range where river.id=:rid");
bcc18293a547 Importer: Added unsharp lookup to avoid numerical problems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 502 diff changeset	171 query.setParameter("rid", r);
bcc18293a547 Importer: Added unsharp lookup to avoid numerical problems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 502 diff changeset	172 for (Iterator iter = query.iterate(); iter.hasNext();) {
bcc18293a547 Importer: Added unsharp lookup to avoid numerical problems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 502 diff changeset	173 Range range = (Range)iter.next();
bcc18293a547 Importer: Added unsharp lookup to avoid numerical problems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 502 diff changeset	174 map.put(new ValueKey(range.getA(), range.getB()), range);
bcc18293a547 Importer: Added unsharp lookup to avoid numerical problems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 502 diff changeset	175 }
500 d50cd3a632e0 Importer: Use BigDecimals in hashing to prevent numerical problems. Cache ranges globally, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 499 diff changeset	176 }
d50cd3a632e0 Importer: Use BigDecimals in hashing to prevent numerical problems. Cache ranges globally, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 499 diff changeset	177
503 bcc18293a547 Importer: Added unsharp lookup to avoid numerical problems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 502 diff changeset	178 ValueKey key = new ValueKey(a, b);
500 d50cd3a632e0 Importer: Use BigDecimals in hashing to prevent numerical problems. Cache ranges globally, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 499 diff changeset	179
503 bcc18293a547 Importer: Added unsharp lookup to avoid numerical problems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 502 diff changeset	180 Range range = map.get(key);
500 d50cd3a632e0 Importer: Use BigDecimals in hashing to prevent numerical problems. Cache ranges globally, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 499 diff changeset	181
502 c6889097f81f Importer: Fix silly bug and set Hibernate session flushing back to auto. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 501 diff changeset	182 if (range != null) {
500 d50cd3a632e0 Importer: Use BigDecimals in hashing to prevent numerical problems. Cache ranges globally, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 499 diff changeset	183 return range;
d50cd3a632e0 Importer: Use BigDecimals in hashing to prevent numerical problems. Cache ranges globally, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 499 diff changeset	184 }
d50cd3a632e0 Importer: Use BigDecimals in hashing to prevent numerical problems. Cache ranges globally, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 499 diff changeset	185
d50cd3a632e0 Importer: Use BigDecimals in hashing to prevent numerical problems. Cache ranges globally, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 499 diff changeset	186 range = new Range(a, b, river);
d50cd3a632e0 Importer: Use BigDecimals in hashing to prevent numerical problems. Cache ranges globally, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 499 diff changeset	187
d50cd3a632e0 Importer: Use BigDecimals in hashing to prevent numerical problems. Cache ranges globally, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 499 diff changeset	188 databaseSession.save(range);
d50cd3a632e0 Importer: Use BigDecimals in hashing to prevent numerical problems. Cache ranges globally, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 499 diff changeset	189
503 bcc18293a547 Importer: Added unsharp lookup to avoid numerical problems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 502 diff changeset	190 map.put(key, range);
500 d50cd3a632e0 Importer: Use BigDecimals in hashing to prevent numerical problems. Cache ranges globally, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 499 diff changeset	191
d50cd3a632e0 Importer: Use BigDecimals in hashing to prevent numerical problems. Cache ranges globally, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 499 diff changeset	192 return range;
d50cd3a632e0 Importer: Use BigDecimals in hashing to prevent numerical problems. Cache ranges globally, too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 499 diff changeset	193 }
497 67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	194 }
67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	195 // vim:set ts=4 sw=4 si et sta sts=4 fenc=utf8 :

Mercurial > dive4elements > river

annotate backend/src/main/java/org/dive4elements/river/importer/ImporterSession.java @ 6955:94cb1845c667