dive4elements/river: backend/src/main/java/org/dive4elements/river/importer/ImportRiver.java annotate

annotate backend/src/main/java/org/dive4elements/river/importer/ImportRiver.java @ 7162:4683bdf77ff9

Handle flow velocity measurements in the FlowVelocity processor

author	Andre Heinecke <aheinecke@intevation.de>
date	Thu, 26 Sep 2013 10:38:21 +0200
parents	0baf7abffcc6
children	827da1952ce2 0fe00824bd96

rev	line source
5844 4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	1 /* Copyright (C) 2011, 2012, 2013 by Bundesanstalt für Gewässerkunde
4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	2 * Software engineering by Intevation GmbH
4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	3 *
5992 4c3ccf2b0304 Removed trailing whitespace. Sascha L. Teichmann <teichmann@intevation.de> parents: 5844 diff changeset	4 * This file is Free Software under the GNU AGPL (>=v3)
5844 4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	5 * and comes with ABSOLUTELY NO WARRANTY! Check out the
5992 4c3ccf2b0304 Removed trailing whitespace. Sascha L. Teichmann <teichmann@intevation.de> parents: 5844 diff changeset	6 * documentation coming with Dive4Elements River for details.
5844 4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	7 */
4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	8
5829 18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	9 package org.dive4elements.river.importer;
5446 3bd786772798 Removed obsolete imports. Sascha L. Teichmann <teichmann@intevation.de> parents: 5427 diff changeset	10
5829 18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	11 import org.dive4elements.artifacts.common.utils.FileTools.HashedFile;
5446 3bd786772798 Removed obsolete imports. Sascha L. Teichmann <teichmann@intevation.de> parents: 5427 diff changeset	12
5829 18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	13 import org.dive4elements.artifacts.common.utils.FileTools;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	14
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	15 import org.dive4elements.river.importer.parsers.AnnotationClassifier;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	16 import org.dive4elements.river.importer.parsers.AnnotationsParser;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	17 import org.dive4elements.river.importer.parsers.BedHeightEpochParser;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	18 import org.dive4elements.river.importer.parsers.BedHeightSingleParser;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	19 import org.dive4elements.river.importer.parsers.CrossSectionParser;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	20 import org.dive4elements.river.importer.parsers.DA50Parser;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	21 import org.dive4elements.river.importer.parsers.DA66Parser;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	22 import org.dive4elements.river.importer.parsers.FlowVelocityMeasurementParser;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	23 import org.dive4elements.river.importer.parsers.FlowVelocityModelParser;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	24 import org.dive4elements.river.importer.parsers.HYKParser;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	25 import org.dive4elements.river.importer.parsers.MeasurementStationsParser;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	26 import org.dive4elements.river.importer.parsers.MorphologicalWidthParser;
6335 b2a470c148a7 Backend: First steps to integrate parsing of official config files. Sascha L. Teichmann <teichmann@intevation.de> parents: 6283 diff changeset	27 import org.dive4elements.river.importer.parsers.OfficialLinesConfigParser;
5829 18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	28 import org.dive4elements.river.importer.parsers.PRFParser;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	29 import org.dive4elements.river.importer.parsers.PegelGltParser;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	30 import org.dive4elements.river.importer.parsers.SQRelationParser;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	31 import org.dive4elements.river.importer.parsers.SedimentDensityParser;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	32 import org.dive4elements.river.importer.parsers.SedimentYieldParser;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	33 import org.dive4elements.river.importer.parsers.W80Parser;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	34 import org.dive4elements.river.importer.parsers.W80CSVParser;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	35 import org.dive4elements.river.importer.parsers.WaterlevelDifferencesParser;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	36 import org.dive4elements.river.importer.parsers.WaterlevelParser;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	37 import org.dive4elements.river.importer.parsers.WstParser;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	38
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	39 import org.dive4elements.river.model.River;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	40 import org.dive4elements.river.model.Unit;
188 003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	41
5446 3bd786772798 Removed obsolete imports. Sascha L. Teichmann <teichmann@intevation.de> parents: 5427 diff changeset	42 import java.io.File;
3bd786772798 Removed obsolete imports. Sascha L. Teichmann <teichmann@intevation.de> parents: 5427 diff changeset	43 import java.io.IOException;
3bd786772798 Removed obsolete imports. Sascha L. Teichmann <teichmann@intevation.de> parents: 5427 diff changeset	44
3bd786772798 Removed obsolete imports. Sascha L. Teichmann <teichmann@intevation.de> parents: 5427 diff changeset	45 import java.util.ArrayList;
3bd786772798 Removed obsolete imports. Sascha L. Teichmann <teichmann@intevation.de> parents: 5427 diff changeset	46 import java.util.Calendar;
3bd786772798 Removed obsolete imports. Sascha L. Teichmann <teichmann@intevation.de> parents: 5427 diff changeset	47 import java.util.Date;
3bd786772798 Removed obsolete imports. Sascha L. Teichmann <teichmann@intevation.de> parents: 5427 diff changeset	48 import java.util.HashSet;
6345 0f7e9a4f1c5a Backend: Joined official lines with there importer model. Sascha L. Teichmann <teichmann@intevation.de> parents: 6339 diff changeset	49 import java.util.Iterator;
5446 3bd786772798 Removed obsolete imports. Sascha L. Teichmann <teichmann@intevation.de> parents: 5427 diff changeset	50 import java.util.List;
3bd786772798 Removed obsolete imports. Sascha L. Teichmann <teichmann@intevation.de> parents: 5427 diff changeset	51 import java.util.Map;
3bd786772798 Removed obsolete imports. Sascha L. Teichmann <teichmann@intevation.de> parents: 5427 diff changeset	52 import java.util.Set;
3bd786772798 Removed obsolete imports. Sascha L. Teichmann <teichmann@intevation.de> parents: 5427 diff changeset	53
3bd786772798 Removed obsolete imports. Sascha L. Teichmann <teichmann@intevation.de> parents: 5427 diff changeset	54 import org.apache.log4j.Logger;
3bd786772798 Removed obsolete imports. Sascha L. Teichmann <teichmann@intevation.de> parents: 5427 diff changeset	55
3bd786772798 Removed obsolete imports. Sascha L. Teichmann <teichmann@intevation.de> parents: 5427 diff changeset	56 import org.hibernate.Query;
3bd786772798 Removed obsolete imports. Sascha L. Teichmann <teichmann@intevation.de> parents: 5427 diff changeset	57 import org.hibernate.Session;
3bd786772798 Removed obsolete imports. Sascha L. Teichmann <teichmann@intevation.de> parents: 5427 diff changeset	58
4706 e7b238247c4e Documentation added. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4678 diff changeset	59
e7b238247c4e Documentation added. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4678 diff changeset	60 /** Import all river-related data (files) that can be found. */
177 31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	61 public class ImportRiver
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	62 {
5016 255898799ed9 Minimal whitespace and doc cosmetics. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4808 diff changeset	63 /** Private logger. */
184 4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	64 private static Logger log = Logger.getLogger(ImportRiver.class);
4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	65
4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	66 public static final String PEGEL_GLT = "PEGEL.GLT";
4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	67
483 f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	68 public static final String FIXATIONS = "Fixierungen";
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	69
482 3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	70 public static final String EXTRA_LONGITUDINALS =
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	71 "Zus.L\u00e4ngsschnitte";
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	72
484 a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	73 public static final String [] OFFICIAL_LINES_FOLDERS = {
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	74 "Basisdaten",
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	75 "Fixierungen" };
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	76
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	77 public static final String OFFICIAL_LINES =
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	78 "Amtl_Linien.wst";
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	79
6335 b2a470c148a7 Backend: First steps to integrate parsing of official config files. Sascha L. Teichmann <teichmann@intevation.de> parents: 6283 diff changeset	80 public static final String OFFICIAL_LINES_CONFIG =
b2a470c148a7 Backend: First steps to integrate parsing of official config files. Sascha L. Teichmann <teichmann@intevation.de> parents: 6283 diff changeset	81 "Amtl_Linien.config";
b2a470c148a7 Backend: First steps to integrate parsing of official config files. Sascha L. Teichmann <teichmann@intevation.de> parents: 6283 diff changeset	82
490 13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	83 public static final String FLOOD_WATER = "HW-Marken";
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	84
494 88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	85 public static final String FLOOD_PROTECTION =
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	86 "HW-Schutzanlagen";
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	87
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	88 public static final String MINFO_DIR = "Morphologie";
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	89
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	90 public static final String BED_HEIGHT_DIR = "Sohlhoehen";
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	91
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	92 public static final String BED_HEIGHT_SINGLE_DIR = "Einzeljahre";
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	93
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	94 public static final String BED_HEIGHT_EPOCH_DIR = "Epochen";
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	95
2815 3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	96 public static final String SEDIMENT_DENSITY_DIR = "Sedimentdichte";
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	97
2821 0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	98 public static final String MORPHOLOGICAL_WIDTH_DIR = "morphologische_Breite";
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	99
2826 c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	100 public static final String FLOW_VELOCITY_DIR = "Geschwindigkeit_Schubspannung";
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	101
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	102 public static final String FLOW_VELOCITY_MODEL = "Modellrechnungen";
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	103
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	104 public static final String FLOW_VELOCITY_MEASUREMENTS = "v-Messungen";
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	105
2839 163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	106 public static final String SEDIMENT_YIELD_DIR = "Fracht";
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	107
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	108 public static final String SEDIMENT_YIELD_SINGLE_DIR = "Einzeljahre";
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	109
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	110 public static final String SEDIMENT_YIELD_EPOCH_DIR = "Epochen";
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	111
6724 0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	112 public static final String SEDIMENT_YIELD_OFF_EPOCH_DIR = "amtliche Epochen";
0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	113
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	114 public static final String MINFO_FIXATIONS_DIR = "Fixierungsanalyse";
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	115
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	116 public static final String MINFO_WATERLEVELS_DIR = "Wasserspiegellagen";
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	117
2851 acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	118 public static final String MINFO_WATERLEVEL_DIFF_DIR = "Wasserspiegeldifferenzen";
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	119
4193 f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	120 public static final String MINFO_BASE_DIR = "Basisdaten";
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	121
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	122 public static final String MINFO_CORE_DATA_FILE = "Stammdaten_Messstellen.csv";
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	123
3328 a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	124 public static final String MINFO_SQ_DIR = "Feststofftransport-Abfluss-Beziehung";
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	125
177 31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	126 protected String name;
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	127
5020 443c173f043a ImportRiver: Added officialNumber field. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5017 diff changeset	128 protected Long officialNumber;
177 31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	129
5020 443c173f043a ImportRiver: Added officialNumber field. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5017 diff changeset	130 protected File wstFile;
443c173f043a ImportRiver: Added officialNumber field. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5017 diff changeset	131
443c173f043a ImportRiver: Added officialNumber field. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5017 diff changeset	132 protected File bbInfoFile;
177 31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	133
184 4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	134 protected List<ImportGauge> gauges;
4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	135
186 cf8cbcb6a10d Added parser to read .KM files. Sascha L. Teichmann <sascha.teichmann@intevation.de>* parents: 184 diff changeset	136 protected List<ImportAnnotation> annotations;
cf8cbcb6a10d Added parser to read .KM files. Sascha L. Teichmann <sascha.teichmann@intevation.de>* parents: 184 diff changeset	137
1220 3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	138 protected List<ImportHYK> hyks;
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	139
1204 22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	140 protected List<ImportCrossSection> crossSections;
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	141
482 3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	142 protected List<ImportWst> extraWsts;
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	143
483 f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	144 protected List<ImportWst> fixations;
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	145
484 a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	146 protected List<ImportWst> officialLines;
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	147
490 13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	148 protected List<ImportWst> floodWater;
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	149
494 88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	150 protected List<ImportWst> floodProtection;
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	151
5261 1e403a0efc21 ImportRiver: Light cleaning up, waterlevelimport more parralel to other imports. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5248 diff changeset	152 /** Wst-structures from waterlevel-csv files. */
1e403a0efc21 ImportRiver: Light cleaning up, waterlevelimport more parralel to other imports. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5248 diff changeset	153 protected List<ImportWst> waterlevels;
1e403a0efc21 ImportRiver: Light cleaning up, waterlevelimport more parralel to other imports. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5248 diff changeset	154
5227 a981222b6260 ImportRiver: Preparing wst-based waterleveldifferences. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5149 diff changeset	155 /** Wst-structures from waterlevel-difference-csv files. */
a981222b6260 ImportRiver: Preparing wst-based waterleveldifferences. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5149 diff changeset	156 protected List<ImportWst> waterlevelDifferences;
a981222b6260 ImportRiver: Preparing wst-based waterleveldifferences. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5149 diff changeset	157
2811 8926571e47fb Finished importing MINFO bed heights (single and epoch). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2810 diff changeset	158 protected List<ImportBedHeight> bedHeightSingles;
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	159
2811 8926571e47fb Finished importing MINFO bed heights (single and epoch). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2810 diff changeset	160 protected List<ImportBedHeight> bedHeightEpochs;
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	161
2815 3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	162 protected List<ImportSedimentDensity> sedimentDensities;
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	163
2821 0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	164 protected List<ImportMorphWidth> morphologicalWidths;
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	165
2827 85b25e74594f Added temp classes used during the import process of flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2826 diff changeset	166 protected List<ImportFlowVelocityModel> flowVelocityModels;
85b25e74594f Added temp classes used during the import process of flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2826 diff changeset	167
2832 ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	168 protected List<ImportFlowVelocityMeasurement> flowVelocityMeasurements;
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	169
2839 163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	170 protected List<ImportSedimentYield> sedimentYields;
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	171
4193 f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	172 protected List<ImportMeasurementStation> measurementStations;
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	173
3328 a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	174 protected List<ImportSQRelation> sqRelations;
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	175
201 3169b559ca3c Build models for wsts, wst columns and q ranges and store them in the backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 197 diff changeset	176 protected ImportWst wst;
3169b559ca3c Build models for wsts, wst columns and q ranges and store them in the backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 197 diff changeset	177
2347 0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	178 protected ImportUnit wstUnit;
0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	179
765 763c4137d6e1 Added classification of annotation types. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 503 diff changeset	180 protected AnnotationClassifier annotationClassifier;
763c4137d6e1 Added classification of annotation types. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 503 diff changeset	181
5017 51a353887871 Tiny doc. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5016 diff changeset	182 /** Database-mapped River instance. */
188 003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	183 protected River peer;
003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	184
4778 a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	185
5806 afcad84755f9 ImportRiver: Doc/Cosmetics. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5446 diff changeset	186 /** Callback-implementation for CrossSectionParsers:
afcad84755f9 ImportRiver: Doc/Cosmetics. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5446 diff changeset	187 * Accept files with different md5(?)sums than what has already been parsed,
afcad84755f9 ImportRiver: Doc/Cosmetics. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5446 diff changeset	188 * on successfull parse, add data. */
4778 a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	189 class ImportRiverCrossSectionParserCallback implements CrossSectionParser.Callback {
a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	190 Set<HashedFile> files = new HashSet<HashedFile>();
a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	191 String type;
a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	192
a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	193
a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	194 /**
a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	195 * Create new Callback, given type which is used for logging
a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	196 * purposes only.
a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	197 */
a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	198 public ImportRiverCrossSectionParserCallback (String type) {
a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	199 this.type = type;
a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	200 }
a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	201
a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	202
a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	203 /** Accept file if not duplicate. */
a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	204 public boolean accept(File file) {
a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	205 HashedFile hf = new HashedFile(file);
a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	206 boolean success = files.add(hf);
a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	207 if (!success) {
a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	208 log.warn(type + " file '" + file + "' seems to be a duplicate.");
a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	209 }
a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	210 return success;
a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	211 }
a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	212
a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	213
a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	214 /** Add crosssection. */
5806 afcad84755f9 ImportRiver: Doc/Cosmetics. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5446 diff changeset	215 public void parsed(CrossSectionParser parser) {
4778 a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	216 log.debug("callback from " + type + " parser");
a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	217
a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	218 addCrossSections(parser);
a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	219 }
5149 3b58bb0c55e3 Removed trailing white space Sascha L. Teichmann <teichmann@intevation.de> parents: 5080 diff changeset	220 } // ImportRiverCrossSectionParserCallback
4778 a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	221
a70de5298248 ImportRiver: Add helper implementation of a CrossSectionParserCallback. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4767 diff changeset	222
177 31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	223 public ImportRiver() {
2832 ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	224 hyks = new ArrayList<ImportHYK>();
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	225 crossSections = new ArrayList<ImportCrossSection>();
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	226 extraWsts = new ArrayList<ImportWst>();
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	227 fixations = new ArrayList<ImportWst>();
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	228 officialLines = new ArrayList<ImportWst>();
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	229 floodWater = new ArrayList<ImportWst>();
5261 1e403a0efc21 ImportRiver: Light cleaning up, waterlevelimport more parralel to other imports. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5248 diff changeset	230 waterlevels = new ArrayList<ImportWst>();
5227 a981222b6260 ImportRiver: Preparing wst-based waterleveldifferences. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5149 diff changeset	231 waterlevelDifferences = new ArrayList<ImportWst>();
2832 ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	232 floodProtection = new ArrayList<ImportWst>();
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	233 sedimentDensities = new ArrayList<ImportSedimentDensity>();
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	234 morphologicalWidths = new ArrayList<ImportMorphWidth>();
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	235 flowVelocityModels = new ArrayList<ImportFlowVelocityModel>();
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	236 flowVelocityMeasurements = new ArrayList<ImportFlowVelocityMeasurement>();
2839 163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	237 sedimentYields = new ArrayList<ImportSedimentYield>();
4193 f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	238 measurementStations = new ArrayList<ImportMeasurementStation>();
3328 a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	239 sqRelations = new ArrayList<ImportSQRelation>();
177 31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	240 }
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	241
766 aa9e3da95c31 Importer: Fix import of annotation type classification. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 765 diff changeset	242 public ImportRiver(
aa9e3da95c31 Importer: Fix import of annotation type classification. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 765 diff changeset	243 String name,
aa9e3da95c31 Importer: Fix import of annotation type classification. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 765 diff changeset	244 File wstFile,
aa9e3da95c31 Importer: Fix import of annotation type classification. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 765 diff changeset	245 File bbInfoFile,
aa9e3da95c31 Importer: Fix import of annotation type classification. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 765 diff changeset	246 AnnotationClassifier annotationClassifier
aa9e3da95c31 Importer: Fix import of annotation type classification. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 765 diff changeset	247 ) {
482 3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	248 this();
766 aa9e3da95c31 Importer: Fix import of annotation type classification. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 765 diff changeset	249 this.name = name;
aa9e3da95c31 Importer: Fix import of annotation type classification. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 765 diff changeset	250 this.wstFile = wstFile;
aa9e3da95c31 Importer: Fix import of annotation type classification. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 765 diff changeset	251 this.bbInfoFile = bbInfoFile;
aa9e3da95c31 Importer: Fix import of annotation type classification. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 765 diff changeset	252 this.annotationClassifier = annotationClassifier;
177 31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	253 }
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	254
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	255 public String getName() {
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	256 return name;
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	257 }
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	258
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	259 public void setName(String name) {
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	260 this.name = name;
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	261 }
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	262
5020 443c173f043a ImportRiver: Added officialNumber field. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5017 diff changeset	263 public Long getOfficialNumber() {
443c173f043a ImportRiver: Added officialNumber field. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5017 diff changeset	264 return this.officialNumber;
443c173f043a ImportRiver: Added officialNumber field. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5017 diff changeset	265 }
443c173f043a ImportRiver: Added officialNumber field. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5017 diff changeset	266
443c173f043a ImportRiver: Added officialNumber field. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5017 diff changeset	267 public void setOfficialNumber(Long officialNumber) {
443c173f043a ImportRiver: Added officialNumber field. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5017 diff changeset	268 this.officialNumber = officialNumber;
443c173f043a ImportRiver: Added officialNumber field. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5017 diff changeset	269 }
443c173f043a ImportRiver: Added officialNumber field. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5017 diff changeset	270
177 31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	271 public File getWstFile() {
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	272 return wstFile;
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	273 }
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	274
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	275 public void setWstFile(File wstFile) {
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	276 this.wstFile = wstFile;
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	277 }
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	278
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	279 public File getBBInfo() {
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	280 return bbInfoFile;
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	281 }
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	282
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	283 public void setBBInfo(File bbInfoFile) {
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	284 this.bbInfoFile = bbInfoFile;
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	285 }
184 4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	286
201 3169b559ca3c Build models for wsts, wst columns and q ranges and store them in the backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 197 diff changeset	287 public ImportWst getWst() {
3169b559ca3c Build models for wsts, wst columns and q ranges and store them in the backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 197 diff changeset	288 return wst;
3169b559ca3c Build models for wsts, wst columns and q ranges and store them in the backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 197 diff changeset	289 }
3169b559ca3c Build models for wsts, wst columns and q ranges and store them in the backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 197 diff changeset	290
3169b559ca3c Build models for wsts, wst columns and q ranges and store them in the backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 197 diff changeset	291 public void setWst(ImportWst wst) {
3169b559ca3c Build models for wsts, wst columns and q ranges and store them in the backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 197 diff changeset	292 this.wst = wst;
3169b559ca3c Build models for wsts, wst columns and q ranges and store them in the backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 197 diff changeset	293 }
3169b559ca3c Build models for wsts, wst columns and q ranges and store them in the backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 197 diff changeset	294
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	295 public File getMinfoDir() {
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	296 File riverDir = wstFile.getParentFile().getParentFile().getParentFile();
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	297 return new File(riverDir, MINFO_DIR);
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	298 }
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	299
186 cf8cbcb6a10d Added parser to read .KM files. Sascha L. Teichmann <sascha.teichmann@intevation.de>* parents: 184 diff changeset	300 public void parseDependencies() throws IOException {
cf8cbcb6a10d Added parser to read .KM files. Sascha L. Teichmann <sascha.teichmann@intevation.de>* parents: 184 diff changeset	301 parseGauges();
cf8cbcb6a10d Added parser to read .KM files. Sascha L. Teichmann <sascha.teichmann@intevation.de>* parents: 184 diff changeset	302 parseAnnotations();
1204 22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	303 parsePRFs();
4712 70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	304 parseDA66s();
4767 03246a8b3869 ImportRiver: Added w80 and hook for da50 parsing (not implemented). Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4735 diff changeset	305 parseDA50s();
03246a8b3869 ImportRiver: Added w80 and hook for da50 parsing (not implemented). Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4735 diff changeset	306 parseW80s();
5810 dba9e1fa233e ImportRiver: Trigger w80csv-parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5806 diff changeset	307 parseW80CSVs();
1220 3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	308 parseHYKs();
197 c0dcc2357106 Added stub for WST parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 194 diff changeset	309 parseWst();
482 3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	310 parseExtraWsts();
483 f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	311 parseFixations();
484 a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	312 parseOfficialLines();
490 13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	313 parseFloodWater();
494 88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	314 parseFloodProtection();
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	315 parseBedHeight();
2815 3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	316 parseSedimentDensity();
2821 0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	317 parseMorphologicalWidth();
2826 c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	318 parseFlowVelocity();
2839 163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	319 parseSedimentYield();
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	320 parseWaterlevels();
2851 acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	321 parseWaterlevelDifferences();
4193 f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	322 parseMeasurementStations();
3328 a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	323 parseSQRelation();
494 88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	324 }
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	325
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	326 public void parseFloodProtection() throws IOException {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	327 if (Config.INSTANCE.skipFloodProtection()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	328 log.info("skip parsing flood protection");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	329 return;
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	330 }
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	331
494 88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	332 log.info("Parse flood protection wst file");
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	333
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	334 File riverDir = wstFile.getParentFile().getParentFile();
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	335
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	336 File dir = FileTools.repair(new File(riverDir, FLOOD_PROTECTION));
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	337
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	338 if (!dir.isDirectory() \|\| !dir.canRead()) {
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	339 log.info("no directory '" + dir + "' found");
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	340 return;
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	341 }
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	342
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	343 File [] files = dir.listFiles();
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	344
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	345 if (files == null) {
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	346 log.warn("cannot read '" + dir + "'");
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	347 return;
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	348 }
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	349
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	350 for (File file: files) {
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	351 if (!file.isFile() \|\| !file.canRead()) {
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	352 continue;
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	353 }
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	354 String name = file.getName().toLowerCase();
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	355 if (!(name.endsWith(".zus") \|\| name.endsWith(".wst"))) {
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	356 continue;
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	357 }
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	358 log.info("found file '" + file.getName() + "'");
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	359 WstParser wstParser = new WstParser();
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	360 wstParser.parse(file);
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	361 ImportWst iw = wstParser.getWst();
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	362 iw.setKind(5);
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	363 iw.setDescription(FLOOD_PROTECTION + "/" + iw.getDescription());
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	364 floodProtection.add(iw);
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	365 }
490 13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	366 }
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	367
5027 25c180fa6162 Use BWASTRParser to set official numbers on rivers. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5020 diff changeset	368 public void storeOfficialNumber() {
25c180fa6162 Use BWASTRParser to set official numbers on rivers. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5020 diff changeset	369 if (Config.INSTANCE.skipBWASTR()) {
25c180fa6162 Use BWASTRParser to set official numbers on rivers. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5020 diff changeset	370 log.info("skip storing official number.");
25c180fa6162 Use BWASTRParser to set official numbers on rivers. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5020 diff changeset	371 return;
25c180fa6162 Use BWASTRParser to set official numbers on rivers. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5020 diff changeset	372 }
25c180fa6162 Use BWASTRParser to set official numbers on rivers. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5020 diff changeset	373 getPeer().setOfficialNumber(officialNumber);
25c180fa6162 Use BWASTRParser to set official numbers on rivers. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5020 diff changeset	374 }
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	375
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	376 public void parseBedHeight() throws IOException {
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	377 File minfoDir = getMinfoDir();
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	378 File bedHeightDir = new File(minfoDir, BED_HEIGHT_DIR);
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	379 File singlesDir = new File(bedHeightDir, BED_HEIGHT_SINGLE_DIR);
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	380 File epochDir = new File(bedHeightDir, BED_HEIGHT_EPOCH_DIR);
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	381
2810 04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	382 if (Config.INSTANCE.skipBedHeightSingle()) {
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	383 log.info("skip parsing bed height single.");
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	384 }
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	385 else {
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	386 log.info("Parse bed height single.");
2810 04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	387 parseBedHeightSingles(singlesDir);
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	388 }
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	389
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	390 if (Config.INSTANCE.skipBedHeightEpoch()) {
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	391 log.info("skip parsing bed height epochs.");
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	392 }
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	393 else {
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	394 log.info("Parse bed height epochs.");
2810 04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	395 parseBedHeightEpochs(epochDir);
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	396 }
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	397 }
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	398
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	399
2815 3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	400 protected void parseSedimentDensity() throws IOException {
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	401 if (Config.INSTANCE.skipSedimentDensity()) {
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	402 log.info("skip parsing sediment density.");
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	403 return;
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	404 }
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	405
3327 bf8d9a4f4cd4 Cleared some irritating debug messages. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3320 diff changeset	406 log.debug("Parse sediment density");
bf8d9a4f4cd4 Cleared some irritating debug messages. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3320 diff changeset	407
2815 3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	408 File minfoDir = getMinfoDir();
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	409 File sediment = new File(minfoDir, SEDIMENT_DENSITY_DIR);
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	410
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	411 File[] files = sediment.listFiles();
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	412
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	413 if (files == null) {
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	414 log.warn("Cannot read directory '" + sediment + "'");
2815 3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	415 return;
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	416 }
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	417
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	418 SedimentDensityParser parser = new SedimentDensityParser();
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	419
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	420 for (File file: files) {
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	421 parser.parse(file);
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	422 }
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	423
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	424 sedimentDensities = parser.getSedimentDensities();
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	425
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	426 log.info("Parsed " + sedimentDensities.size() + " sediment densities.");
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	427 }
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	428
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	429
2821 0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	430 protected void parseMorphologicalWidth() throws IOException {
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	431 if (Config.INSTANCE.skipMorphologicalWidth()) {
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	432 log.info("skip parsing morphological width.");
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	433 return;
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	434 }
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	435
3327 bf8d9a4f4cd4 Cleared some irritating debug messages. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3320 diff changeset	436 log.debug("Parse morphological width");
bf8d9a4f4cd4 Cleared some irritating debug messages. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3320 diff changeset	437
2821 0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	438 File minfoDir = getMinfoDir();
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	439 File morphDir = new File(minfoDir, MORPHOLOGICAL_WIDTH_DIR);
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	440
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	441 File[] files = morphDir.listFiles();
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	442
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	443 if (files == null) {
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	444 log.warn("Cannot read directory '" + morphDir + "'");
2821 0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	445 return;
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	446 }
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	447
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	448 MorphologicalWidthParser parser = new MorphologicalWidthParser();
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	449
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	450 for (File file: files) {
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	451 parser.parse(file);
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	452 }
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	453
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	454 morphologicalWidths = parser.getMorphologicalWidths();
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	455
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	456 log.info("Parsed " + morphologicalWidths.size() + " morph. widths files.");
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	457 }
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	458
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	459
2826 c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	460 protected void parseFlowVelocity() throws IOException {
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	461 if (Config.INSTANCE.skipFlowVelocity()) {
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	462 log.info("skip parsing flow velocity");
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	463 return;
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	464 }
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	465
3328 a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	466 log.debug("Parse flow velocity");
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	467
2826 c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	468 File minfoDir = getMinfoDir();
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	469 File flowDir = new File(minfoDir, FLOW_VELOCITY_DIR);
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	470 File modelDir = new File(flowDir, FLOW_VELOCITY_MODEL);
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	471 File measureDir = new File(flowDir, FLOW_VELOCITY_MEASUREMENTS);
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	472
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	473 File[] modelFiles = modelDir.listFiles();
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	474 File[] measureFiles = measureDir.listFiles();
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	475
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	476 if (modelFiles == null) {
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	477 log.warn("Cannot read directory '" + modelDir + "'");
2826 c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	478 }
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	479 else {
2828 ac13e466a55e Added a parser for flow velocity model data and adjusted the db relation schema (missing q column). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2827 diff changeset	480 FlowVelocityModelParser parser = new FlowVelocityModelParser();
ac13e466a55e Added a parser for flow velocity model data and adjusted the db relation schema (missing q column). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2827 diff changeset	481
2826 c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	482 for (File model: modelFiles) {
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	483 log.debug("Parse file '" + model + "'");
2828 ac13e466a55e Added a parser for flow velocity model data and adjusted the db relation schema (missing q column). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2827 diff changeset	484 parser.parse(model);
2826 c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	485 }
2828 ac13e466a55e Added a parser for flow velocity model data and adjusted the db relation schema (missing q column). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2827 diff changeset	486
ac13e466a55e Added a parser for flow velocity model data and adjusted the db relation schema (missing q column). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2827 diff changeset	487 flowVelocityModels = parser.getModels();
2826 c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	488 }
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	489
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	490 if (measureFiles == null) {
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	491 log.warn("Cannot read directory '" + measureDir + "'");
2826 c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	492 }
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	493 else {
2832 ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	494 FlowVelocityMeasurementParser parser =
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	495 new FlowVelocityMeasurementParser();
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	496
2826 c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	497 for (File measurement: measureFiles) {
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	498 log.debug("Parse file '" + measurement + "'");
2832 ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	499 parser.parse(measurement);
2826 c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	500 }
2832 ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	501
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	502 flowVelocityMeasurements = parser.getMeasurements();
2826 c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	503 }
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	504 }
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	505
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	506
6724 0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	507 private void parseSedimentYieldDir(
0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	508 File[] files,
0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	509 SedimentYieldParser parser
0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	510 ) throws IOException {
0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	511 for (File file: files) {
0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	512 if (file.isDirectory()) {
0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	513 for (File child: file.listFiles()) {
0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	514 parser.parse(child);
0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	515 }
0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	516 }
0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	517 else {
0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	518 parser.parse(file);
0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	519 }
0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	520 }
0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	521 }
0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	522
2839 163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	523 protected void parseSedimentYield() throws IOException {
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	524 if (Config.INSTANCE.skipSedimentYield()) {
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	525 log.info("skip parsing sediment yield data");
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	526 return;
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	527 }
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	528
3327 bf8d9a4f4cd4 Cleared some irritating debug messages. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3320 diff changeset	529 log.debug("Parse sediment yield data");
bf8d9a4f4cd4 Cleared some irritating debug messages. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3320 diff changeset	530
2839 163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	531 File minfoDir = getMinfoDir();
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	532 File sedimentYieldDir = new File(minfoDir, SEDIMENT_YIELD_DIR);
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	533
6724 0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	534 File singleDir = new File(sedimentYieldDir, SEDIMENT_YIELD_SINGLE_DIR);
0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	535 File epochDir = new File(sedimentYieldDir, SEDIMENT_YIELD_EPOCH_DIR);
0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	536 File offEpochDir = new File(sedimentYieldDir, SEDIMENT_YIELD_OFF_EPOCH_DIR);
2839 163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	537
6724 0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	538 File[] singles = singleDir.listFiles();
0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	539 File[] epochs = epochDir.listFiles();
0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	540 File[] offEpochs = offEpochDir.listFiles();
2839 163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	541
2840 71175502d868 Added a parser for sediment yield files; started parsing and store values in db. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2839 diff changeset	542 SedimentYieldParser parser = new SedimentYieldParser();
71175502d868 Added a parser for sediment yield files; started parsing and store values in db. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2839 diff changeset	543
2839 163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	544 if (singles == null \|\| singles.length == 0) {
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	545 log.warn("Cannot read directory '" + singleDir + "'");
2839 163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	546 }
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	547 else {
6724 0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	548 parseSedimentYieldDir(singles, parser);
2839 163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	549 }
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	550
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	551 if (epochs == null \|\| epochs.length == 0) {
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	552 log.warn("Cannot read directory '" + epochDir + "'");
2839 163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	553 }
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	554 else {
6724 0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	555 parseSedimentYieldDir(epochs, parser);
0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	556 }
0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	557
0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	558 if (offEpochs == null \|\| offEpochs.length == 0) {
0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	559 log.warn("Cannot read directory '" + offEpochDir + "'");
0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	560 }
0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	561 else {
0baf7abffcc6 issue1393/ImportRiver: Import official epochs from directory, minor refac. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6347 diff changeset	562 parseSedimentYieldDir(offEpochs, parser);
2839 163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	563 }
2840 71175502d868 Added a parser for sediment yield files; started parsing and store values in db. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2839 diff changeset	564
71175502d868 Added a parser for sediment yield files; started parsing and store values in db. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2839 diff changeset	565 sedimentYields = parser.getSedimentYields();
2839 163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	566 }
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	567
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	568
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	569 protected void parseWaterlevels() throws IOException {
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	570 if (Config.INSTANCE.skipWaterlevels()) {
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	571 log.info("skip parsing waterlevels");
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	572 return;
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	573 }
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	574
2851 acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	575 log.info("Parse waterlevels");
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	576
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	577 File minfo = getMinfoDir();
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	578 File fixDir = new File(minfo, MINFO_FIXATIONS_DIR);
2845 a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	579 File wspDir = new File(fixDir, MINFO_WATERLEVELS_DIR);
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	580
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	581 File[] files = wspDir.listFiles();
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	582
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	583 if (files == null) {
5262 0d9ad1c432b8 ImportRiver: Cosmetics, resolved todo. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5261 diff changeset	584 log.warn("Cannot read directory for wl '" + wspDir + "'");
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	585 return;
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	586 }
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	587
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	588 WaterlevelParser parser = new WaterlevelParser();
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	589
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	590 for (File file: files) {
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	591 parser.parse(file);
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	592 }
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	593
5050 e6dc908297e8 ImportRiver: Make waterlevels become fixation-wsts. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5027 diff changeset	594 // The parsed ImportWaterlevels are converted to
e6dc908297e8 ImportRiver: Make waterlevels become fixation-wsts. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5027 diff changeset	595 // 'fixation'-wsts now.
5247 93d4145d5740 WaterlevelParser, ImportRiver: Remove deprecated exportWst()-usage. Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5232 diff changeset	596 for(ImportWst iw: parser.getWaterlevels()) {
5227 a981222b6260 ImportRiver: Preparing wst-based waterleveldifferences. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5149 diff changeset	597 iw.setDescription("CSV/" + iw.getDescription());
6283 e81e9dcc81b4 Switch wst_kinds of Waterleve/-Differences (6/7). Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5992 diff changeset	598 iw.setKind(7);
5261 1e403a0efc21 ImportRiver: Light cleaning up, waterlevelimport more parralel to other imports. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5248 diff changeset	599 waterlevels.add(iw);
5050 e6dc908297e8 ImportRiver: Make waterlevels become fixation-wsts. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5027 diff changeset	600 }
2851 acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	601 }
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	602
4193 f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	603 protected void parseMeasurementStations() throws IOException {
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	604 if (Config.INSTANCE.skipMeasurementStations()) {
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	605 log.info("skip parsing measurement stations");
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	606 return;
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	607 }
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	608
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	609 log.info("Parse measurement stations");
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	610
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	611 File minfo = getMinfoDir();
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	612 File minfoBaseDir = new File(minfo, MINFO_BASE_DIR);
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	613 File coredataFile = new File(minfoBaseDir, MINFO_CORE_DATA_FILE);
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	614
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	615 if (coredataFile == null \|\| !coredataFile.exists()) {
5427 473edafe4cb1 Improved logging. Raimund Renkert <rrenkert@intevation.de> parents: 5416 diff changeset	616 log.warn("No core data file '" + coredataFile.getAbsolutePath() + "' found");
4193 f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	617 return;
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	618 }
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	619
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	620 MeasurementStationsParser parser = new MeasurementStationsParser();
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	621 try {
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	622 parser.parse(coredataFile);
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	623 measurementStations = parser.getMeasurementStations();
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	624
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	625 log.info("Successfully parsed " + measurementStations.size() + " measurement stations.");
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	626 }
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	627 catch (IOException ioe) {
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	628 log.error("unable to parse file '" + coredataFile.getName() +
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	629 ": " + ioe.getMessage());
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	630 }
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	631 }
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	632
2851 acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	633
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	634 protected void parseWaterlevelDifferences() throws IOException {
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	635 if (Config.INSTANCE.skipWaterlevelDifferences()) {
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	636 log.info("skip parsing waterlevel differences");
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	637 return;
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	638 }
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	639
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	640 log.info("Parse waterlevel differences");
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	641
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	642 File minfo = getMinfoDir();
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	643 File fixDir = new File(minfo, MINFO_FIXATIONS_DIR);
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	644 File diffDir = new File(fixDir, MINFO_WATERLEVEL_DIFF_DIR);
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	645
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	646 File[] files = diffDir.listFiles();
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	647
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	648 if (files == null) {
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	649 log.warn("Cannot read directory '" + diffDir + "'");
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	650 return;
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	651 }
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	652
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	653 WaterlevelDifferencesParser parser = new WaterlevelDifferencesParser();
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	654
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	655 for (File file: files) {
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	656 parser.parse(file);
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	657 }
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	658
5232 11b2a0c55318 ImportRiver: Import WaterlevelDifferences as Wst. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5227 diff changeset	659 // WaterlevelDifferences become Wsts now.
5247 93d4145d5740 WaterlevelParser, ImportRiver: Remove deprecated exportWst()-usage. Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5232 diff changeset	660 for(ImportWst iw: parser.getDifferences()) {
5232 11b2a0c55318 ImportRiver: Import WaterlevelDifferences as Wst. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5227 diff changeset	661 iw.setDescription("CSV/" + iw.getDescription());
6283 e81e9dcc81b4 Switch wst_kinds of Waterleve/-Differences (6/7). Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5992 diff changeset	662 iw.setKind(6);
5232 11b2a0c55318 ImportRiver: Import WaterlevelDifferences as Wst. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5227 diff changeset	663 waterlevelDifferences.add(iw);
11b2a0c55318 ImportRiver: Import WaterlevelDifferences as Wst. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5227 diff changeset	664 }
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	665 }
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	666
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	667
3328 a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	668 protected void parseSQRelation() throws IOException {
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	669 if (Config.INSTANCE.skipSQRelation()) {
3329 cc8fc6b29649 Store sq relations into database after parsing. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3328 diff changeset	670 log.info("skip parsing sq relation");
3328 a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	671 return;
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	672 }
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	673
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	674 log.info("Parse sq relations");
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	675
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	676 File minfo = getMinfoDir();
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	677 File sqDir = new File(minfo, MINFO_SQ_DIR);
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	678
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	679 File[] files = sqDir.listFiles();
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	680
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	681 if (files == null) {
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	682 log.warn("Cannot read directory '" + sqDir + "'");
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	683 return;
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	684 }
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	685
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	686 SQRelationParser parser = new SQRelationParser();
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	687
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	688 for (File file: files) {
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	689 parser.parse(file);
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	690 }
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	691
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	692 sqRelations = parser.getSQRelations();
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	693
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	694 log.debug("Parsed " + sqRelations.size() + " SQ relations.");
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	695 }
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	696
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	697
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	698 protected void parseBedHeightSingles(File dir) throws IOException {
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	699 log.debug("Parse bed height singles");
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	700
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	701 File[] files = dir.listFiles();
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	702
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	703 if (files == null) {
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	704 log.warn("Cannot read directory '" + dir + "'");
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	705 return;
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	706 }
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	707
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	708 BedHeightSingleParser parser = new BedHeightSingleParser();
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	709
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	710 for (File file: files) {
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	711 parser.parse(file);
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	712 }
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	713
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	714 bedHeightSingles = parser.getBedHeights();
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	715 }
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	716
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	717
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	718 protected void parseBedHeightEpochs(File dir) throws IOException {
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	719 log.debug("Parse bed height epochs");
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	720
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	721 File[] files = dir.listFiles();
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	722
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	723 if (files == null) {
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	724 log.warn("Cannot read directory '" + dir + "'");
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	725 return;
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	726 }
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	727
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	728 BedHeightEpochParser parser = new BedHeightEpochParser();
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	729
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	730 for (File file: files) {
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	731 parser.parse(file);
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	732 }
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	733
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	734 bedHeightEpochs = parser.getBedHeights();
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	735 }
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	736
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	737
490 13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	738 public void parseFloodWater() throws IOException {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	739 if (Config.INSTANCE.skipFloodWater()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	740 log.info("skip parsing flod water");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	741 return;
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	742 }
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	743
490 13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	744 log.info("Parse flood water wst file");
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	745
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	746 File riverDir = wstFile.getParentFile().getParentFile();
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	747
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	748 File dir = FileTools.repair(new File(riverDir, FLOOD_WATER));
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	749
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	750 if (!dir.isDirectory() \|\| !dir.canRead()) {
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	751 log.info("no directory '" + dir + "' found");
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	752 return;
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	753 }
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	754
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	755 File [] files = dir.listFiles();
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	756
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	757 if (files == null) {
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	758 log.warn("cannot read '" + dir + "'");
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	759 return;
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	760 }
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	761
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	762 for (File file: files) {
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	763 if (!file.isFile() \|\| !file.canRead()) {
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	764 continue;
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	765 }
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	766 String name = file.getName().toLowerCase();
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	767 if (!(name.endsWith(".zus") \|\| name.endsWith(".wst"))) {
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	768 continue;
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	769 }
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	770 log.info("found file '" + file.getName() + "'");
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	771 WstParser wstParser = new WstParser();
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	772 wstParser.parse(file);
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	773 ImportWst iw = wstParser.getWst();
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	774 iw.setKind(4);
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	775 iw.setDescription(FLOOD_WATER + "/" + iw.getDescription());
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	776 floodWater.add(iw);
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	777 }
484 a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	778 }
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	779
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	780 public void parseOfficialLines() throws IOException {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	781 if (Config.INSTANCE.skipOfficialLines()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	782 log.info("skip parsing official lines");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	783 return;
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	784 }
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	785
484 a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	786 log.info("Parse official wst files");
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	787
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	788 File riverDir = wstFile.getParentFile().getParentFile();
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	789
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	790 for (String folder: OFFICIAL_LINES_FOLDERS) {
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	791 File dir = FileTools.repair(new File(riverDir, folder));
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	792
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	793 if (!dir.isDirectory() \|\| !dir.canRead()) {
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	794 log.info("no directory '" + folder + "' found");
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	795 continue;
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	796 }
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	797
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	798 File file = FileTools.repair(new File(dir, OFFICIAL_LINES));
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	799 if (!file.isFile() \|\| !file.canRead()) {
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	800 log.warn("no official lines wst file found");
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	801 continue;
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	802 }
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	803 log.debug("Found WST file: " + file);
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	804
6339 aef238fdd9b6 Backend: Added special ImportWstColumns for official lines. They have to be glued with the main values. Sascha L. Teichmann <teichmann@intevation.de> parents: 6337 diff changeset	805 ImportWst iw = new ImportWst(ImportOfficialWstColumn.COLUMN_FACTORY);
6337 224d7c4b5291 Backend: Create ImportWsts for official lines expicitly. They are going to be somewhat special. Removed some cruft from the WstParser. Sascha L. Teichmann <teichmann@intevation.de> parents: 6335 diff changeset	806
224d7c4b5291 Backend: Create ImportWsts for official lines expicitly. They are going to be somewhat special. Removed some cruft from the WstParser. Sascha L. Teichmann <teichmann@intevation.de> parents: 6335 diff changeset	807 WstParser wstParser = new WstParser(iw);
484 a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	808 wstParser.parse(file);
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	809 iw.setKind(3);
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	810 iw.setDescription(folder + "/" + iw.getDescription());
6335 b2a470c148a7 Backend: First steps to integrate parsing of official config files. Sascha L. Teichmann <teichmann@intevation.de> parents: 6283 diff changeset	811
b2a470c148a7 Backend: First steps to integrate parsing of official config files. Sascha L. Teichmann <teichmann@intevation.de> parents: 6283 diff changeset	812 File configFile = FileTools.repair(new File(dir, OFFICIAL_LINES_CONFIG));
b2a470c148a7 Backend: First steps to integrate parsing of official config files. Sascha L. Teichmann <teichmann@intevation.de> parents: 6283 diff changeset	813 if (!configFile.isFile() \|\| !configFile.canRead()) {
b2a470c148a7 Backend: First steps to integrate parsing of official config files. Sascha L. Teichmann <teichmann@intevation.de> parents: 6283 diff changeset	814 log.warn("no config file for official lines found");
b2a470c148a7 Backend: First steps to integrate parsing of official config files. Sascha L. Teichmann <teichmann@intevation.de> parents: 6283 diff changeset	815 }
b2a470c148a7 Backend: First steps to integrate parsing of official config files. Sascha L. Teichmann <teichmann@intevation.de> parents: 6283 diff changeset	816 else {
b2a470c148a7 Backend: First steps to integrate parsing of official config files. Sascha L. Teichmann <teichmann@intevation.de> parents: 6283 diff changeset	817 OfficialLinesConfigParser olcp = new OfficialLinesConfigParser();
b2a470c148a7 Backend: First steps to integrate parsing of official config files. Sascha L. Teichmann <teichmann@intevation.de> parents: 6283 diff changeset	818 try {
b2a470c148a7 Backend: First steps to integrate parsing of official config files. Sascha L. Teichmann <teichmann@intevation.de> parents: 6283 diff changeset	819 olcp.parse(configFile);
b2a470c148a7 Backend: First steps to integrate parsing of official config files. Sascha L. Teichmann <teichmann@intevation.de> parents: 6283 diff changeset	820 }
b2a470c148a7 Backend: First steps to integrate parsing of official config files. Sascha L. Teichmann <teichmann@intevation.de> parents: 6283 diff changeset	821 catch (IOException ioe) {
b2a470c148a7 Backend: First steps to integrate parsing of official config files. Sascha L. Teichmann <teichmann@intevation.de> parents: 6283 diff changeset	822 log.warn("Error reading offical lines config", ioe);
b2a470c148a7 Backend: First steps to integrate parsing of official config files. Sascha L. Teichmann <teichmann@intevation.de> parents: 6283 diff changeset	823 }
b2a470c148a7 Backend: First steps to integrate parsing of official config files. Sascha L. Teichmann <teichmann@intevation.de> parents: 6283 diff changeset	824 List<String> mainValueNames = olcp.getMainValueNames();
b2a470c148a7 Backend: First steps to integrate parsing of official config files. Sascha L. Teichmann <teichmann@intevation.de> parents: 6283 diff changeset	825 if (mainValueNames.isEmpty()) {
b2a470c148a7 Backend: First steps to integrate parsing of official config files. Sascha L. Teichmann <teichmann@intevation.de> parents: 6283 diff changeset	826 log.warn("config file for offical lines contains no entries");
b2a470c148a7 Backend: First steps to integrate parsing of official config files. Sascha L. Teichmann <teichmann@intevation.de> parents: 6283 diff changeset	827 }
b2a470c148a7 Backend: First steps to integrate parsing of official config files. Sascha L. Teichmann <teichmann@intevation.de> parents: 6283 diff changeset	828 else {
6345 0f7e9a4f1c5a Backend: Joined official lines with there importer model. Sascha L. Teichmann <teichmann@intevation.de> parents: 6339 diff changeset	829 // Join as much as possible.
0f7e9a4f1c5a Backend: Joined official lines with there importer model. Sascha L. Teichmann <teichmann@intevation.de> parents: 6339 diff changeset	830 Iterator<ImportWstColumn> wi = iw.getColumns().iterator();
0f7e9a4f1c5a Backend: Joined official lines with there importer model. Sascha L. Teichmann <teichmann@intevation.de> parents: 6339 diff changeset	831 Iterator<String> si = olcp.getMainValueNames().iterator();
0f7e9a4f1c5a Backend: Joined official lines with there importer model. Sascha L. Teichmann <teichmann@intevation.de> parents: 6339 diff changeset	832 while (wi.hasNext() && si.hasNext()) {
0f7e9a4f1c5a Backend: Joined official lines with there importer model. Sascha L. Teichmann <teichmann@intevation.de> parents: 6339 diff changeset	833 ImportOfficialWstColumn wc = (ImportOfficialWstColumn)wi.next();
0f7e9a4f1c5a Backend: Joined official lines with there importer model. Sascha L. Teichmann <teichmann@intevation.de> parents: 6339 diff changeset	834 String name = si.next();
0f7e9a4f1c5a Backend: Joined official lines with there importer model. Sascha L. Teichmann <teichmann@intevation.de> parents: 6339 diff changeset	835 ImportOfficialLine iol = new ImportOfficialLine(name, wc);
0f7e9a4f1c5a Backend: Joined official lines with there importer model. Sascha L. Teichmann <teichmann@intevation.de> parents: 6339 diff changeset	836 wc.setOfficialLine(iol);
0f7e9a4f1c5a Backend: Joined official lines with there importer model. Sascha L. Teichmann <teichmann@intevation.de> parents: 6339 diff changeset	837 }
6335 b2a470c148a7 Backend: First steps to integrate parsing of official config files. Sascha L. Teichmann <teichmann@intevation.de> parents: 6283 diff changeset	838 }
b2a470c148a7 Backend: First steps to integrate parsing of official config files. Sascha L. Teichmann <teichmann@intevation.de> parents: 6283 diff changeset	839 }
b2a470c148a7 Backend: First steps to integrate parsing of official config files. Sascha L. Teichmann <teichmann@intevation.de> parents: 6283 diff changeset	840
484 a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	841 officialLines.add(iw);
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	842 } // for all folders
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	843
483 f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	844 }
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	845
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	846 public void parseFixations() throws IOException {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	847 if (Config.INSTANCE.skipFixations()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	848 log.info("skip parsing fixations");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	849 return;
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	850 }
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	851
483 f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	852 log.info("Parse fixation wst files");
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	853
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	854 File riverDir = wstFile.getParentFile().getParentFile();
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	855
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	856 File fixDir = FileTools.repair(
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	857 new File(riverDir, FIXATIONS));
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	858
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	859 if (!fixDir.isDirectory() \|\| !fixDir.canRead()) {
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	860 log.info("no fixation wst file directory found");
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	861 return;
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	862 }
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	863
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	864 File [] files = fixDir.listFiles();
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	865
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	866 if (files == null) {
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	867 log.warn("cannot read fixations wst file directory");
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	868 return;
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	869 }
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	870
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	871 for (File file: files) {
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	872 if (!file.isFile() \|\| !file.canRead()) {
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	873 continue;
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	874 }
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	875 String name = file.getName().toLowerCase();
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	876 if (!name.endsWith(".wst")) {
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	877 continue;
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	878 }
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	879 log.debug("Found WST file: " + file);
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	880
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	881 WstParser wstParser = new WstParser();
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	882 wstParser.parse(file);
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	883 ImportWst iw = wstParser.getWst();
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	884 iw.setKind(2);
490 13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	885 iw.setDescription(FIXATIONS+ "/" + iw.getDescription());
483 f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	886 fixations.add(iw);
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	887 }
482 3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	888 }
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	889
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	890 public void parseExtraWsts() throws IOException {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	891 if (Config.INSTANCE.skipExtraWsts()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	892 log.info("skip parsing extra WST files");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	893 return;
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	894 }
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	895
482 3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	896 log.info("Parse extra longitudinal wst files");
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	897
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	898 File riverDir = wstFile.getParentFile().getParentFile();
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	899
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	900 File extraDir = FileTools.repair(
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	901 new File(riverDir, EXTRA_LONGITUDINALS));
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	902
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	903 if (!extraDir.isDirectory() \|\| !extraDir.canRead()) {
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	904 log.info("no extra longitudinal wst file directory found");
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	905 return;
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	906 }
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	907
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	908 File [] files = extraDir.listFiles();
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	909
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	910 if (files == null) {
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	911 log.warn("cannot read extra longitudinal wst file directory");
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	912 return;
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	913 }
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	914
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	915 for (File file: files) {
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	916 if (!file.isFile() \|\| !file.canRead()) {
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	917 continue;
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	918 }
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	919 String name = file.getName().toLowerCase();
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	920 if (!(name.endsWith(".zus") \|\| name.endsWith(".wst"))) {
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	921 continue;
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	922 }
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	923 log.debug("Found WST file: " + file);
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	924
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	925 WstParser wstParser = new WstParser();
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	926 wstParser.parse(file);
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	927 ImportWst iw = wstParser.getWst();
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	928 iw.setKind(1);
491 738140fe56fe Importer: Prefix "Zusätzliche Längsschnitte" with "Zus.Längsschnitte" in description. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 490 diff changeset	929 iw.setDescription(EXTRA_LONGITUDINALS + "/" + iw.getDescription());
482 3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	930 extraWsts.add(iw);
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	931 }
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	932
197 c0dcc2357106 Added stub for WST parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 194 diff changeset	933 }
c0dcc2357106 Added stub for WST parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 194 diff changeset	934
c0dcc2357106 Added stub for WST parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 194 diff changeset	935 public void parseWst() throws IOException {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	936 if (Config.INSTANCE.skipWst()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	937 log.info("skip parsing WST file");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	938 return;
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	939 }
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	940
197 c0dcc2357106 Added stub for WST parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 194 diff changeset	941 WstParser wstParser = new WstParser();
c0dcc2357106 Added stub for WST parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 194 diff changeset	942 wstParser.parse(wstFile);
201 3169b559ca3c Build models for wsts, wst columns and q ranges and store them in the backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 197 diff changeset	943 wst = wstParser.getWst();
186 cf8cbcb6a10d Added parser to read .KM files. Sascha L. Teichmann <sascha.teichmann@intevation.de>* parents: 184 diff changeset	944 }
cf8cbcb6a10d Added parser to read .KM files. Sascha L. Teichmann <sascha.teichmann@intevation.de>* parents: 184 diff changeset	945
184 4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	946 public void parseGauges() throws IOException {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	947 if (Config.INSTANCE.skipGauges()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	948 log.info("skip parsing gauges");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	949 return;
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	950 }
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	951
184 4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	952 File gltFile = new File(wstFile.getParentFile(), PEGEL_GLT);
4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	953 gltFile = FileTools.repair(gltFile);
4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	954
4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	955 if (!gltFile.isFile() \|\| !gltFile.canRead()) {
4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	956 log.warn("cannot read gauges from '" + gltFile + "'");
4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	957 return;
4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	958 }
4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	959
4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	960 PegelGltParser pgltp = new PegelGltParser();
4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	961 pgltp.parse(gltFile);
4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	962
4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	963 gauges = pgltp.getGauges();
189 bc3747a371cc First part of parsing main values. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 188 diff changeset	964
bc3747a371cc First part of parsing main values. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 188 diff changeset	965 for (ImportGauge gauge: gauges) {
bc3747a371cc First part of parsing main values. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 188 diff changeset	966 gauge.parseDependencies();
bc3747a371cc First part of parsing main values. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 188 diff changeset	967 }
184 4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	968 }
186 cf8cbcb6a10d Added parser to read .KM files. Sascha L. Teichmann <sascha.teichmann@intevation.de>* parents: 184 diff changeset	969
cf8cbcb6a10d Added parser to read .KM files. Sascha L. Teichmann <sascha.teichmann@intevation.de>* parents: 184 diff changeset	970 public void parseAnnotations() throws IOException {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	971 if (Config.INSTANCE.skipAnnotations()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	972 log.info("skip parsing annotations");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	973 return;
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	974 }
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	975
186 cf8cbcb6a10d Added parser to read .KM files. Sascha L. Teichmann <sascha.teichmann@intevation.de>* parents: 184 diff changeset	976 File riverDir = wstFile.getParentFile().getParentFile();
765 763c4137d6e1 Added classification of annotation types. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 503 diff changeset	977 AnnotationsParser aparser =
763c4137d6e1 Added classification of annotation types. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 503 diff changeset	978 new AnnotationsParser(annotationClassifier);
186 cf8cbcb6a10d Added parser to read .KM files. Sascha L. Teichmann <sascha.teichmann@intevation.de>* parents: 184 diff changeset	979 aparser.parse(riverDir);
cf8cbcb6a10d Added parser to read .KM files. Sascha L. Teichmann <sascha.teichmann@intevation.de>* parents: 184 diff changeset	980
cf8cbcb6a10d Added parser to read .KM files. Sascha L. Teichmann <sascha.teichmann@intevation.de>* parents: 184 diff changeset	981 annotations = aparser.getAnnotations();
cf8cbcb6a10d Added parser to read .KM files. Sascha L. Teichmann <sascha.teichmann@intevation.de>* parents: 184 diff changeset	982 }
188 003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	983
1220 3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	984 public void parseHYKs() {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	985 if (Config.INSTANCE.skipHYKs()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	986 log.info("skip parsing HYK files");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	987 return;
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	988 }
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	989
1220 3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	990 log.info("looking for HYK files");
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	991 HYKParser parser = new HYKParser();
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	992 File riverDir = wstFile
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	993 .getParentFile() // Basisdaten
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	994 .getParentFile() // Hydrologie
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	995 .getParentFile(); // <river>
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	996
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	997 parser.parseHYKs(riverDir, new HYKParser.Callback() {
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	998
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	999 Set<HashedFile> hfs = new HashSet<HashedFile>();
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	1000
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	1001 @Override
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	1002 public boolean hykAccept(File file) {
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	1003 HashedFile hf = new HashedFile(file);
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	1004 boolean success = hfs.add(hf);
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	1005 if (!success) {
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	1006 log.warn("HYK file '" + file + "' seems to be a duplicate.");
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	1007 }
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	1008 return success;
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	1009 }
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	1010
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	1011 @Override
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	1012 public void hykParsed(HYKParser parser) {
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	1013 log.debug("callback from HYK parser");
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	1014 ImportHYK hyk = parser.getHYK();
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	1015 hyk.setRiver(ImportRiver.this);
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	1016 hyks.add(hyk);
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	1017 }
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	1018 });
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	1019 }
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	1020
4712 70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	1021
4724 c30152f77f77 ImportRiver: Refactoring, use description and year of da66parser. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4716 diff changeset	1022 /** Add cross sections with description, years and lines to
c30152f77f77 ImportRiver: Refactoring, use description and year of da66parser. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4716 diff changeset	1023 * store. */
c30152f77f77 ImportRiver: Refactoring, use description and year of da66parser. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4716 diff changeset	1024 private void addCrossSections(CrossSectionParser parser) {
c30152f77f77 ImportRiver: Refactoring, use description and year of da66parser. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4716 diff changeset	1025 String description = parser.getDescription();
c30152f77f77 ImportRiver: Refactoring, use description and year of da66parser. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4716 diff changeset	1026 Integer year = parser.getYear();
c30152f77f77 ImportRiver: Refactoring, use description and year of da66parser. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4716 diff changeset	1027 ImportTimeInterval ti = year != null
c30152f77f77 ImportRiver: Refactoring, use description and year of da66parser. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4716 diff changeset	1028 ? new ImportTimeInterval(yearToDate(year))
c30152f77f77 ImportRiver: Refactoring, use description and year of da66parser. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4716 diff changeset	1029 : null;
c30152f77f77 ImportRiver: Refactoring, use description and year of da66parser. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4716 diff changeset	1030
4735 94b39073f0f7 Moved EpsilonComparator to utils package becaus its not only useful for TIM parsing. Used EpsilonComparator in DA60 and DA66 case. Maybe TODO: Use in PRF, too. Sascha L. Teichmann <teichmann@intevation.de> parents: 4725 diff changeset	1031 Map<Double, List<XY>> data = parser.getData();
94b39073f0f7 Moved EpsilonComparator to utils package becaus its not only useful for TIM parsing. Used EpsilonComparator in DA60 and DA66 case. Maybe TODO: Use in PRF, too. Sascha L. Teichmann <teichmann@intevation.de> parents: 4725 diff changeset	1032
4724 c30152f77f77 ImportRiver: Refactoring, use description and year of da66parser. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4716 diff changeset	1033 List<ImportCrossSectionLine> lines =
4735 94b39073f0f7 Moved EpsilonComparator to utils package becaus its not only useful for TIM parsing. Used EpsilonComparator in DA60 and DA66 case. Maybe TODO: Use in PRF, too. Sascha L. Teichmann <teichmann@intevation.de> parents: 4725 diff changeset	1034 new ArrayList<ImportCrossSectionLine>(data.size());
4724 c30152f77f77 ImportRiver: Refactoring, use description and year of da66parser. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4716 diff changeset	1035
4735 94b39073f0f7 Moved EpsilonComparator to utils package becaus its not only useful for TIM parsing. Used EpsilonComparator in DA60 and DA66 case. Maybe TODO: Use in PRF, too. Sascha L. Teichmann <teichmann@intevation.de> parents: 4725 diff changeset	1036 for (Map.Entry<Double, List<XY>> entry: data.entrySet()) {
4724 c30152f77f77 ImportRiver: Refactoring, use description and year of da66parser. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4716 diff changeset	1037 Double km = entry.getKey();
c30152f77f77 ImportRiver: Refactoring, use description and year of da66parser. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4716 diff changeset	1038 List<XY> points = entry.getValue();
c30152f77f77 ImportRiver: Refactoring, use description and year of da66parser. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4716 diff changeset	1039 lines.add(new ImportCrossSectionLine(km, points));
c30152f77f77 ImportRiver: Refactoring, use description and year of da66parser. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4716 diff changeset	1040 }
c30152f77f77 ImportRiver: Refactoring, use description and year of da66parser. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4716 diff changeset	1041
c30152f77f77 ImportRiver: Refactoring, use description and year of da66parser. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4716 diff changeset	1042 crossSections.add(new ImportCrossSection(
c30152f77f77 ImportRiver: Refactoring, use description and year of da66parser. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4716 diff changeset	1043 ImportRiver.this, description, ti, lines));
c30152f77f77 ImportRiver: Refactoring, use description and year of da66parser. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4716 diff changeset	1044 }
c30152f77f77 ImportRiver: Refactoring, use description and year of da66parser. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4716 diff changeset	1045
4767 03246a8b3869 ImportRiver: Added w80 and hook for da50 parsing (not implemented). Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4735 diff changeset	1046 /** Create a W80 Parser and parse w80 files found. */
03246a8b3869 ImportRiver: Added w80 and hook for da50 parsing (not implemented). Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4735 diff changeset	1047 public void parseW80s() {
03246a8b3869 ImportRiver: Added w80 and hook for da50 parsing (not implemented). Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4735 diff changeset	1048 if (Config.INSTANCE.skipW80s()) {
03246a8b3869 ImportRiver: Added w80 and hook for da50 parsing (not implemented). Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4735 diff changeset	1049 log.info("skip parsing W80s");
4781 e77b461fa360 ImportRiver: Bail out if skip* parameters were given. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4779 diff changeset	1050 return;
4767 03246a8b3869 ImportRiver: Added w80 and hook for da50 parsing (not implemented). Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4735 diff changeset	1051 }
03246a8b3869 ImportRiver: Added w80 and hook for da50 parsing (not implemented). Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4735 diff changeset	1052 W80Parser parser = new W80Parser();
03246a8b3869 ImportRiver: Added w80 and hook for da50 parsing (not implemented). Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4735 diff changeset	1053 File riverDir = wstFile
03246a8b3869 ImportRiver: Added w80 and hook for da50 parsing (not implemented). Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4735 diff changeset	1054 .getParentFile() // Basisdaten
03246a8b3869 ImportRiver: Added w80 and hook for da50 parsing (not implemented). Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4735 diff changeset	1055 .getParentFile() // Hydrologie
03246a8b3869 ImportRiver: Added w80 and hook for da50 parsing (not implemented). Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4735 diff changeset	1056 .getParentFile(); // <river>
03246a8b3869 ImportRiver: Added w80 and hook for da50 parsing (not implemented). Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4735 diff changeset	1057
4779 18908a3cbb3a ImportRiver: Use callback (refactoring), resolving TODOs. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4778 diff changeset	1058 ImportRiverCrossSectionParserCallback w80Callback =
18908a3cbb3a ImportRiver: Use callback (refactoring), resolving TODOs. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4778 diff changeset	1059 new ImportRiverCrossSectionParserCallback("w80");
18908a3cbb3a ImportRiver: Use callback (refactoring), resolving TODOs. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4778 diff changeset	1060 parser.parseW80s(riverDir, w80Callback);
4767 03246a8b3869 ImportRiver: Added w80 and hook for da50 parsing (not implemented). Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4735 diff changeset	1061 }
03246a8b3869 ImportRiver: Added w80 and hook for da50 parsing (not implemented). Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4735 diff changeset	1062
5810 dba9e1fa233e ImportRiver: Trigger w80csv-parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5806 diff changeset	1063 /** Create a W80 Parser and parse w80 files found. */
dba9e1fa233e ImportRiver: Trigger w80csv-parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5806 diff changeset	1064 public void parseW80CSVs() {
dba9e1fa233e ImportRiver: Trigger w80csv-parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5806 diff changeset	1065 if (Config.INSTANCE.skipW80CSVs()) {
dba9e1fa233e ImportRiver: Trigger w80csv-parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5806 diff changeset	1066 log.info("skip parsing W80 csvs");
dba9e1fa233e ImportRiver: Trigger w80csv-parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5806 diff changeset	1067 return;
dba9e1fa233e ImportRiver: Trigger w80csv-parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5806 diff changeset	1068 }
dba9e1fa233e ImportRiver: Trigger w80csv-parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5806 diff changeset	1069 W80CSVParser parser = new W80CSVParser();
dba9e1fa233e ImportRiver: Trigger w80csv-parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5806 diff changeset	1070 File riverDir = wstFile
dba9e1fa233e ImportRiver: Trigger w80csv-parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5806 diff changeset	1071 .getParentFile() // Basisdaten
dba9e1fa233e ImportRiver: Trigger w80csv-parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5806 diff changeset	1072 .getParentFile() // Hydrologie
dba9e1fa233e ImportRiver: Trigger w80csv-parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5806 diff changeset	1073 .getParentFile(); // <river>
dba9e1fa233e ImportRiver: Trigger w80csv-parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5806 diff changeset	1074
dba9e1fa233e ImportRiver: Trigger w80csv-parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5806 diff changeset	1075 // Construct the Cross-Section-Data path.
dba9e1fa233e ImportRiver: Trigger w80csv-parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5806 diff changeset	1076 File csDir = new File(riverDir.getPath()
dba9e1fa233e ImportRiver: Trigger w80csv-parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5806 diff changeset	1077 + File.separator + "Geodaesie"
dba9e1fa233e ImportRiver: Trigger w80csv-parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5806 diff changeset	1078 + File.separator + "Querprofile"
dba9e1fa233e ImportRiver: Trigger w80csv-parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5806 diff changeset	1079 + File.separator + "QP-Daten");
dba9e1fa233e ImportRiver: Trigger w80csv-parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5806 diff changeset	1080
dba9e1fa233e ImportRiver: Trigger w80csv-parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5806 diff changeset	1081 ImportRiverCrossSectionParserCallback w80CSVCallback =
dba9e1fa233e ImportRiver: Trigger w80csv-parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5806 diff changeset	1082 new ImportRiverCrossSectionParserCallback("w80-csv");
dba9e1fa233e ImportRiver: Trigger w80csv-parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5806 diff changeset	1083 parser.parseW80CSVs(csDir, w80CSVCallback);
dba9e1fa233e ImportRiver: Trigger w80csv-parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5806 diff changeset	1084 }
dba9e1fa233e ImportRiver: Trigger w80csv-parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5806 diff changeset	1085
4782 696285cef182 ImportRiver: Trigger basic (useless) da50 parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4781 diff changeset	1086
696285cef182 ImportRiver: Trigger basic (useless) da50 parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4781 diff changeset	1087 /**
696285cef182 ImportRiver: Trigger basic (useless) da50 parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4781 diff changeset	1088 * Create and use a DA50Parser, parse the files found, add the
696285cef182 ImportRiver: Trigger basic (useless) da50 parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4781 diff changeset	1089 * ross-sections found.
696285cef182 ImportRiver: Trigger basic (useless) da50 parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4781 diff changeset	1090 */
4767 03246a8b3869 ImportRiver: Added w80 and hook for da50 parsing (not implemented). Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4735 diff changeset	1091 public void parseDA50s() {
03246a8b3869 ImportRiver: Added w80 and hook for da50 parsing (not implemented). Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4735 diff changeset	1092 if (Config.INSTANCE.skipDA50s()) {
03246a8b3869 ImportRiver: Added w80 and hook for da50 parsing (not implemented). Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4735 diff changeset	1093 log.info("skip parsing DA50s");
4781 e77b461fa360 ImportRiver: Bail out if skip* parameters were given. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4779 diff changeset	1094 return;
4767 03246a8b3869 ImportRiver: Added w80 and hook for da50 parsing (not implemented). Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4735 diff changeset	1095 }
4782 696285cef182 ImportRiver: Trigger basic (useless) da50 parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4781 diff changeset	1096 DA50Parser parser = new DA50Parser();
696285cef182 ImportRiver: Trigger basic (useless) da50 parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4781 diff changeset	1097 File riverDir = wstFile
696285cef182 ImportRiver: Trigger basic (useless) da50 parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4781 diff changeset	1098 .getParentFile() // Basisdaten
696285cef182 ImportRiver: Trigger basic (useless) da50 parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4781 diff changeset	1099 .getParentFile() // Hydrologie
696285cef182 ImportRiver: Trigger basic (useless) da50 parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4781 diff changeset	1100 .getParentFile(); // <river>
696285cef182 ImportRiver: Trigger basic (useless) da50 parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4781 diff changeset	1101
696285cef182 ImportRiver: Trigger basic (useless) da50 parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4781 diff changeset	1102 ImportRiverCrossSectionParserCallback da50Callback =
696285cef182 ImportRiver: Trigger basic (useless) da50 parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4781 diff changeset	1103 new ImportRiverCrossSectionParserCallback("da50");
696285cef182 ImportRiver: Trigger basic (useless) da50 parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4781 diff changeset	1104 parser.parseDA50s(riverDir, da50Callback);
4767 03246a8b3869 ImportRiver: Added w80 and hook for da50 parsing (not implemented). Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4735 diff changeset	1105 }
03246a8b3869 ImportRiver: Added w80 and hook for da50 parsing (not implemented). Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4735 diff changeset	1106
4724 c30152f77f77 ImportRiver: Refactoring, use description and year of da66parser. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4716 diff changeset	1107
4712 70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	1108 /** Create a DA66 Parser and parse the da66 files found. */
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	1109 // TODO this is a copy of parsePRFs, extract interfaces (e.g. CrossSectionParser).
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	1110 public void parseDA66s() {
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	1111 if (Config.INSTANCE.skipDA66s()) {
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	1112 log.info("skip parsing DA66s");
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	1113 return;
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	1114 }
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	1115
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	1116 log.info("looking for DA66 files");
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	1117 DA66Parser parser = new DA66Parser();
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	1118 File riverDir = wstFile
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	1119 .getParentFile() // Basisdaten
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	1120 .getParentFile() // Hydrologie
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	1121 .getParentFile(); // <river>
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	1122
4779 18908a3cbb3a ImportRiver: Use callback (refactoring), resolving TODOs. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4778 diff changeset	1123 ImportRiverCrossSectionParserCallback da66Callback =
18908a3cbb3a ImportRiver: Use callback (refactoring), resolving TODOs. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4778 diff changeset	1124 new ImportRiverCrossSectionParserCallback("da66");
18908a3cbb3a ImportRiver: Use callback (refactoring), resolving TODOs. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4778 diff changeset	1125 parser.parseDA66s(riverDir, da66Callback);
4712 70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	1126 }
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	1127
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	1128 /** Create a PRFParser and let it parse the prf files found. */
1204 22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1129 public void parsePRFs() {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1130 if (Config.INSTANCE.skipPRFs()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1131 log.info("skip parsing PRFs");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1132 return;
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1133 }
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1134
1204 22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1135 log.info("looking for PRF files");
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1136 PRFParser parser = new PRFParser();
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1137 File riverDir = wstFile
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1138 .getParentFile() // Basisdaten
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1139 .getParentFile() // Hydrologie
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1140 .getParentFile(); // <river>
1206 c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	1141
4779 18908a3cbb3a ImportRiver: Use callback (refactoring), resolving TODOs. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4778 diff changeset	1142 ImportRiverCrossSectionParserCallback prfCallback =
18908a3cbb3a ImportRiver: Use callback (refactoring), resolving TODOs. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4778 diff changeset	1143 new ImportRiverCrossSectionParserCallback("prf");
18908a3cbb3a ImportRiver: Use callback (refactoring), resolving TODOs. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4778 diff changeset	1144 parser.parsePRFs(riverDir, prfCallback);
1204 22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1145 }
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1146
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1147 public static Date yearToDate(int year) {
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1148 Calendar cal = Calendar.getInstance();
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1149 cal.set(year, 5, 15, 12, 0, 0);
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1150 long ms = cal.getTimeInMillis();
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1151 cal.setTimeInMillis(ms - ms%1000);
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1152 return cal.getTime();
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1153 }
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1154
190 d40da430d2fe Added stub code to write gauges Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 189 diff changeset	1155 public void storeDependencies() {
2347 0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	1156 storeWstUnit();
190 d40da430d2fe Added stub code to write gauges Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 189 diff changeset	1157 storeAnnotations();
1221 979ff070e368 Store HYK data structures to database. Needs testing. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1220 diff changeset	1158 storeHYKs();
1204 22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1159 storeCrossSections();
190 d40da430d2fe Added stub code to write gauges Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 189 diff changeset	1160 storeGauges();
201 3169b559ca3c Build models for wsts, wst columns and q ranges and store them in the backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 197 diff changeset	1161 storeWst();
482 3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	1162 storeExtraWsts();
483 f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	1163 storeFixations();
484 a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	1164 storeOfficialLines();
490 13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	1165 storeFloodWater();
494 88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	1166 storeFloodProtection();
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	1167 storeBedHeight();
2815 3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	1168 storeSedimentDensity();
2821 0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	1169 storeMorphologicalWidth();
2826 c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	1170 storeFlowVelocity();
2839 163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1171 storeSedimentYield();
5261 1e403a0efc21 ImportRiver: Light cleaning up, waterlevelimport more parralel to other imports. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5248 diff changeset	1172 storeWaterlevels();
2851 acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	1173 storeWaterlevelDifferences();
4193 f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1174 storeMeasurementStations();
3328 a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	1175 storeSQRelations();
5080 b87e504f916e Importer/River: Move storeOfficialNumber from parse* to store, do not store explicitely. Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5051 diff changeset	1176 storeOfficialNumber();
201 3169b559ca3c Build models for wsts, wst columns and q ranges and store them in the backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 197 diff changeset	1177 }
3169b559ca3c Build models for wsts, wst columns and q ranges and store them in the backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 197 diff changeset	1178
2347 0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	1179 public void storeWstUnit() {
0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	1180 if (wst == null) {
0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	1181 wstUnit = new ImportUnit("NN + m");
0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	1182 }
0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	1183 else {
0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	1184 wstUnit = wst.getUnit();
0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	1185 }
0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	1186 }
0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	1187
1221 979ff070e368 Store HYK data structures to database. Needs testing. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1220 diff changeset	1188 public void storeHYKs() {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1189 if (!Config.INSTANCE.skipHYKs()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1190 log.info("store HYKs");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1191 getPeer();
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1192 for (ImportHYK hyk: hyks) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1193 hyk.storeDependencies();
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1194 }
1221 979ff070e368 Store HYK data structures to database. Needs testing. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1220 diff changeset	1195 }
979ff070e368 Store HYK data structures to database. Needs testing. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1220 diff changeset	1196 }
979ff070e368 Store HYK data structures to database. Needs testing. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1220 diff changeset	1197
1204 22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1198 public void storeCrossSections() {
5810 dba9e1fa233e ImportRiver: Trigger w80csv-parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5806 diff changeset	1199 if (!Config.INSTANCE.skipPRFs()
dba9e1fa233e ImportRiver: Trigger w80csv-parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5806 diff changeset	1200 \|\| !Config.INSTANCE.skipDA66s()
dba9e1fa233e ImportRiver: Trigger w80csv-parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5806 diff changeset	1201 \|\| !Config.INSTANCE.skipDA50s()
dba9e1fa233e ImportRiver: Trigger w80csv-parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5806 diff changeset	1202 \|\| !Config.INSTANCE.skipW80s()
dba9e1fa233e ImportRiver: Trigger w80csv-parsing. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5806 diff changeset	1203 \|\| !Config.INSTANCE.skipW80CSVs()) {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1204 log.info("store cross sections");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1205 getPeer();
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1206 for (ImportCrossSection crossSection: crossSections) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1207 crossSection.storeDependencies();
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1208 }
1204 22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1209 }
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1210 }
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1211
201 3169b559ca3c Build models for wsts, wst columns and q ranges and store them in the backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 197 diff changeset	1212 public void storeWst() {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1213 if (!Config.INSTANCE.skipWst()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1214 River river = getPeer();
483 f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	1215 wst.storeDependencies(river);
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	1216 }
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	1217 }
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	1218
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1219 public void storeFixations() {
5262 0d9ad1c432b8 ImportRiver: Cosmetics, resolved todo. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5261 diff changeset	1220 if (!Config.INSTANCE.skipFixations()) {
0d9ad1c432b8 ImportRiver: Cosmetics, resolved todo. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5261 diff changeset	1221 log.info("store fixation wsts");
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1222 River river = getPeer();
5261 1e403a0efc21 ImportRiver: Light cleaning up, waterlevelimport more parralel to other imports. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5248 diff changeset	1223 for (ImportWst fWst: fixations) {
1e403a0efc21 ImportRiver: Light cleaning up, waterlevelimport more parralel to other imports. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5248 diff changeset	1224 log.debug("Fixation name: " + fWst.getDescription());
1e403a0efc21 ImportRiver: Light cleaning up, waterlevelimport more parralel to other imports. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5248 diff changeset	1225 fWst.storeDependencies(river);
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1226 }
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1227 }
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1228 }
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1229
5232 11b2a0c55318 ImportRiver: Import WaterlevelDifferences as Wst. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5227 diff changeset	1230
5261 1e403a0efc21 ImportRiver: Light cleaning up, waterlevelimport more parralel to other imports. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5248 diff changeset	1231 /** Store wsts from waterlevel-csv files. */
1e403a0efc21 ImportRiver: Light cleaning up, waterlevelimport more parralel to other imports. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5248 diff changeset	1232 public void storeWaterlevels() {
1e403a0efc21 ImportRiver: Light cleaning up, waterlevelimport more parralel to other imports. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5248 diff changeset	1233 if (!Config.INSTANCE.skipWaterlevels())
5262 0d9ad1c432b8 ImportRiver: Cosmetics, resolved todo. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5261 diff changeset	1234
5261 1e403a0efc21 ImportRiver: Light cleaning up, waterlevelimport more parralel to other imports. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5248 diff changeset	1235 log.info("store waterlevel wsts from csv");
1e403a0efc21 ImportRiver: Light cleaning up, waterlevelimport more parralel to other imports. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5248 diff changeset	1236 River river = getPeer();
1e403a0efc21 ImportRiver: Light cleaning up, waterlevelimport more parralel to other imports. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5248 diff changeset	1237 for (ImportWst wWst: waterlevels) {
1e403a0efc21 ImportRiver: Light cleaning up, waterlevelimport more parralel to other imports. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5248 diff changeset	1238 log.debug("Waterlevel name: " + wWst.getDescription());
1e403a0efc21 ImportRiver: Light cleaning up, waterlevelimport more parralel to other imports. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5248 diff changeset	1239 wWst.storeDependencies(river);
1e403a0efc21 ImportRiver: Light cleaning up, waterlevelimport more parralel to other imports. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5248 diff changeset	1240 }
1e403a0efc21 ImportRiver: Light cleaning up, waterlevelimport more parralel to other imports. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5248 diff changeset	1241 }
5262 0d9ad1c432b8 ImportRiver: Cosmetics, resolved todo. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5261 diff changeset	1242
5261 1e403a0efc21 ImportRiver: Light cleaning up, waterlevelimport more parralel to other imports. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5248 diff changeset	1243
5232 11b2a0c55318 ImportRiver: Import WaterlevelDifferences as Wst. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5227 diff changeset	1244 /** Store wsts from waterleveldifference-csv files. */
11b2a0c55318 ImportRiver: Import WaterlevelDifferences as Wst. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5227 diff changeset	1245 public void storeWaterlevelDifferences() {
11b2a0c55318 ImportRiver: Import WaterlevelDifferences as Wst. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5227 diff changeset	1246 if (!Config.INSTANCE.skipWaterlevelDifferences())
5280 dba703edfff1 Removed trailing whitespace. Sascha L. Teichmann <teichmann@intevation.de> parents: 5262 diff changeset	1247
5232 11b2a0c55318 ImportRiver: Import WaterlevelDifferences as Wst. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5227 diff changeset	1248 log.info("store waterleveldifferences wsts from csv");
11b2a0c55318 ImportRiver: Import WaterlevelDifferences as Wst. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5227 diff changeset	1249 River river = getPeer();
11b2a0c55318 ImportRiver: Import WaterlevelDifferences as Wst. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5227 diff changeset	1250 for (ImportWst dWst: waterlevelDifferences) {
11b2a0c55318 ImportRiver: Import WaterlevelDifferences as Wst. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5227 diff changeset	1251 log.debug("water.diff.: name " + dWst.getDescription());
11b2a0c55318 ImportRiver: Import WaterlevelDifferences as Wst. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5227 diff changeset	1252 dWst.storeDependencies(river);
11b2a0c55318 ImportRiver: Import WaterlevelDifferences as Wst. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5227 diff changeset	1253 }
11b2a0c55318 ImportRiver: Import WaterlevelDifferences as Wst. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5227 diff changeset	1254 }
5280 dba703edfff1 Removed trailing whitespace. Sascha L. Teichmann <teichmann@intevation.de> parents: 5262 diff changeset	1255
5232 11b2a0c55318 ImportRiver: Import WaterlevelDifferences as Wst. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5227 diff changeset	1256
482 3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	1257 public void storeExtraWsts() {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1258 if (!Config.INSTANCE.skipExtraWsts()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1259 log.info("store extra wsts");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1260 River river = getPeer();
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1261 for (ImportWst wst: extraWsts) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1262 log.debug("name: " + wst.getDescription());
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1263 wst.storeDependencies(river);
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1264 }
482 3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	1265 }
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	1266 }
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	1267
484 a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	1268 public void storeOfficialLines() {
6347 75c483450c96 Backend: Store official lines from config if they are any. Sascha L. Teichmann <teichmann@intevation.de> parents: 6345 diff changeset	1269 if (Config.INSTANCE.skipOfficialLines() \|\| officialLines.isEmpty()) {
75c483450c96 Backend: Store official lines from config if they are any. Sascha L. Teichmann <teichmann@intevation.de> parents: 6345 diff changeset	1270 return;
75c483450c96 Backend: Store official lines from config if they are any. Sascha L. Teichmann <teichmann@intevation.de> parents: 6345 diff changeset	1271 }
75c483450c96 Backend: Store official lines from config if they are any. Sascha L. Teichmann <teichmann@intevation.de> parents: 6345 diff changeset	1272
75c483450c96 Backend: Store official lines from config if they are any. Sascha L. Teichmann <teichmann@intevation.de> parents: 6345 diff changeset	1273 log.info("store official lines wsts");
75c483450c96 Backend: Store official lines from config if they are any. Sascha L. Teichmann <teichmann@intevation.de> parents: 6345 diff changeset	1274 River river = getPeer();
75c483450c96 Backend: Store official lines from config if they are any. Sascha L. Teichmann <teichmann@intevation.de> parents: 6345 diff changeset	1275 for (ImportWst wst: officialLines) {
75c483450c96 Backend: Store official lines from config if they are any. Sascha L. Teichmann <teichmann@intevation.de> parents: 6345 diff changeset	1276 log.debug("name: " + wst.getDescription());
75c483450c96 Backend: Store official lines from config if they are any. Sascha L. Teichmann <teichmann@intevation.de> parents: 6345 diff changeset	1277 wst.storeDependencies(river);
75c483450c96 Backend: Store official lines from config if they are any. Sascha L. Teichmann <teichmann@intevation.de> parents: 6345 diff changeset	1278
75c483450c96 Backend: Store official lines from config if they are any. Sascha L. Teichmann <teichmann@intevation.de> parents: 6345 diff changeset	1279 // Store the official lines after the columns are store.
75c483450c96 Backend: Store official lines from config if they are any. Sascha L. Teichmann <teichmann@intevation.de> parents: 6345 diff changeset	1280 for (ImportWstColumn wc: wst.getColumns()) {
75c483450c96 Backend: Store official lines from config if they are any. Sascha L. Teichmann <teichmann@intevation.de> parents: 6345 diff changeset	1281 ImportOfficialWstColumn owc = (ImportOfficialWstColumn)wc;
75c483450c96 Backend: Store official lines from config if they are any. Sascha L. Teichmann <teichmann@intevation.de> parents: 6345 diff changeset	1282 ImportOfficialLine ioc = owc.getOfficialLine();
75c483450c96 Backend: Store official lines from config if they are any. Sascha L. Teichmann <teichmann@intevation.de> parents: 6345 diff changeset	1283 if (ioc != null) {
75c483450c96 Backend: Store official lines from config if they are any. Sascha L. Teichmann <teichmann@intevation.de> parents: 6345 diff changeset	1284 if (ioc.getPeer(river) == null) {
75c483450c96 Backend: Store official lines from config if they are any. Sascha L. Teichmann <teichmann@intevation.de> parents: 6345 diff changeset	1285 log.warn("Cannot store official line: " + ioc.getName());
75c483450c96 Backend: Store official lines from config if they are any. Sascha L. Teichmann <teichmann@intevation.de> parents: 6345 diff changeset	1286 }
75c483450c96 Backend: Store official lines from config if they are any. Sascha L. Teichmann <teichmann@intevation.de> parents: 6345 diff changeset	1287 }
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1288 }
484 a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	1289 }
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	1290 }
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	1291
490 13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	1292 public void storeFloodWater() {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1293 if (!Config.INSTANCE.skipFloodWater()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1294 log.info("store flood water wsts");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1295 River river = getPeer();
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1296 for (ImportWst wst: floodWater) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1297 log.debug("name: " + wst.getDescription());
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1298 wst.storeDependencies(river);
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1299 }
490 13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	1300 }
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	1301 }
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	1302
5262 0d9ad1c432b8 ImportRiver: Cosmetics, resolved todo. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5261 diff changeset	1303
494 88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	1304 public void storeFloodProtection() {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1305 if (!Config.INSTANCE.skipFloodProtection()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1306 log.info("store flood protection wsts");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1307 River river = getPeer();
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1308 for (ImportWst wst: floodProtection) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1309 log.debug("name: " + wst.getDescription());
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1310 wst.storeDependencies(river);
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1311 }
494 88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	1312 }
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	1313 }
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	1314
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	1315
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	1316 public void storeBedHeight() {
2810 04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1317 if (!Config.INSTANCE.skipBedHeightSingle()) {
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1318 log.info("store bed heights single");
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1319 storeBedHeightSingle();
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1320 }
2809 f283212966e8 Finished work on MINFO bed heights (single). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2806 diff changeset	1321
2810 04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1322 if (!Config.INSTANCE.skipBedHeightEpoch()) {
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1323 log.info("store bed height epoch.");
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1324 storeBedHeightEpoch();
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1325 }
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1326 }
2809 f283212966e8 Finished work on MINFO bed heights (single). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2806 diff changeset	1327
2810 04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1328
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1329 private void storeBedHeightSingle() {
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1330 River river = getPeer();
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1331
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1332 if (bedHeightSingles != null) {
2811 8926571e47fb Finished importing MINFO bed heights (single and epoch). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2810 diff changeset	1333 for (ImportBedHeight tmp: bedHeightSingles) {
8926571e47fb Finished importing MINFO bed heights (single and epoch). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2810 diff changeset	1334 ImportBedHeightSingle single = (ImportBedHeightSingle) tmp;
8926571e47fb Finished importing MINFO bed heights (single and epoch). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2810 diff changeset	1335
2810 04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1336 String desc = single.getDescription();
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1337
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1338 log.debug("name: " + desc);
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1339
5416 4ee97d914501 Morpho-Importer: Do not mask database exceptions as broken files Tom Gottfried <tom.gottfried@intevation.de> parents: 5280 diff changeset	1340 single.storeDependencies(river);
4ee97d914501 Morpho-Importer: Do not mask database exceptions as broken files Tom Gottfried <tom.gottfried@intevation.de> parents: 5280 diff changeset	1341
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	1342 }
2810 04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1343 }
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1344 else {
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1345 log.info("No single bed heights to store.");
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1346 }
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1347 }
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	1348
2810 04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1349
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1350 private void storeBedHeightEpoch() {
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1351 River river = getPeer();
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1352
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1353 if (bedHeightEpochs != null) {
2811 8926571e47fb Finished importing MINFO bed heights (single and epoch). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2810 diff changeset	1354 for (ImportBedHeight tmp: bedHeightEpochs) {
8926571e47fb Finished importing MINFO bed heights (single and epoch). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2810 diff changeset	1355 ImportBedHeightEpoch epoch = (ImportBedHeightEpoch) tmp;
8926571e47fb Finished importing MINFO bed heights (single and epoch). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2810 diff changeset	1356
2810 04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1357 String desc = epoch.getDescription();
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1358
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1359 log.debug("name: " + desc);
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1360
5416 4ee97d914501 Morpho-Importer: Do not mask database exceptions as broken files Tom Gottfried <tom.gottfried@intevation.de> parents: 5280 diff changeset	1361 epoch.storeDependencies(river);
4ee97d914501 Morpho-Importer: Do not mask database exceptions as broken files Tom Gottfried <tom.gottfried@intevation.de> parents: 5280 diff changeset	1362
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	1363 }
2810 04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1364 }
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1365 else {
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1366 log.info("No epoch bed heights to store.");
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	1367 }
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	1368 }
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	1369
2815 3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	1370 public void storeSedimentDensity() {
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	1371 if (!Config.INSTANCE.skipSedimentDensity()) {
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	1372 log.info("store sediment density");
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	1373
2817 8979f2294af9 Finished parsing MINFO specific sediment density. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2815 diff changeset	1374 River river = getPeer();
8979f2294af9 Finished parsing MINFO specific sediment density. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2815 diff changeset	1375
8979f2294af9 Finished parsing MINFO specific sediment density. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2815 diff changeset	1376 for (ImportSedimentDensity density: sedimentDensities) {
8979f2294af9 Finished parsing MINFO specific sediment density. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2815 diff changeset	1377 String desc = density.getDescription();
8979f2294af9 Finished parsing MINFO specific sediment density. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2815 diff changeset	1378
8979f2294af9 Finished parsing MINFO specific sediment density. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2815 diff changeset	1379 log.debug("name: " + desc);
8979f2294af9 Finished parsing MINFO specific sediment density. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2815 diff changeset	1380
5416 4ee97d914501 Morpho-Importer: Do not mask database exceptions as broken files Tom Gottfried <tom.gottfried@intevation.de> parents: 5280 diff changeset	1381 density.storeDependencies(river);
4ee97d914501 Morpho-Importer: Do not mask database exceptions as broken files Tom Gottfried <tom.gottfried@intevation.de> parents: 5280 diff changeset	1382
2817 8979f2294af9 Finished parsing MINFO specific sediment density. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2815 diff changeset	1383 }
2815 3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	1384 }
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	1385 }
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	1386
2821 0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	1387 public void storeMorphologicalWidth() {
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	1388 if (!Config.INSTANCE.skipMorphologicalWidth()) {
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	1389 log.info("store morphological width");
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	1390
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	1391 River river = getPeer();
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	1392
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	1393 for (ImportMorphWidth width: morphologicalWidths) {
5416 4ee97d914501 Morpho-Importer: Do not mask database exceptions as broken files Tom Gottfried <tom.gottfried@intevation.de> parents: 5280 diff changeset	1394
4ee97d914501 Morpho-Importer: Do not mask database exceptions as broken files Tom Gottfried <tom.gottfried@intevation.de> parents: 5280 diff changeset	1395 width.storeDependencies(river);
4ee97d914501 Morpho-Importer: Do not mask database exceptions as broken files Tom Gottfried <tom.gottfried@intevation.de> parents: 5280 diff changeset	1396
2821 0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	1397 }
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	1398 }
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	1399 }
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	1400
2826 c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	1401 public void storeFlowVelocity() {
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	1402 if (!Config.INSTANCE.skipFlowVelocity()) {
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	1403 log.info("store flow velocity");
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	1404
2827 85b25e74594f Added temp classes used during the import process of flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2826 diff changeset	1405 River river = getPeer();
85b25e74594f Added temp classes used during the import process of flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2826 diff changeset	1406
85b25e74594f Added temp classes used during the import process of flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2826 diff changeset	1407 for (ImportFlowVelocityModel flowVelocityModel: flowVelocityModels){
5416 4ee97d914501 Morpho-Importer: Do not mask database exceptions as broken files Tom Gottfried <tom.gottfried@intevation.de> parents: 5280 diff changeset	1408
4ee97d914501 Morpho-Importer: Do not mask database exceptions as broken files Tom Gottfried <tom.gottfried@intevation.de> parents: 5280 diff changeset	1409 flowVelocityModel.storeDependencies(river);
4ee97d914501 Morpho-Importer: Do not mask database exceptions as broken files Tom Gottfried <tom.gottfried@intevation.de> parents: 5280 diff changeset	1410
2827 85b25e74594f Added temp classes used during the import process of flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2826 diff changeset	1411 }
2832 ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	1412
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	1413 for (ImportFlowVelocityMeasurement m: flowVelocityMeasurements) {
5416 4ee97d914501 Morpho-Importer: Do not mask database exceptions as broken files Tom Gottfried <tom.gottfried@intevation.de> parents: 5280 diff changeset	1414
4ee97d914501 Morpho-Importer: Do not mask database exceptions as broken files Tom Gottfried <tom.gottfried@intevation.de> parents: 5280 diff changeset	1415 m.storeDependencies(river);
4ee97d914501 Morpho-Importer: Do not mask database exceptions as broken files Tom Gottfried <tom.gottfried@intevation.de> parents: 5280 diff changeset	1416
2832 ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	1417 }
2826 c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	1418 }
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	1419 }
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	1420
2839 163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1421
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1422 public void storeSedimentYield() {
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1423 if (!Config.INSTANCE.skipSedimentYield()) {
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1424 log.info("store sediment yield data");
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1425
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1426 River river = getPeer();
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1427
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1428 for (ImportSedimentYield sedimentYield: sedimentYields) {
5416 4ee97d914501 Morpho-Importer: Do not mask database exceptions as broken files Tom Gottfried <tom.gottfried@intevation.de> parents: 5280 diff changeset	1429
4ee97d914501 Morpho-Importer: Do not mask database exceptions as broken files Tom Gottfried <tom.gottfried@intevation.de> parents: 5280 diff changeset	1430 sedimentYield.storeDependencies(river);
4ee97d914501 Morpho-Importer: Do not mask database exceptions as broken files Tom Gottfried <tom.gottfried@intevation.de> parents: 5280 diff changeset	1431
2839 163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1432 }
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1433 }
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1434 }
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1435
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	1436
4193 f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1437 public void storeMeasurementStations() {
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1438 if (!Config.INSTANCE.skipMeasurementStations()) {
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1439 log.info("store measurement stations");
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1440
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1441 River river = getPeer();
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1442
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1443 int count = 0;
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1444
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1445 for (ImportMeasurementStation station: measurementStations) {
5416 4ee97d914501 Morpho-Importer: Do not mask database exceptions as broken files Tom Gottfried <tom.gottfried@intevation.de> parents: 5280 diff changeset	1446
4ee97d914501 Morpho-Importer: Do not mask database exceptions as broken files Tom Gottfried <tom.gottfried@intevation.de> parents: 5280 diff changeset	1447 boolean success = station.storeDependencies(river);
4ee97d914501 Morpho-Importer: Do not mask database exceptions as broken files Tom Gottfried <tom.gottfried@intevation.de> parents: 5280 diff changeset	1448 if (success) {
4ee97d914501 Morpho-Importer: Do not mask database exceptions as broken files Tom Gottfried <tom.gottfried@intevation.de> parents: 5280 diff changeset	1449 count++;
4ee97d914501 Morpho-Importer: Do not mask database exceptions as broken files Tom Gottfried <tom.gottfried@intevation.de> parents: 5280 diff changeset	1450 }
4ee97d914501 Morpho-Importer: Do not mask database exceptions as broken files Tom Gottfried <tom.gottfried@intevation.de> parents: 5280 diff changeset	1451
4193 f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1452 }
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1453
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1454 log.info("stored " + count + " measurement stations.");
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1455 }
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1456 }
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1457
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1458
3328 a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	1459 public void storeSQRelations() {
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	1460 if (!Config.INSTANCE.skipSQRelation()) {
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	1461 log.info("store sq relations");
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	1462
3329 cc8fc6b29649 Store sq relations into database after parsing. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3328 diff changeset	1463 River river = getPeer();
cc8fc6b29649 Store sq relations into database after parsing. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3328 diff changeset	1464
cc8fc6b29649 Store sq relations into database after parsing. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3328 diff changeset	1465 int count = 0;
cc8fc6b29649 Store sq relations into database after parsing. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3328 diff changeset	1466
cc8fc6b29649 Store sq relations into database after parsing. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3328 diff changeset	1467 for (ImportSQRelation sqRelation: sqRelations) {
5416 4ee97d914501 Morpho-Importer: Do not mask database exceptions as broken files Tom Gottfried <tom.gottfried@intevation.de> parents: 5280 diff changeset	1468
4ee97d914501 Morpho-Importer: Do not mask database exceptions as broken files Tom Gottfried <tom.gottfried@intevation.de> parents: 5280 diff changeset	1469 sqRelation.storeDependencies(river);
4ee97d914501 Morpho-Importer: Do not mask database exceptions as broken files Tom Gottfried <tom.gottfried@intevation.de> parents: 5280 diff changeset	1470 count++;
4ee97d914501 Morpho-Importer: Do not mask database exceptions as broken files Tom Gottfried <tom.gottfried@intevation.de> parents: 5280 diff changeset	1471
3329 cc8fc6b29649 Store sq relations into database after parsing. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3328 diff changeset	1472 }
cc8fc6b29649 Store sq relations into database after parsing. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3328 diff changeset	1473
cc8fc6b29649 Store sq relations into database after parsing. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3328 diff changeset	1474 log.info("stored " + count + " sq relations.");
3328 a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	1475 }
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	1476 }
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	1477
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	1478
188 003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1479 public void storeAnnotations() {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1480 if (!Config.INSTANCE.skipAnnotations()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1481 River river = getPeer();
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1482 for (ImportAnnotation annotation: annotations) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1483 annotation.getPeer(river);
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1484 }
188 003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1485 }
003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1486 }
003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1487
190 d40da430d2fe Added stub code to write gauges Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 189 diff changeset	1488 public void storeGauges() {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1489 if (!Config.INSTANCE.skipGauges()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1490 log.info("store gauges:");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1491 River river = getPeer();
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1492 Session session = ImporterSession.getInstance()
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1493 .getDatabaseSession();
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1494 for (ImportGauge gauge: gauges) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1495 log.info("\tgauge: " + gauge.getName());
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1496 gauge.storeDependencies(river);
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1497 ImporterSession.getInstance().getDatabaseSession();
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1498 session.flush();
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1499 }
191 c4fb5141ce11 Propagate river into storing of gauges. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 190 diff changeset	1500 }
190 d40da430d2fe Added stub code to write gauges Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 189 diff changeset	1501 }
d40da430d2fe Added stub code to write gauges Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 189 diff changeset	1502
188 003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1503 public River getPeer() {
003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1504 if (peer == null) {
497 67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 494 diff changeset	1505 Session session = ImporterSession.getInstance().getDatabaseSession();
188 003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1506 Query query = session.createQuery("from River where name=:name");
2347 0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	1507
5027 25c180fa6162 Use BWASTRParser to set official numbers on rivers. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5020 diff changeset	1508 Unit u = null;
25c180fa6162 Use BWASTRParser to set official numbers on rivers. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5020 diff changeset	1509 if (wstUnit != null) {
25c180fa6162 Use BWASTRParser to set official numbers on rivers. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5020 diff changeset	1510 u = wstUnit.getPeer();
25c180fa6162 Use BWASTRParser to set official numbers on rivers. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5020 diff changeset	1511 }
2347 0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	1512
188 003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1513 query.setString("name", name);
003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1514 List<River> rivers = query.list();
003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1515 if (rivers.isEmpty()) {
2347 0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	1516 log.info("Store new river '" + name + "'");
0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	1517 peer = new River(name, u);
5027 25c180fa6162 Use BWASTRParser to set official numbers on rivers. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5020 diff changeset	1518 if (!Config.INSTANCE.skipBWASTR()) {
25c180fa6162 Use BWASTRParser to set official numbers on rivers. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5020 diff changeset	1519 peer.setOfficialNumber(officialNumber);
25c180fa6162 Use BWASTRParser to set official numbers on rivers. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5020 diff changeset	1520 }
188 003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1521 session.save(peer);
003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1522 }
003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1523 else {
003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1524 peer = rivers.get(0);
003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1525 }
003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1526 }
003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1527 return peer;
003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1528 }
177 31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	1529 }
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	1530 // vim:set ts=4 sw=4 si et sta sts=4 fenc=utf8 :

Mercurial > dive4elements > river

annotate backend/src/main/java/org/dive4elements/river/importer/ImportRiver.java @ 7162:4683bdf77ff9