dive4elements/river: flys-backend/src/main/java/de/intevation/flys/importer/ImportRiver.java annotate

annotate flys-backend/src/main/java/de/intevation/flys/importer/ImportRiver.java @ 4716:6016b9aa827a

Adjust callbacks after Parsers new interface implementation, re-enable file hashing for da66s.

author	Felix Wolfsteller <felix.wolfsteller@intevation.de>
date	Wed, 19 Dec 2012 14:59:55 +0100
parents	70842db72ee4
children	c30152f77f77

rev	line source
177 31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	1 package de.intevation.flys.importer;
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	2
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	3 import java.io.File;
184 4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	4 import java.io.IOException;
2809 f283212966e8 Finished work on MINFO bed heights (single). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2806 diff changeset	5 import java.sql.SQLException;
3320 8f905390c10d Removed superfluous imports. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2860 diff changeset	6 import java.util.ArrayList;
8f905390c10d Removed superfluous imports. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2860 diff changeset	7 import java.util.Calendar;
8f905390c10d Removed superfluous imports. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2860 diff changeset	8 import java.util.Date;
8f905390c10d Removed superfluous imports. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2860 diff changeset	9 import java.util.HashSet;
8f905390c10d Removed superfluous imports. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2860 diff changeset	10 import java.util.List;
8f905390c10d Removed superfluous imports. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2860 diff changeset	11 import java.util.Map;
8f905390c10d Removed superfluous imports. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2860 diff changeset	12 import java.util.Set;
8f905390c10d Removed superfluous imports. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2860 diff changeset	13
184 4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	14 import org.apache.log4j.Logger;
3320 8f905390c10d Removed superfluous imports. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2860 diff changeset	15 import org.hibernate.Query;
8f905390c10d Removed superfluous imports. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2860 diff changeset	16 import org.hibernate.Session;
4193 f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	17 import org.hibernate.exception.ConstraintViolationException;
177 31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	18
4193 f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	19 import de.intevation.artifacts.common.utils.FileTools;
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	20 import de.intevation.artifacts.common.utils.FileTools.HashedFile;
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	21 import de.intevation.flys.importer.parsers.AnnotationClassifier;
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	22 import de.intevation.flys.importer.parsers.AnnotationsParser;
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	23 import de.intevation.flys.importer.parsers.BedHeightEpochParser;
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	24 import de.intevation.flys.importer.parsers.BedHeightSingleParser;
4716 6016b9aa827a Adjust callbacks after Parsers new interface implementation, re-enable file hashing for da66s. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4712 diff changeset	25 import de.intevation.flys.importer.parsers.CrossSectionParser;
4706 e7b238247c4e Documentation added. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4678 diff changeset	26 import de.intevation.flys.importer.parsers.DA66Parser;
4193 f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	27 import de.intevation.flys.importer.parsers.FlowVelocityMeasurementParser;
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	28 import de.intevation.flys.importer.parsers.FlowVelocityModelParser;
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	29 import de.intevation.flys.importer.parsers.HYKParser;
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	30 import de.intevation.flys.importer.parsers.MeasurementStationsParser;
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	31 import de.intevation.flys.importer.parsers.MorphologicalWidthParser;
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	32 import de.intevation.flys.importer.parsers.PRFParser;
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	33 import de.intevation.flys.importer.parsers.PegelGltParser;
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	34 import de.intevation.flys.importer.parsers.SQRelationParser;
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	35 import de.intevation.flys.importer.parsers.SedimentDensityParser;
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	36 import de.intevation.flys.importer.parsers.SedimentYieldParser;
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	37 import de.intevation.flys.importer.parsers.WaterlevelDifferencesParser;
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	38 import de.intevation.flys.importer.parsers.WaterlevelParser;
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	39 import de.intevation.flys.importer.parsers.WstParser;
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	40 import de.intevation.flys.model.River;
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	41 import de.intevation.flys.model.Unit;
188 003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	42
4706 e7b238247c4e Documentation added. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4678 diff changeset	43
e7b238247c4e Documentation added. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4678 diff changeset	44 /** Import all river-related data (files) that can be found. */
177 31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	45 public class ImportRiver
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	46 {
184 4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	47 private static Logger log = Logger.getLogger(ImportRiver.class);
4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	48
4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	49 public static final String PEGEL_GLT = "PEGEL.GLT";
4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	50
483 f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	51 public static final String FIXATIONS = "Fixierungen";
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	52
482 3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	53 public static final String EXTRA_LONGITUDINALS =
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	54 "Zus.L\u00e4ngsschnitte";
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	55
484 a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	56 public static final String [] OFFICIAL_LINES_FOLDERS = {
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	57 "Basisdaten",
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	58 "Fixierungen" };
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	59
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	60 public static final String OFFICIAL_LINES =
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	61 "Amtl_Linien.wst";
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	62
490 13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	63 public static final String FLOOD_WATER = "HW-Marken";
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	64
494 88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	65 public static final String FLOOD_PROTECTION =
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	66 "HW-Schutzanlagen";
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	67
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	68 public static final String MINFO_DIR = "Morphologie";
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	69
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	70 public static final String BED_HEIGHT_DIR = "Sohlhoehen";
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	71
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	72 public static final String BED_HEIGHT_SINGLE_DIR = "Einzeljahre";
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	73
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	74 public static final String BED_HEIGHT_EPOCH_DIR = "Epochen";
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	75
2815 3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	76 public static final String SEDIMENT_DENSITY_DIR = "Sedimentdichte";
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	77
2821 0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	78 public static final String MORPHOLOGICAL_WIDTH_DIR = "morphologische_Breite";
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	79
2826 c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	80 public static final String FLOW_VELOCITY_DIR = "Geschwindigkeit_Schubspannung";
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	81
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	82 public static final String FLOW_VELOCITY_MODEL = "Modellrechnungen";
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	83
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	84 public static final String FLOW_VELOCITY_MEASUREMENTS = "v-Messungen";
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	85
2839 163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	86 public static final String SEDIMENT_YIELD_DIR = "Fracht";
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	87
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	88 public static final String SEDIMENT_YIELD_SINGLE_DIR = "Einzeljahre";
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	89
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	90 public static final String SEDIMENT_YIELD_EPOCH_DIR = "Epochen";
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	91
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	92 public static final String MINFO_FIXATIONS_DIR = "Fixierungsanalyse";
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	93
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	94 public static final String MINFO_WATERLEVELS_DIR = "Wasserspiegellagen";
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	95
2851 acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	96 public static final String MINFO_WATERLEVEL_DIFF_DIR = "Wasserspiegeldifferenzen";
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	97
4193 f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	98 public static final String MINFO_BASE_DIR = "Basisdaten";
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	99
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	100 public static final String MINFO_CORE_DATA_FILE = "Stammdaten_Messstellen.csv";
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	101
3328 a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	102 public static final String MINFO_SQ_DIR = "Feststofftransport-Abfluss-Beziehung";
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	103
177 31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	104 protected String name;
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	105
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	106 protected File wstFile;
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	107
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	108 protected File bbInfoFile;
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	109
184 4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	110 protected List<ImportGauge> gauges;
4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	111
186 cf8cbcb6a10d Added parser to read .KM files. Sascha L. Teichmann <sascha.teichmann@intevation.de>* parents: 184 diff changeset	112 protected List<ImportAnnotation> annotations;
cf8cbcb6a10d Added parser to read .KM files. Sascha L. Teichmann <sascha.teichmann@intevation.de>* parents: 184 diff changeset	113
1220 3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	114 protected List<ImportHYK> hyks;
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	115
1204 22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	116 protected List<ImportCrossSection> crossSections;
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	117
482 3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	118 protected List<ImportWst> extraWsts;
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	119
483 f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	120 protected List<ImportWst> fixations;
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	121
484 a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	122 protected List<ImportWst> officialLines;
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	123
490 13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	124 protected List<ImportWst> floodWater;
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	125
494 88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	126 protected List<ImportWst> floodProtection;
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	127
2811 8926571e47fb Finished importing MINFO bed heights (single and epoch). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2810 diff changeset	128 protected List<ImportBedHeight> bedHeightSingles;
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	129
2811 8926571e47fb Finished importing MINFO bed heights (single and epoch). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2810 diff changeset	130 protected List<ImportBedHeight> bedHeightEpochs;
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	131
2815 3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	132 protected List<ImportSedimentDensity> sedimentDensities;
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	133
2821 0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	134 protected List<ImportMorphWidth> morphologicalWidths;
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	135
2827 85b25e74594f Added temp classes used during the import process of flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2826 diff changeset	136 protected List<ImportFlowVelocityModel> flowVelocityModels;
85b25e74594f Added temp classes used during the import process of flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2826 diff changeset	137
2832 ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	138 protected List<ImportFlowVelocityMeasurement> flowVelocityMeasurements;
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	139
2839 163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	140 protected List<ImportSedimentYield> sedimentYields;
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	141
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	142 protected List<ImportWaterlevel> waterlevels;
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	143
2851 acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	144 protected List<ImportWaterlevelDifference> waterlevelDiffs;
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	145
4193 f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	146 protected List<ImportMeasurementStation> measurementStations;
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	147
3328 a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	148 protected List<ImportSQRelation> sqRelations;
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	149
201 3169b559ca3c Build models for wsts, wst columns and q ranges and store them in the backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 197 diff changeset	150 protected ImportWst wst;
3169b559ca3c Build models for wsts, wst columns and q ranges and store them in the backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 197 diff changeset	151
2347 0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	152 protected ImportUnit wstUnit;
0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	153
765 763c4137d6e1 Added classification of annotation types. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 503 diff changeset	154 protected AnnotationClassifier annotationClassifier;
763c4137d6e1 Added classification of annotation types. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 503 diff changeset	155
188 003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	156 protected River peer;
003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	157
177 31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	158 public ImportRiver() {
2832 ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	159 hyks = new ArrayList<ImportHYK>();
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	160 crossSections = new ArrayList<ImportCrossSection>();
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	161 extraWsts = new ArrayList<ImportWst>();
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	162 fixations = new ArrayList<ImportWst>();
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	163 officialLines = new ArrayList<ImportWst>();
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	164 floodWater = new ArrayList<ImportWst>();
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	165 floodProtection = new ArrayList<ImportWst>();
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	166 sedimentDensities = new ArrayList<ImportSedimentDensity>();
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	167 morphologicalWidths = new ArrayList<ImportMorphWidth>();
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	168 flowVelocityModels = new ArrayList<ImportFlowVelocityModel>();
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	169 flowVelocityMeasurements = new ArrayList<ImportFlowVelocityMeasurement>();
2839 163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	170 sedimentYields = new ArrayList<ImportSedimentYield>();
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	171 waterlevels = new ArrayList<ImportWaterlevel>();
2851 acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	172 waterlevelDiffs = new ArrayList<ImportWaterlevelDifference>();
4193 f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	173 measurementStations = new ArrayList<ImportMeasurementStation>();
3328 a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	174 sqRelations = new ArrayList<ImportSQRelation>();
177 31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	175 }
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	176
766 aa9e3da95c31 Importer: Fix import of annotation type classification. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 765 diff changeset	177 public ImportRiver(
aa9e3da95c31 Importer: Fix import of annotation type classification. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 765 diff changeset	178 String name,
aa9e3da95c31 Importer: Fix import of annotation type classification. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 765 diff changeset	179 File wstFile,
aa9e3da95c31 Importer: Fix import of annotation type classification. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 765 diff changeset	180 File bbInfoFile,
aa9e3da95c31 Importer: Fix import of annotation type classification. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 765 diff changeset	181 AnnotationClassifier annotationClassifier
aa9e3da95c31 Importer: Fix import of annotation type classification. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 765 diff changeset	182 ) {
482 3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	183 this();
766 aa9e3da95c31 Importer: Fix import of annotation type classification. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 765 diff changeset	184 this.name = name;
aa9e3da95c31 Importer: Fix import of annotation type classification. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 765 diff changeset	185 this.wstFile = wstFile;
aa9e3da95c31 Importer: Fix import of annotation type classification. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 765 diff changeset	186 this.bbInfoFile = bbInfoFile;
aa9e3da95c31 Importer: Fix import of annotation type classification. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 765 diff changeset	187 this.annotationClassifier = annotationClassifier;
177 31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	188 }
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	189
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	190 public String getName() {
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	191 return name;
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	192 }
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	193
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	194 public void setName(String name) {
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	195 this.name = name;
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	196 }
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	197
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	198 public File getWstFile() {
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	199 return wstFile;
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	200 }
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	201
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	202 public void setWstFile(File wstFile) {
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	203 this.wstFile = wstFile;
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	204 }
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	205
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	206 public File getBBInfo() {
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	207 return bbInfoFile;
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	208 }
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	209
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	210 public void setBBInfo(File bbInfoFile) {
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	211 this.bbInfoFile = bbInfoFile;
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	212 }
184 4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	213
201 3169b559ca3c Build models for wsts, wst columns and q ranges and store them in the backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 197 diff changeset	214 public ImportWst getWst() {
3169b559ca3c Build models for wsts, wst columns and q ranges and store them in the backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 197 diff changeset	215 return wst;
3169b559ca3c Build models for wsts, wst columns and q ranges and store them in the backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 197 diff changeset	216 }
3169b559ca3c Build models for wsts, wst columns and q ranges and store them in the backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 197 diff changeset	217
3169b559ca3c Build models for wsts, wst columns and q ranges and store them in the backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 197 diff changeset	218 public void setWst(ImportWst wst) {
3169b559ca3c Build models for wsts, wst columns and q ranges and store them in the backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 197 diff changeset	219 this.wst = wst;
3169b559ca3c Build models for wsts, wst columns and q ranges and store them in the backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 197 diff changeset	220 }
3169b559ca3c Build models for wsts, wst columns and q ranges and store them in the backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 197 diff changeset	221
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	222 public File getMinfoDir() {
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	223 File riverDir = wstFile.getParentFile().getParentFile().getParentFile();
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	224 return new File(riverDir, MINFO_DIR);
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	225 }
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	226
186 cf8cbcb6a10d Added parser to read .KM files. Sascha L. Teichmann <sascha.teichmann@intevation.de>* parents: 184 diff changeset	227 public void parseDependencies() throws IOException {
cf8cbcb6a10d Added parser to read .KM files. Sascha L. Teichmann <sascha.teichmann@intevation.de>* parents: 184 diff changeset	228 parseGauges();
cf8cbcb6a10d Added parser to read .KM files. Sascha L. Teichmann <sascha.teichmann@intevation.de>* parents: 184 diff changeset	229 parseAnnotations();
1204 22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	230 parsePRFs();
4712 70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	231 parseDA66s();
1220 3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	232 parseHYKs();
197 c0dcc2357106 Added stub for WST parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 194 diff changeset	233 parseWst();
482 3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	234 parseExtraWsts();
483 f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	235 parseFixations();
484 a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	236 parseOfficialLines();
490 13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	237 parseFloodWater();
494 88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	238 parseFloodProtection();
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	239 parseBedHeight();
2815 3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	240 parseSedimentDensity();
2821 0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	241 parseMorphologicalWidth();
2826 c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	242 parseFlowVelocity();
2839 163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	243 parseSedimentYield();
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	244 parseWaterlevels();
2851 acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	245 parseWaterlevelDifferences();
4193 f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	246 parseMeasurementStations();
3328 a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	247 parseSQRelation();
494 88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	248 }
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	249
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	250 public void parseFloodProtection() throws IOException {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	251 if (Config.INSTANCE.skipFloodProtection()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	252 log.info("skip parsing flood protection");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	253 return;
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	254 }
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	255
494 88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	256 log.info("Parse flood protection wst file");
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	257
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	258 File riverDir = wstFile.getParentFile().getParentFile();
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	259
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	260 File dir = FileTools.repair(new File(riverDir, FLOOD_PROTECTION));
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	261
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	262 if (!dir.isDirectory() \|\| !dir.canRead()) {
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	263 log.info("no directory '" + dir + "' found");
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	264 return;
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	265 }
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	266
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	267 File [] files = dir.listFiles();
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	268
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	269 if (files == null) {
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	270 log.warn("cannot read '" + dir + "'");
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	271 return;
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	272 }
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	273
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	274 for (File file: files) {
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	275 if (!file.isFile() \|\| !file.canRead()) {
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	276 continue;
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	277 }
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	278 String name = file.getName().toLowerCase();
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	279 if (!(name.endsWith(".zus") \|\| name.endsWith(".wst"))) {
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	280 continue;
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	281 }
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	282 log.info("found file '" + file.getName() + "'");
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	283 WstParser wstParser = new WstParser();
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	284 wstParser.parse(file);
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	285 ImportWst iw = wstParser.getWst();
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	286 iw.setKind(5);
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	287 iw.setDescription(FLOOD_PROTECTION + "/" + iw.getDescription());
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	288 floodProtection.add(iw);
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	289 }
490 13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	290 }
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	291
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	292
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	293 public void parseBedHeight() throws IOException {
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	294 File minfoDir = getMinfoDir();
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	295 File bedHeightDir = new File(minfoDir, BED_HEIGHT_DIR);
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	296 File singlesDir = new File(bedHeightDir, BED_HEIGHT_SINGLE_DIR);
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	297 File epochDir = new File(bedHeightDir, BED_HEIGHT_EPOCH_DIR);
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	298
2810 04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	299 if (Config.INSTANCE.skipBedHeightSingle()) {
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	300 log.info("skip parsing bed height single.");
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	301 }
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	302 else {
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	303 log.info("Parse bed height single.");
2810 04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	304 parseBedHeightSingles(singlesDir);
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	305 }
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	306
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	307 if (Config.INSTANCE.skipBedHeightEpoch()) {
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	308 log.info("skip parsing bed height epochs.");
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	309 }
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	310 else {
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	311 log.info("Parse bed height epochs.");
2810 04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	312 parseBedHeightEpochs(epochDir);
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	313 }
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	314 }
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	315
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	316
2815 3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	317 protected void parseSedimentDensity() throws IOException {
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	318 if (Config.INSTANCE.skipSedimentDensity()) {
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	319 log.info("skip parsing sediment density.");
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	320 return;
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	321 }
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	322
3327 bf8d9a4f4cd4 Cleared some irritating debug messages. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3320 diff changeset	323 log.debug("Parse sediment density");
bf8d9a4f4cd4 Cleared some irritating debug messages. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3320 diff changeset	324
2815 3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	325 File minfoDir = getMinfoDir();
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	326 File sediment = new File(minfoDir, SEDIMENT_DENSITY_DIR);
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	327
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	328 File[] files = sediment.listFiles();
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	329
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	330 if (files == null) {
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	331 log.warn("Cannot read directory '" + sediment + "'");
2815 3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	332 return;
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	333 }
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	334
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	335 SedimentDensityParser parser = new SedimentDensityParser();
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	336
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	337 for (File file: files) {
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	338 parser.parse(file);
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	339 }
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	340
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	341 sedimentDensities = parser.getSedimentDensities();
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	342
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	343 log.info("Parsed " + sedimentDensities.size() + " sediment densities.");
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	344 }
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	345
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	346
2821 0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	347 protected void parseMorphologicalWidth() throws IOException {
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	348 if (Config.INSTANCE.skipMorphologicalWidth()) {
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	349 log.info("skip parsing morphological width.");
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	350 return;
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	351 }
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	352
3327 bf8d9a4f4cd4 Cleared some irritating debug messages. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3320 diff changeset	353 log.debug("Parse morphological width");
bf8d9a4f4cd4 Cleared some irritating debug messages. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3320 diff changeset	354
2821 0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	355 File minfoDir = getMinfoDir();
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	356 File morphDir = new File(minfoDir, MORPHOLOGICAL_WIDTH_DIR);
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	357
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	358 File[] files = morphDir.listFiles();
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	359
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	360 if (files == null) {
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	361 log.warn("Cannot read directory '" + morphDir + "'");
2821 0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	362 return;
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	363 }
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	364
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	365 MorphologicalWidthParser parser = new MorphologicalWidthParser();
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	366
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	367 for (File file: files) {
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	368 parser.parse(file);
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	369 }
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	370
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	371 morphologicalWidths = parser.getMorphologicalWidths();
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	372
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	373 log.info("Parsed " + morphologicalWidths.size() + " morph. widths files.");
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	374 }
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	375
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	376
2826 c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	377 protected void parseFlowVelocity() throws IOException {
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	378 if (Config.INSTANCE.skipFlowVelocity()) {
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	379 log.info("skip parsing flow velocity");
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	380 return;
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	381 }
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	382
3328 a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	383 log.debug("Parse flow velocity");
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	384
2826 c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	385 File minfoDir = getMinfoDir();
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	386 File flowDir = new File(minfoDir, FLOW_VELOCITY_DIR);
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	387 File modelDir = new File(flowDir, FLOW_VELOCITY_MODEL);
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	388 File measureDir = new File(flowDir, FLOW_VELOCITY_MEASUREMENTS);
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	389
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	390 File[] modelFiles = modelDir.listFiles();
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	391 File[] measureFiles = measureDir.listFiles();
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	392
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	393 if (modelFiles == null) {
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	394 log.warn("Cannot read directory '" + modelDir + "'");
2826 c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	395 }
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	396 else {
2828 ac13e466a55e Added a parser for flow velocity model data and adjusted the db relation schema (missing q column). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2827 diff changeset	397 FlowVelocityModelParser parser = new FlowVelocityModelParser();
ac13e466a55e Added a parser for flow velocity model data and adjusted the db relation schema (missing q column). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2827 diff changeset	398
2826 c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	399 for (File model: modelFiles) {
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	400 log.debug("Parse file '" + model + "'");
2828 ac13e466a55e Added a parser for flow velocity model data and adjusted the db relation schema (missing q column). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2827 diff changeset	401 parser.parse(model);
2826 c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	402 }
2828 ac13e466a55e Added a parser for flow velocity model data and adjusted the db relation schema (missing q column). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2827 diff changeset	403
ac13e466a55e Added a parser for flow velocity model data and adjusted the db relation schema (missing q column). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2827 diff changeset	404 flowVelocityModels = parser.getModels();
2826 c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	405 }
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	406
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	407 if (measureFiles == null) {
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	408 log.warn("Cannot read directory '" + measureDir + "'");
2826 c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	409 }
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	410 else {
2832 ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	411 FlowVelocityMeasurementParser parser =
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	412 new FlowVelocityMeasurementParser();
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	413
2826 c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	414 for (File measurement: measureFiles) {
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	415 log.debug("Parse file '" + measurement + "'");
2832 ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	416 parser.parse(measurement);
2826 c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	417 }
2832 ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	418
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	419 flowVelocityMeasurements = parser.getMeasurements();
2826 c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	420 }
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	421 }
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	422
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	423
2839 163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	424 protected void parseSedimentYield() throws IOException {
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	425 if (Config.INSTANCE.skipSedimentYield()) {
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	426 log.info("skip parsing sediment yield data");
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	427 return;
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	428 }
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	429
3327 bf8d9a4f4cd4 Cleared some irritating debug messages. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3320 diff changeset	430 log.debug("Parse sediment yield data");
bf8d9a4f4cd4 Cleared some irritating debug messages. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3320 diff changeset	431
2839 163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	432 File minfoDir = getMinfoDir();
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	433 File sedimentYieldDir = new File(minfoDir, SEDIMENT_YIELD_DIR);
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	434
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	435 File singleDir = new File(sedimentYieldDir, SEDIMENT_YIELD_SINGLE_DIR);
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	436 File epochDir = new File(sedimentYieldDir, SEDIMENT_YIELD_EPOCH_DIR);
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	437
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	438 File[] singles = singleDir.listFiles();
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	439 File[] epochs = epochDir.listFiles();
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	440
2840 71175502d868 Added a parser for sediment yield files; started parsing and store values in db. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2839 diff changeset	441 SedimentYieldParser parser = new SedimentYieldParser();
71175502d868 Added a parser for sediment yield files; started parsing and store values in db. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2839 diff changeset	442
2839 163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	443 if (singles == null \|\| singles.length == 0) {
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	444 log.warn("Cannot read directory '" + singleDir + "'");
2839 163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	445 }
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	446 else {
2840 71175502d868 Added a parser for sediment yield files; started parsing and store values in db. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2839 diff changeset	447 for (File file: singles) {
71175502d868 Added a parser for sediment yield files; started parsing and store values in db. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2839 diff changeset	448 if (file.isDirectory()) {
71175502d868 Added a parser for sediment yield files; started parsing and store values in db. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2839 diff changeset	449 for (File child: file.listFiles()) {
71175502d868 Added a parser for sediment yield files; started parsing and store values in db. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2839 diff changeset	450 parser.parse(child);
71175502d868 Added a parser for sediment yield files; started parsing and store values in db. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2839 diff changeset	451 }
71175502d868 Added a parser for sediment yield files; started parsing and store values in db. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2839 diff changeset	452 }
71175502d868 Added a parser for sediment yield files; started parsing and store values in db. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2839 diff changeset	453 else {
71175502d868 Added a parser for sediment yield files; started parsing and store values in db. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2839 diff changeset	454 parser.parse(file);
71175502d868 Added a parser for sediment yield files; started parsing and store values in db. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2839 diff changeset	455 }
71175502d868 Added a parser for sediment yield files; started parsing and store values in db. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2839 diff changeset	456 }
2839 163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	457 }
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	458
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	459 if (epochs == null \|\| epochs.length == 0) {
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	460 log.warn("Cannot read directory '" + epochDir + "'");
2839 163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	461 }
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	462 else {
2840 71175502d868 Added a parser for sediment yield files; started parsing and store values in db. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2839 diff changeset	463 for (File file: epochs) {
71175502d868 Added a parser for sediment yield files; started parsing and store values in db. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2839 diff changeset	464 if (file.isDirectory()) {
71175502d868 Added a parser for sediment yield files; started parsing and store values in db. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2839 diff changeset	465 for (File child: file.listFiles()) {
71175502d868 Added a parser for sediment yield files; started parsing and store values in db. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2839 diff changeset	466 parser.parse(child);
71175502d868 Added a parser for sediment yield files; started parsing and store values in db. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2839 diff changeset	467 }
71175502d868 Added a parser for sediment yield files; started parsing and store values in db. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2839 diff changeset	468 }
71175502d868 Added a parser for sediment yield files; started parsing and store values in db. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2839 diff changeset	469 else {
71175502d868 Added a parser for sediment yield files; started parsing and store values in db. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2839 diff changeset	470 parser.parse(file);
71175502d868 Added a parser for sediment yield files; started parsing and store values in db. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2839 diff changeset	471 }
71175502d868 Added a parser for sediment yield files; started parsing and store values in db. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2839 diff changeset	472 }
2839 163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	473 }
2840 71175502d868 Added a parser for sediment yield files; started parsing and store values in db. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2839 diff changeset	474
71175502d868 Added a parser for sediment yield files; started parsing and store values in db. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2839 diff changeset	475 sedimentYields = parser.getSedimentYields();
2839 163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	476 }
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	477
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	478
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	479 protected void parseWaterlevels() throws IOException {
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	480 if (Config.INSTANCE.skipWaterlevels()) {
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	481 log.info("skip parsing waterlevels");
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	482 return;
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	483 }
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	484
2851 acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	485 log.info("Parse waterlevels");
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	486
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	487 File minfo = getMinfoDir();
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	488 File fixDir = new File(minfo, MINFO_FIXATIONS_DIR);
2845 a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	489 File wspDir = new File(fixDir, MINFO_WATERLEVELS_DIR);
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	490
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	491 File[] files = wspDir.listFiles();
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	492
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	493 if (files == null) {
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	494 log.warn("Cannot read directory '" + wspDir + "'");
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	495 return;
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	496 }
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	497
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	498 WaterlevelParser parser = new WaterlevelParser();
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	499
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	500 for (File file: files) {
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	501 parser.parse(file);
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	502 }
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	503
2851 acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	504 waterlevels = parser.getWaterlevels();
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	505 }
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	506
4193 f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	507 protected void parseMeasurementStations() throws IOException {
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	508 if (Config.INSTANCE.skipMeasurementStations()) {
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	509 log.info("skip parsing measurement stations");
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	510 return;
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	511 }
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	512
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	513 log.info("Parse measurement stations");
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	514
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	515 File minfo = getMinfoDir();
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	516 File minfoBaseDir = new File(minfo, MINFO_BASE_DIR);
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	517 File coredataFile = new File(minfoBaseDir, MINFO_CORE_DATA_FILE);
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	518
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	519 if (coredataFile == null \|\| !coredataFile.exists()) {
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	520 log.warn("No core data file '" + MINFO_CORE_DATA_FILE + "' found");
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	521 return;
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	522 }
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	523
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	524 MeasurementStationsParser parser = new MeasurementStationsParser();
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	525 try {
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	526 parser.parse(coredataFile);
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	527 measurementStations = parser.getMeasurementStations();
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	528
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	529 log.info("Successfully parsed " + measurementStations.size() + " measurement stations.");
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	530 }
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	531 catch (IOException ioe) {
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	532 log.error("unable to parse file '" + coredataFile.getName() +
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	533 ": " + ioe.getMessage());
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	534 }
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	535 }
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	536
2851 acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	537
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	538 protected void parseWaterlevelDifferences() throws IOException {
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	539 if (Config.INSTANCE.skipWaterlevelDifferences()) {
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	540 log.info("skip parsing waterlevel differences");
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	541 return;
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	542 }
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	543
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	544 log.info("Parse waterlevel differences");
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	545
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	546 File minfo = getMinfoDir();
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	547 File fixDir = new File(minfo, MINFO_FIXATIONS_DIR);
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	548 File diffDir = new File(fixDir, MINFO_WATERLEVEL_DIFF_DIR);
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	549
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	550 File[] files = diffDir.listFiles();
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	551
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	552 if (files == null) {
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	553 log.warn("Cannot read directory '" + diffDir + "'");
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	554 return;
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	555 }
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	556
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	557 WaterlevelDifferencesParser parser = new WaterlevelDifferencesParser();
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	558
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	559 for (File file: files) {
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	560 parser.parse(file);
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	561 }
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	562
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	563 waterlevelDiffs = parser.getDifferences();
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	564 }
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	565
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	566
3328 a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	567 protected void parseSQRelation() throws IOException {
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	568 if (Config.INSTANCE.skipSQRelation()) {
3329 cc8fc6b29649 Store sq relations into database after parsing. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3328 diff changeset	569 log.info("skip parsing sq relation");
3328 a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	570 return;
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	571 }
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	572
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	573 log.info("Parse sq relations");
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	574
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	575 File minfo = getMinfoDir();
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	576 File sqDir = new File(minfo, MINFO_SQ_DIR);
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	577
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	578 File[] files = sqDir.listFiles();
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	579
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	580 if (files == null) {
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	581 log.warn("Cannot read directory '" + sqDir + "'");
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	582 return;
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	583 }
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	584
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	585 SQRelationParser parser = new SQRelationParser();
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	586
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	587 for (File file: files) {
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	588 parser.parse(file);
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	589 }
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	590
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	591 sqRelations = parser.getSQRelations();
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	592
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	593 log.debug("Parsed " + sqRelations.size() + " SQ relations.");
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	594 }
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	595
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	596
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	597 protected void parseBedHeightSingles(File dir) throws IOException {
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	598 log.debug("Parse bed height singles");
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	599
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	600 File[] files = dir.listFiles();
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	601
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	602 if (files == null) {
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	603 log.warn("Cannot read directory '" + dir + "'");
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	604 return;
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	605 }
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	606
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	607 BedHeightSingleParser parser = new BedHeightSingleParser();
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	608
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	609 for (File file: files) {
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	610 parser.parse(file);
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	611 }
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	612
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	613 bedHeightSingles = parser.getBedHeights();
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	614 }
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	615
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	616
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	617 protected void parseBedHeightEpochs(File dir) throws IOException {
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	618 log.debug("Parse bed height epochs");
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	619
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	620 File[] files = dir.listFiles();
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	621
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	622 if (files == null) {
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	623 log.warn("Cannot read directory '" + dir + "'");
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	624 return;
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	625 }
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	626
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	627 BedHeightEpochParser parser = new BedHeightEpochParser();
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	628
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	629 for (File file: files) {
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	630 parser.parse(file);
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	631 }
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	632
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	633 bedHeightEpochs = parser.getBedHeights();
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	634 }
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	635
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	636
490 13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	637 public void parseFloodWater() throws IOException {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	638 if (Config.INSTANCE.skipFloodWater()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	639 log.info("skip parsing flod water");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	640 return;
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	641 }
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	642
490 13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	643 log.info("Parse flood water wst file");
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	644
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	645 File riverDir = wstFile.getParentFile().getParentFile();
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	646
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	647 File dir = FileTools.repair(new File(riverDir, FLOOD_WATER));
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	648
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	649 if (!dir.isDirectory() \|\| !dir.canRead()) {
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	650 log.info("no directory '" + dir + "' found");
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	651 return;
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	652 }
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	653
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	654 File [] files = dir.listFiles();
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	655
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	656 if (files == null) {
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	657 log.warn("cannot read '" + dir + "'");
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	658 return;
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	659 }
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	660
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	661 for (File file: files) {
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	662 if (!file.isFile() \|\| !file.canRead()) {
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	663 continue;
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	664 }
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	665 String name = file.getName().toLowerCase();
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	666 if (!(name.endsWith(".zus") \|\| name.endsWith(".wst"))) {
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	667 continue;
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	668 }
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	669 log.info("found file '" + file.getName() + "'");
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	670 WstParser wstParser = new WstParser();
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	671 wstParser.parse(file);
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	672 ImportWst iw = wstParser.getWst();
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	673 iw.setKind(4);
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	674 iw.setDescription(FLOOD_WATER + "/" + iw.getDescription());
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	675 floodWater.add(iw);
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	676 }
484 a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	677 }
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	678
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	679 public void parseOfficialLines() throws IOException {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	680 if (Config.INSTANCE.skipOfficialLines()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	681 log.info("skip parsing official lines");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	682 return;
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	683 }
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	684
484 a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	685 log.info("Parse official wst files");
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	686
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	687 File riverDir = wstFile.getParentFile().getParentFile();
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	688
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	689 for (String folder: OFFICIAL_LINES_FOLDERS) {
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	690 File dir = FileTools.repair(new File(riverDir, folder));
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	691
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	692 if (!dir.isDirectory() \|\| !dir.canRead()) {
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	693 log.info("no directory '" + folder + "' found");
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	694 continue;
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	695 }
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	696
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	697 File file = FileTools.repair(new File(dir, OFFICIAL_LINES));
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	698 if (!file.isFile() \|\| !file.canRead()) {
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	699 log.warn("no official lines wst file found");
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	700 continue;
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	701 }
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	702 log.debug("Found WST file: " + file);
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	703
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	704 WstParser wstParser = new WstParser();
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	705 wstParser.parse(file);
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	706 ImportWst iw = wstParser.getWst();
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	707 iw.setKind(3);
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	708 iw.setDescription(folder + "/" + iw.getDescription());
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	709 officialLines.add(iw);
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	710 } // for all folders
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	711
483 f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	712 }
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	713
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	714 public void parseFixations() throws IOException {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	715 if (Config.INSTANCE.skipFixations()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	716 log.info("skip parsing fixations");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	717 return;
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	718 }
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	719
483 f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	720 log.info("Parse fixation wst files");
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	721
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	722 File riverDir = wstFile.getParentFile().getParentFile();
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	723
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	724 File fixDir = FileTools.repair(
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	725 new File(riverDir, FIXATIONS));
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	726
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	727 if (!fixDir.isDirectory() \|\| !fixDir.canRead()) {
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	728 log.info("no fixation wst file directory found");
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	729 return;
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	730 }
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	731
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	732 File [] files = fixDir.listFiles();
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	733
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	734 if (files == null) {
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	735 log.warn("cannot read fixations wst file directory");
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	736 return;
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	737 }
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	738
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	739 for (File file: files) {
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	740 if (!file.isFile() \|\| !file.canRead()) {
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	741 continue;
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	742 }
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	743 String name = file.getName().toLowerCase();
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	744 if (!name.endsWith(".wst")) {
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	745 continue;
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	746 }
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	747 log.debug("Found WST file: " + file);
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	748
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	749 WstParser wstParser = new WstParser();
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	750 wstParser.parse(file);
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	751 ImportWst iw = wstParser.getWst();
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	752 iw.setKind(2);
490 13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	753 iw.setDescription(FIXATIONS+ "/" + iw.getDescription());
483 f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	754 fixations.add(iw);
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	755 }
482 3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	756 }
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	757
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	758 public void parseExtraWsts() throws IOException {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	759 if (Config.INSTANCE.skipExtraWsts()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	760 log.info("skip parsing extra WST files");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	761 return;
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	762 }
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	763
482 3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	764 log.info("Parse extra longitudinal wst files");
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	765
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	766 File riverDir = wstFile.getParentFile().getParentFile();
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	767
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	768 File extraDir = FileTools.repair(
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	769 new File(riverDir, EXTRA_LONGITUDINALS));
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	770
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	771 if (!extraDir.isDirectory() \|\| !extraDir.canRead()) {
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	772 log.info("no extra longitudinal wst file directory found");
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	773 return;
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	774 }
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	775
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	776 File [] files = extraDir.listFiles();
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	777
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	778 if (files == null) {
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	779 log.warn("cannot read extra longitudinal wst file directory");
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	780 return;
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	781 }
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	782
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	783 for (File file: files) {
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	784 if (!file.isFile() \|\| !file.canRead()) {
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	785 continue;
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	786 }
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	787 String name = file.getName().toLowerCase();
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	788 if (!(name.endsWith(".zus") \|\| name.endsWith(".wst"))) {
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	789 continue;
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	790 }
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	791 log.debug("Found WST file: " + file);
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	792
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	793 WstParser wstParser = new WstParser();
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	794 wstParser.parse(file);
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	795 ImportWst iw = wstParser.getWst();
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	796 iw.setKind(1);
491 738140fe56fe Importer: Prefix "Zusätzliche Längsschnitte" with "Zus.Längsschnitte" in description. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 490 diff changeset	797 iw.setDescription(EXTRA_LONGITUDINALS + "/" + iw.getDescription());
482 3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	798 extraWsts.add(iw);
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	799 }
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	800
197 c0dcc2357106 Added stub for WST parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 194 diff changeset	801 }
c0dcc2357106 Added stub for WST parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 194 diff changeset	802
c0dcc2357106 Added stub for WST parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 194 diff changeset	803 public void parseWst() throws IOException {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	804 if (Config.INSTANCE.skipWst()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	805 log.info("skip parsing WST file");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	806 return;
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	807 }
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	808
197 c0dcc2357106 Added stub for WST parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 194 diff changeset	809 WstParser wstParser = new WstParser();
c0dcc2357106 Added stub for WST parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 194 diff changeset	810 wstParser.parse(wstFile);
201 3169b559ca3c Build models for wsts, wst columns and q ranges and store them in the backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 197 diff changeset	811 wst = wstParser.getWst();
186 cf8cbcb6a10d Added parser to read .KM files. Sascha L. Teichmann <sascha.teichmann@intevation.de>* parents: 184 diff changeset	812 }
cf8cbcb6a10d Added parser to read .KM files. Sascha L. Teichmann <sascha.teichmann@intevation.de>* parents: 184 diff changeset	813
184 4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	814 public void parseGauges() throws IOException {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	815 if (Config.INSTANCE.skipGauges()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	816 log.info("skip parsing gauges");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	817 return;
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	818 }
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	819
184 4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	820 File gltFile = new File(wstFile.getParentFile(), PEGEL_GLT);
4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	821 gltFile = FileTools.repair(gltFile);
4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	822
4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	823 if (!gltFile.isFile() \|\| !gltFile.canRead()) {
4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	824 log.warn("cannot read gauges from '" + gltFile + "'");
4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	825 return;
4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	826 }
4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	827
4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	828 PegelGltParser pgltp = new PegelGltParser();
4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	829 pgltp.parse(gltFile);
4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	830
4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	831 gauges = pgltp.getGauges();
189 bc3747a371cc First part of parsing main values. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 188 diff changeset	832
bc3747a371cc First part of parsing main values. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 188 diff changeset	833 for (ImportGauge gauge: gauges) {
bc3747a371cc First part of parsing main values. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 188 diff changeset	834 gauge.parseDependencies();
bc3747a371cc First part of parsing main values. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 188 diff changeset	835 }
184 4ab2c3bd474c Added parsing of PEGEL.GLT files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 177 diff changeset	836 }
186 cf8cbcb6a10d Added parser to read .KM files. Sascha L. Teichmann <sascha.teichmann@intevation.de>* parents: 184 diff changeset	837
cf8cbcb6a10d Added parser to read .KM files. Sascha L. Teichmann <sascha.teichmann@intevation.de>* parents: 184 diff changeset	838 public void parseAnnotations() throws IOException {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	839 if (Config.INSTANCE.skipAnnotations()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	840 log.info("skip parsing annotations");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	841 return;
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	842 }
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	843
186 cf8cbcb6a10d Added parser to read .KM files. Sascha L. Teichmann <sascha.teichmann@intevation.de>* parents: 184 diff changeset	844 File riverDir = wstFile.getParentFile().getParentFile();
765 763c4137d6e1 Added classification of annotation types. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 503 diff changeset	845 AnnotationsParser aparser =
763c4137d6e1 Added classification of annotation types. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 503 diff changeset	846 new AnnotationsParser(annotationClassifier);
186 cf8cbcb6a10d Added parser to read .KM files. Sascha L. Teichmann <sascha.teichmann@intevation.de>* parents: 184 diff changeset	847 aparser.parse(riverDir);
cf8cbcb6a10d Added parser to read .KM files. Sascha L. Teichmann <sascha.teichmann@intevation.de>* parents: 184 diff changeset	848
cf8cbcb6a10d Added parser to read .KM files. Sascha L. Teichmann <sascha.teichmann@intevation.de>* parents: 184 diff changeset	849 annotations = aparser.getAnnotations();
cf8cbcb6a10d Added parser to read .KM files. Sascha L. Teichmann <sascha.teichmann@intevation.de>* parents: 184 diff changeset	850 }
188 003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	851
1220 3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	852 public void parseHYKs() {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	853 if (Config.INSTANCE.skipHYKs()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	854 log.info("skip parsing HYK files");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	855 return;
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	856 }
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	857
1220 3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	858 log.info("looking for HYK files");
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	859 HYKParser parser = new HYKParser();
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	860 File riverDir = wstFile
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	861 .getParentFile() // Basisdaten
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	862 .getParentFile() // Hydrologie
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	863 .getParentFile(); // <river>
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	864
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	865 parser.parseHYKs(riverDir, new HYKParser.Callback() {
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	866
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	867 Set<HashedFile> hfs = new HashSet<HashedFile>();
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	868
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	869 @Override
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	870 public boolean hykAccept(File file) {
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	871 HashedFile hf = new HashedFile(file);
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	872 boolean success = hfs.add(hf);
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	873 if (!success) {
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	874 log.warn("HYK file '" + file + "' seems to be a duplicate.");
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	875 }
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	876 return success;
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	877 }
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	878
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	879 @Override
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	880 public void hykParsed(HYKParser parser) {
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	881 log.debug("callback from HYK parser");
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	882 ImportHYK hyk = parser.getHYK();
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	883 hyk.setRiver(ImportRiver.this);
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	884 hyks.add(hyk);
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	885 }
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	886 });
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	887 }
3c860d3e79d9 Importer: Parse HYKs from importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	888
4712 70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	889
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	890 /** Create a DA66 Parser and parse the da66 files found. */
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	891 // TODO this is a copy of parsePRFs, extract interfaces (e.g. CrossSectionParser).
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	892 public void parseDA66s() {
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	893 if (Config.INSTANCE.skipDA66s()) {
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	894 log.info("skip parsing DA66s");
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	895 return;
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	896 }
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	897
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	898 log.info("looking for DA66 files");
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	899 DA66Parser parser = new DA66Parser();
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	900 File riverDir = wstFile
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	901 .getParentFile() // Basisdaten
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	902 .getParentFile() // Hydrologie
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	903 .getParentFile(); // <river>
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	904
4716 6016b9aa827a Adjust callbacks after Parsers new interface implementation, re-enable file hashing for da66s. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4712 diff changeset	905 parser.parseDA66s(riverDir, new CrossSectionParser.Callback() {
4712 70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	906
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	907 Set<HashedFile> da66s = new HashSet<HashedFile>();
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	908
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	909 @Override
4716 6016b9aa827a Adjust callbacks after Parsers new interface implementation, re-enable file hashing for da66s. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4712 diff changeset	910 public boolean accept(File file) {
4712 70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	911 HashedFile hf = new HashedFile(file);
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	912 boolean success = da66s.add(hf);
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	913 if (!success) {
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	914 log.warn("DA66 file '" + file + "' seems to be a duplicate.");
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	915 }
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	916 return success;
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	917 }
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	918
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	919 @Override
4716 6016b9aa827a Adjust callbacks after Parsers new interface implementation, re-enable file hashing for da66s. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4712 diff changeset	920 public void parsed(CrossSectionParser parser) {
4712 70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	921 log.debug("callback from DA66 parser");
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	922
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	923 // TODO populate with real-world data
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	924 String description = "dummy";//parser.getDescription();
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	925 Integer year = 2012;//parser.getYear();
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	926 ImportTimeInterval ti = year != null
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	927 ? new ImportTimeInterval(yearToDate(year))
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	928 : null;
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	929
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	930 List<ImportCrossSectionLine> lines =
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	931 new ArrayList<ImportCrossSectionLine>();
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	932
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	933 for (Map.Entry<Double, List<XY>> entry: parser.getData().entrySet()) {
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	934 Double km = entry.getKey();
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	935 List<XY> points = entry.getValue();
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	936 lines.add(new ImportCrossSectionLine(km, points));
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	937 }
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	938
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	939 crossSections.add(new ImportCrossSection(
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	940 ImportRiver.this, description, ti, lines));
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	941 }
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	942 });
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	943 }
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	944
70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	945 /** Create a PRFParser and let it parse the prf files found. */
1204 22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	946 public void parsePRFs() {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	947 if (Config.INSTANCE.skipPRFs()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	948 log.info("skip parsing PRFs");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	949 return;
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	950 }
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	951
1204 22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	952 log.info("looking for PRF files");
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	953 PRFParser parser = new PRFParser();
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	954 File riverDir = wstFile
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	955 .getParentFile() // Basisdaten
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	956 .getParentFile() // Hydrologie
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	957 .getParentFile(); // <river>
1206 c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	958
c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	959 parser.parsePRFs(riverDir, new PRFParser.Callback() {
c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	960
c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	961 Set<HashedFile> prfs = new HashSet<HashedFile>();
c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	962
4716 6016b9aa827a Adjust callbacks after Parsers new interface implementation, re-enable file hashing for da66s. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4712 diff changeset	963 // TODO merge Callback implementation with DA66 one.
1206 c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	964 @Override
4716 6016b9aa827a Adjust callbacks after Parsers new interface implementation, re-enable file hashing for da66s. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4712 diff changeset	965 public boolean accept(File file) {
1206 c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	966 HashedFile hf = new HashedFile(file);
c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	967 boolean success = prfs.add(hf);
c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	968 if (!success) {
c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	969 log.warn("PRF file '" + file + "' seems to be a duplicate.");
c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	970 }
c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	971 return success;
c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	972 }
c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	973
c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	974 @Override
4716 6016b9aa827a Adjust callbacks after Parsers new interface implementation, re-enable file hashing for da66s. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4712 diff changeset	975 public void parsed(CrossSectionParser parser) {
1206 c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	976 log.debug("callback from PRF parser");
c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	977
c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	978 String description = parser.getDescription();
c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	979 Integer year = parser.getYear();
c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	980 ImportTimeInterval ti = year != null
c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	981 ? new ImportTimeInterval(yearToDate(year))
c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	982 : null;
c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	983
c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	984 List<ImportCrossSectionLine> lines =
c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	985 new ArrayList<ImportCrossSectionLine>();
c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	986
c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	987 for (Map.Entry<Double, List<XY>> entry: parser.getData().entrySet()) {
4678 83838f87e98f Whitespace-cosmetics. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4193 diff changeset	988 Double km = entry.getKey();
83838f87e98f Whitespace-cosmetics. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4193 diff changeset	989 List<XY> points = entry.getValue();
1206 c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	990 lines.add(new ImportCrossSectionLine(km, points));
c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	991 }
c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	992
c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	993 crossSections.add(new ImportCrossSection(
c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	994 ImportRiver.this, description, ti, lines));
c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	995 }
c7370734b872 Prevent parsing and storing PRF duplicates. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1204 diff changeset	996 });
1204 22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	997 }
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	998
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	999 public static Date yearToDate(int year) {
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1000 Calendar cal = Calendar.getInstance();
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1001 cal.set(year, 5, 15, 12, 0, 0);
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1002 long ms = cal.getTimeInMillis();
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1003 cal.setTimeInMillis(ms - ms%1000);
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1004 return cal.getTime();
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1005 }
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1006
190 d40da430d2fe Added stub code to write gauges Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 189 diff changeset	1007 public void storeDependencies() {
2347 0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	1008 storeWstUnit();
190 d40da430d2fe Added stub code to write gauges Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 189 diff changeset	1009 storeAnnotations();
1221 979ff070e368 Store HYK data structures to database. Needs testing. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1220 diff changeset	1010 storeHYKs();
1204 22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1011 storeCrossSections();
190 d40da430d2fe Added stub code to write gauges Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 189 diff changeset	1012 storeGauges();
201 3169b559ca3c Build models for wsts, wst columns and q ranges and store them in the backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 197 diff changeset	1013 storeWst();
482 3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	1014 storeExtraWsts();
483 f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	1015 storeFixations();
484 a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	1016 storeOfficialLines();
490 13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	1017 storeFloodWater();
494 88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	1018 storeFloodProtection();
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	1019 storeBedHeight();
2815 3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	1020 storeSedimentDensity();
2821 0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	1021 storeMorphologicalWidth();
2826 c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	1022 storeFlowVelocity();
2839 163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1023 storeSedimentYield();
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	1024 storeWaterlevels();
2851 acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	1025 storeWaterlevelDifferences();
4193 f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1026 storeMeasurementStations();
3328 a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	1027 storeSQRelations();
201 3169b559ca3c Build models for wsts, wst columns and q ranges and store them in the backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 197 diff changeset	1028 }
3169b559ca3c Build models for wsts, wst columns and q ranges and store them in the backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 197 diff changeset	1029
2347 0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	1030 public void storeWstUnit() {
0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	1031 if (wst == null) {
0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	1032 wstUnit = new ImportUnit("NN + m");
0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	1033 }
0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	1034 else {
0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	1035 wstUnit = wst.getUnit();
0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	1036 }
0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	1037 }
0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	1038
1221 979ff070e368 Store HYK data structures to database. Needs testing. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1220 diff changeset	1039 public void storeHYKs() {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1040 if (!Config.INSTANCE.skipHYKs()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1041 log.info("store HYKs");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1042 getPeer();
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1043 for (ImportHYK hyk: hyks) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1044 hyk.storeDependencies();
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1045 }
1221 979ff070e368 Store HYK data structures to database. Needs testing. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1220 diff changeset	1046 }
979ff070e368 Store HYK data structures to database. Needs testing. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1220 diff changeset	1047 }
979ff070e368 Store HYK data structures to database. Needs testing. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1220 diff changeset	1048
1204 22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1049 public void storeCrossSections() {
4712 70842db72ee4 Include improved DA66Parser into importer. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4706 diff changeset	1050 if (!Config.INSTANCE.skipPRFs() \|\| !Config.INSTANCE.skipDA66s()) {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1051 log.info("store cross sections");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1052 getPeer();
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1053 for (ImportCrossSection crossSection: crossSections) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1054 crossSection.storeDependencies();
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1055 }
1204 22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1056 }
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1057 }
22858e7cca79 Integrated PRF parsing into importer. Needs testing! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 766 diff changeset	1058
201 3169b559ca3c Build models for wsts, wst columns and q ranges and store them in the backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 197 diff changeset	1059 public void storeWst() {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1060 if (!Config.INSTANCE.skipWst()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1061 River river = getPeer();
483 f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	1062 wst.storeDependencies(river);
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	1063 }
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	1064 }
f1fd9cab6a07 Importer: parse and store fixation wst files as well Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 482 diff changeset	1065
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1066 public void storeFixations() {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1067 if (!Config.INSTANCE.skipFixations()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1068 log.info("store fixation wsts");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1069 River river = getPeer();
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1070 for (ImportWst wst: fixations) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1071 log.debug("name: " + wst.getDescription());
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1072 wst.storeDependencies(river);
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1073 }
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1074 }
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1075 }
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1076
482 3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	1077 public void storeExtraWsts() {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1078 if (!Config.INSTANCE.skipExtraWsts()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1079 log.info("store extra wsts");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1080 River river = getPeer();
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1081 for (ImportWst wst: extraWsts) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1082 log.debug("name: " + wst.getDescription());
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1083 wst.storeDependencies(river);
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1084 }
482 3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	1085 }
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	1086 }
3a99d0295006 Importer: Support parsing "zusaetzliche Laengsschnitte". Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 201 diff changeset	1087
484 a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	1088 public void storeOfficialLines() {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1089 if (!Config.INSTANCE.skipOfficialLines()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1090 log.info("store official lines wsts");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1091 River river = getPeer();
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1092 for (ImportWst wst: officialLines) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1093 log.debug("name: " + wst.getDescription());
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1094 wst.storeDependencies(river);
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1095 }
484 a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	1096 }
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	1097 }
a9e9a8a44d19 Parse and store "amtliche Linien" wst files. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 483 diff changeset	1098
490 13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	1099 public void storeFloodWater() {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1100 if (!Config.INSTANCE.skipFloodWater()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1101 log.info("store flood water wsts");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1102 River river = getPeer();
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1103 for (ImportWst wst: floodWater) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1104 log.debug("name: " + wst.getDescription());
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1105 wst.storeDependencies(river);
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1106 }
490 13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	1107 }
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	1108 }
13af9318a4a2 Import "Hochwasser-Marken", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 484 diff changeset	1109
494 88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	1110 public void storeFloodProtection() {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1111 if (!Config.INSTANCE.skipFloodProtection()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1112 log.info("store flood protection wsts");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1113 River river = getPeer();
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1114 for (ImportWst wst: floodProtection) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1115 log.debug("name: " + wst.getDescription());
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1116 wst.storeDependencies(river);
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1117 }
494 88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	1118 }
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	1119 }
88d5b02ff0c1 Importer: Import the "HW-Schutzanlagen", too. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 491 diff changeset	1120
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	1121
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	1122 public void storeBedHeight() {
2810 04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1123 if (!Config.INSTANCE.skipBedHeightSingle()) {
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1124 log.info("store bed heights single");
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1125 storeBedHeightSingle();
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1126 }
2809 f283212966e8 Finished work on MINFO bed heights (single). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2806 diff changeset	1127
2810 04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1128 if (!Config.INSTANCE.skipBedHeightEpoch()) {
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1129 log.info("store bed height epoch.");
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1130 storeBedHeightEpoch();
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1131 }
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1132 }
2809 f283212966e8 Finished work on MINFO bed heights (single). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2806 diff changeset	1133
2810 04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1134
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1135 private void storeBedHeightSingle() {
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1136 River river = getPeer();
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1137
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1138 if (bedHeightSingles != null) {
2811 8926571e47fb Finished importing MINFO bed heights (single and epoch). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2810 diff changeset	1139 for (ImportBedHeight tmp: bedHeightSingles) {
8926571e47fb Finished importing MINFO bed heights (single and epoch). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2810 diff changeset	1140 ImportBedHeightSingle single = (ImportBedHeightSingle) tmp;
8926571e47fb Finished importing MINFO bed heights (single and epoch). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2810 diff changeset	1141
2810 04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1142 String desc = single.getDescription();
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1143
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1144 log.debug("name: " + desc);
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1145
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1146 try {
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1147 single.storeDependencies(river);
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1148 }
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1149 catch (SQLException sqle) {
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1150 log.error("File '" + desc + "' is broken!");
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1151 }
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1152 catch (ConstraintViolationException cve) {
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1153 log.error("File '" + desc + "' is broken!");
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	1154 }
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	1155 }
2810 04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1156 }
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1157 else {
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1158 log.info("No single bed heights to store.");
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1159 }
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1160 }
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	1161
2810 04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1162
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1163 private void storeBedHeightEpoch() {
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1164 River river = getPeer();
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1165
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1166 if (bedHeightEpochs != null) {
2811 8926571e47fb Finished importing MINFO bed heights (single and epoch). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2810 diff changeset	1167 for (ImportBedHeight tmp: bedHeightEpochs) {
8926571e47fb Finished importing MINFO bed heights (single and epoch). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2810 diff changeset	1168 ImportBedHeightEpoch epoch = (ImportBedHeightEpoch) tmp;
8926571e47fb Finished importing MINFO bed heights (single and epoch). Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2810 diff changeset	1169
2810 04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1170 String desc = epoch.getDescription();
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1171
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1172 log.debug("name: " + desc);
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1173
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1174 try {
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	1175 epoch.storeDependencies(river);
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	1176 }
2810 04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1177 catch (SQLException sqle) {
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1178 log.error("File '" + desc + "' is broken!");
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1179 }
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1180 catch (ConstraintViolationException cve) {
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1181 log.error("File '" + desc + "' is broken!");
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1182 }
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	1183 }
2810 04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1184 }
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1185 else {
04eeb45df27b Implemented model classes and importer classes for bed height epochs. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2809 diff changeset	1186 log.info("No epoch bed heights to store.");
2806 33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	1187 }
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	1188 }
33f40b23edd8 Initial checkin for parsing MINFO bed heights. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2347 diff changeset	1189
2815 3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	1190 public void storeSedimentDensity() {
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	1191 if (!Config.INSTANCE.skipSedimentDensity()) {
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	1192 log.info("store sediment density");
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	1193
2817 8979f2294af9 Finished parsing MINFO specific sediment density. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2815 diff changeset	1194 River river = getPeer();
8979f2294af9 Finished parsing MINFO specific sediment density. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2815 diff changeset	1195
8979f2294af9 Finished parsing MINFO specific sediment density. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2815 diff changeset	1196 for (ImportSedimentDensity density: sedimentDensities) {
8979f2294af9 Finished parsing MINFO specific sediment density. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2815 diff changeset	1197 String desc = density.getDescription();
8979f2294af9 Finished parsing MINFO specific sediment density. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2815 diff changeset	1198
8979f2294af9 Finished parsing MINFO specific sediment density. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2815 diff changeset	1199 log.debug("name: " + desc);
8979f2294af9 Finished parsing MINFO specific sediment density. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2815 diff changeset	1200
8979f2294af9 Finished parsing MINFO specific sediment density. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2815 diff changeset	1201 try {
8979f2294af9 Finished parsing MINFO specific sediment density. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2815 diff changeset	1202 density.storeDependencies(river);
8979f2294af9 Finished parsing MINFO specific sediment density. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2815 diff changeset	1203 }
8979f2294af9 Finished parsing MINFO specific sediment density. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2815 diff changeset	1204 catch (SQLException sqle) {
8979f2294af9 Finished parsing MINFO specific sediment density. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2815 diff changeset	1205 log.error("File '" + desc + "' is broken!");
8979f2294af9 Finished parsing MINFO specific sediment density. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2815 diff changeset	1206 }
8979f2294af9 Finished parsing MINFO specific sediment density. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2815 diff changeset	1207 catch (ConstraintViolationException cve) {
8979f2294af9 Finished parsing MINFO specific sediment density. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2815 diff changeset	1208 log.error("File '" + desc + "' is broken!");
8979f2294af9 Finished parsing MINFO specific sediment density. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2815 diff changeset	1209 }
8979f2294af9 Finished parsing MINFO specific sediment density. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2815 diff changeset	1210 }
2815 3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	1211 }
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	1212 }
3febaed762b8 Added new parser (stub) to read MINFO sediment density files; prepared import process to handle those files. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2811 diff changeset	1213
2821 0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	1214 public void storeMorphologicalWidth() {
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	1215 if (!Config.INSTANCE.skipMorphologicalWidth()) {
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	1216 log.info("store morphological width");
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	1217
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	1218 River river = getPeer();
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	1219
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	1220 for (ImportMorphWidth width: morphologicalWidths) {
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	1221 try {
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	1222 width.storeDependencies(river);
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	1223 }
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	1224 catch (SQLException sqle) {
3659 36edf9a71cbd backend: Mention backend errors in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3329 diff changeset	1225 log.error("Error while parsing file for morph. width.", sqle);
2821 0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	1226 }
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	1227 catch (ConstraintViolationException cve) {
3659 36edf9a71cbd backend: Mention backend errors in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3329 diff changeset	1228 log.error("Error while parsing file for morph. width.", cve);
2821 0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	1229 }
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	1230 }
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	1231 }
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	1232 }
0a536eb5d668 Added parser for parsing morphological widths. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2817 diff changeset	1233
2826 c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	1234 public void storeFlowVelocity() {
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	1235 if (!Config.INSTANCE.skipFlowVelocity()) {
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	1236 log.info("store flow velocity");
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	1237
2827 85b25e74594f Added temp classes used during the import process of flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2826 diff changeset	1238 River river = getPeer();
85b25e74594f Added temp classes used during the import process of flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2826 diff changeset	1239
85b25e74594f Added temp classes used during the import process of flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2826 diff changeset	1240 for (ImportFlowVelocityModel flowVelocityModel: flowVelocityModels){
85b25e74594f Added temp classes used during the import process of flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2826 diff changeset	1241 try {
85b25e74594f Added temp classes used during the import process of flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2826 diff changeset	1242 flowVelocityModel.storeDependencies(river);
85b25e74594f Added temp classes used during the import process of flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2826 diff changeset	1243 }
85b25e74594f Added temp classes used during the import process of flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2826 diff changeset	1244 catch (SQLException sqle) {
85b25e74594f Added temp classes used during the import process of flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2826 diff changeset	1245 log.error("Error while storing flow velocity model.", sqle);
85b25e74594f Added temp classes used during the import process of flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2826 diff changeset	1246 }
85b25e74594f Added temp classes used during the import process of flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2826 diff changeset	1247 catch (ConstraintViolationException cve) {
85b25e74594f Added temp classes used during the import process of flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2826 diff changeset	1248 log.error("Error while storing flow velocity model.", cve);
85b25e74594f Added temp classes used during the import process of flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2826 diff changeset	1249 }
85b25e74594f Added temp classes used during the import process of flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2826 diff changeset	1250 }
2832 ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	1251
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	1252 for (ImportFlowVelocityMeasurement m: flowVelocityMeasurements) {
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	1253 try {
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	1254 m.storeDependencies(river);
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	1255 }
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	1256 catch (SQLException sqle) {
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	1257 log.error("Error while storing flow velocity measurement.", sqle);
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	1258 }
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	1259 catch (ConstraintViolationException cve) {
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	1260 log.error("Error while storing flow velocity measurement.", cve);
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	1261 }
ac5bd90697c1 Added new parser for flow velocity measurements and fixed some smaller bugs while importing flow velocity data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2828 diff changeset	1262 }
2826 c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	1263 }
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	1264 }
c3f8cf0cdf69 Prepared the importer to parse flow velocity files and added a config option to skip that process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2821 diff changeset	1265
2839 163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1266
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1267 public void storeSedimentYield() {
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1268 if (!Config.INSTANCE.skipSedimentYield()) {
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1269 log.info("store sediment yield data");
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1270
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1271 River river = getPeer();
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1272
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1273 for (ImportSedimentYield sedimentYield: sedimentYields) {
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1274 try {
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1275 sedimentYield.storeDependencies(river);
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1276 }
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1277 catch (SQLException sqle) {
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1278 log.error("Error while storing sediment yield.", sqle);
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1279 }
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1280 catch (ConstraintViolationException cve) {
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1281 log.error("Error while storing sediment yield.", cve);
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1282 }
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1283 }
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1284 }
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1285 }
163c037f2c7e Added config option to skip parsing sediment yield data and prepared the importer to read/store those data. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2832 diff changeset	1286
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	1287
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	1288 public void storeWaterlevels() {
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	1289 if (!Config.INSTANCE.skipWaterlevels()) {
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	1290 log.info("store waterlevels");
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	1291
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	1292 River river = getPeer();
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	1293
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	1294 for (ImportWaterlevel waterlevel: waterlevels) {
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	1295 waterlevel.storeDependencies(river);
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	1296 }
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	1297 }
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	1298 }
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	1299
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2840 diff changeset	1300
2851 acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	1301 public void storeWaterlevelDifferences() {
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	1302 if (!Config.INSTANCE.skipWaterlevelDifferences()) {
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	1303 log.info("store waterlevel differences");
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	1304
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	1305 River river = getPeer();
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	1306
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	1307 for (ImportWaterlevelDifference diff: waterlevelDiffs) {
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	1308 try {
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	1309 diff.storeDependencies(river);
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	1310 }
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	1311 catch (SQLException sqle) {
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	1312 log.error("Error while storing waterlevel diff.", sqle);
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	1313 }
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	1314 catch (ConstraintViolationException cve) {
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	1315 log.error("Error while storing waterlevel diff.", cve);
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	1316 }
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	1317 }
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	1318 }
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	1319 }
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	1320
acb8d08f59a2 Parse and store MINFO waterlevel differences; added config option to skip this process. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	1321
4193 f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1322 public void storeMeasurementStations() {
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1323 if (!Config.INSTANCE.skipMeasurementStations()) {
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1324 log.info("store measurement stations");
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1325
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1326 River river = getPeer();
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1327
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1328 int count = 0;
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1329
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1330 for (ImportMeasurementStation station: measurementStations) {
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1331 try {
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1332 boolean success = station.storeDependencies(river);
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1333 if (success) {
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1334 count++;
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1335 }
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1336 }
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1337 catch (SQLException sqle) {
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1338 log.error("Error while storing measurement station.", sqle);
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1339 }
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1340 catch (ConstraintViolationException cve) {
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1341 log.error("Error while storing measurement station.", cve);
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1342 }
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1343 }
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1344
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1345 log.info("stored " + count + " measurement stations.");
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1346 }
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1347 }
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1348
f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3660 diff changeset	1349
3328 a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	1350 public void storeSQRelations() {
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	1351 if (!Config.INSTANCE.skipSQRelation()) {
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	1352 log.info("store sq relations");
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	1353
3329 cc8fc6b29649 Store sq relations into database after parsing. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3328 diff changeset	1354 River river = getPeer();
cc8fc6b29649 Store sq relations into database after parsing. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3328 diff changeset	1355
cc8fc6b29649 Store sq relations into database after parsing. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3328 diff changeset	1356 int count = 0;
cc8fc6b29649 Store sq relations into database after parsing. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3328 diff changeset	1357
cc8fc6b29649 Store sq relations into database after parsing. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3328 diff changeset	1358 for (ImportSQRelation sqRelation: sqRelations) {
cc8fc6b29649 Store sq relations into database after parsing. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3328 diff changeset	1359 try {
cc8fc6b29649 Store sq relations into database after parsing. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3328 diff changeset	1360 sqRelation.storeDependencies(river);
cc8fc6b29649 Store sq relations into database after parsing. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3328 diff changeset	1361 count++;
cc8fc6b29649 Store sq relations into database after parsing. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3328 diff changeset	1362 }
cc8fc6b29649 Store sq relations into database after parsing. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3328 diff changeset	1363 catch (SQLException sqle) {
cc8fc6b29649 Store sq relations into database after parsing. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3328 diff changeset	1364 log.error("Error while storing sq relation.", sqle);
cc8fc6b29649 Store sq relations into database after parsing. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3328 diff changeset	1365 }
cc8fc6b29649 Store sq relations into database after parsing. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3328 diff changeset	1366 catch (ConstraintViolationException cve) {
cc8fc6b29649 Store sq relations into database after parsing. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3328 diff changeset	1367 log.error("Error while storing sq relation.", cve);
cc8fc6b29649 Store sq relations into database after parsing. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3328 diff changeset	1368 }
cc8fc6b29649 Store sq relations into database after parsing. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3328 diff changeset	1369 }
cc8fc6b29649 Store sq relations into database after parsing. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3328 diff changeset	1370
cc8fc6b29649 Store sq relations into database after parsing. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3328 diff changeset	1371 log.info("stored " + count + " sq relations.");
3328 a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	1372 }
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	1373 }
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	1374
a41f279a66e2 Added parser and import classes to import MINFO sq relations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 3327 diff changeset	1375
188 003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1376 public void storeAnnotations() {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1377 if (!Config.INSTANCE.skipAnnotations()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1378 River river = getPeer();
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1379 for (ImportAnnotation annotation: annotations) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1380 annotation.getPeer(river);
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1381 }
188 003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1382 }
003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1383 }
003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1384
190 d40da430d2fe Added stub code to write gauges Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 189 diff changeset	1385 public void storeGauges() {
1223 268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1386 if (!Config.INSTANCE.skipGauges()) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1387 log.info("store gauges:");
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1388 River river = getPeer();
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1389 Session session = ImporterSession.getInstance()
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1390 .getDatabaseSession();
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1391 for (ImportGauge gauge: gauges) {
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1392 log.info("\tgauge: " + gauge.getName());
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1393 gauge.storeDependencies(river);
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1394 ImporterSession.getInstance().getDatabaseSession();
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1395 session.flush();
268f8da412e3 Importer: Added a central configuration to allow skipping of parsing/storing individual sub systems. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1221 diff changeset	1396 }
191 c4fb5141ce11 Propagate river into storing of gauges. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 190 diff changeset	1397 }
190 d40da430d2fe Added stub code to write gauges Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 189 diff changeset	1398 }
d40da430d2fe Added stub code to write gauges Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 189 diff changeset	1399
188 003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1400 public River getPeer() {
003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1401 if (peer == null) {
497 67fd63e4ef66 Importer: centralized caching Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 494 diff changeset	1402 Session session = ImporterSession.getInstance().getDatabaseSession();
188 003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1403 Query query = session.createQuery("from River where name=:name");
2347 0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	1404
0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	1405 Unit u = wstUnit.getPeer();
0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	1406
188 003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1407 query.setString("name", name);
003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1408 List<River> rivers = query.list();
003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1409 if (rivers.isEmpty()) {
2347 0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	1410 log.info("Store new river '" + name + "'");
0acf28a3d28a Removed the Unit from Wsts - added a WstUnit column to rivers. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 1234 diff changeset	1411 peer = new River(name, u);
188 003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1412 session.save(peer);
003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1413 }
003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1414 else {
003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1415 peer = rivers.get(0);
003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1416 }
003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1417 }
003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1418 return peer;
003ac16812dd Store annotations in backend. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 186 diff changeset	1419 }
177 31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	1420 }
31895d24387e Importer: Added info gew parser. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	1421 // vim:set ts=4 sw=4 si et sta sts=4 fenc=utf8 :

Mercurial > dive4elements > river

annotate flys-backend/src/main/java/de/intevation/flys/importer/ImportRiver.java @ 4716:6016b9aa827a