dive4elements/river: backend/src/main/java/org/dive4elements/river/importer/parsers/WaterlevelParser.java annotate

annotate backend/src/main/java/org/dive4elements/river/importer/parsers/WaterlevelParser.java @ 6328:53d08f33d094

Backend: Moved guessing of main values and there time intervals out of the STA parser. Same come will be useful to extend the WST parser to better handle official lines.

author	Sascha L. Teichmann <teichmann@intevation.de>
date	Thu, 13 Jun 2013 17:15:34 +0200
parents	550cb41d37d9
children	ad2fdc34910a

rev	line source
5844 4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	1 /* Copyright (C) 2011, 2012, 2013 by Bundesanstalt für Gewässerkunde
4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	2 * Software engineering by Intevation GmbH
4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	3 *
5992 4c3ccf2b0304 Removed trailing whitespace. Sascha L. Teichmann <teichmann@intevation.de> parents: 5844 diff changeset	4 * This file is Free Software under the GNU AGPL (>=v3)
5844 4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	5 * and comes with ABSOLUTELY NO WARRANTY! Check out the
5992 4c3ccf2b0304 Removed trailing whitespace. Sascha L. Teichmann <teichmann@intevation.de> parents: 5844 diff changeset	6 * documentation coming with Dive4Elements River for details.
5844 4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	7 */
4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	8
5829 18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	9 package org.dive4elements.river.importer.parsers;
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	10
2845 a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	11 import java.io.File;
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	12 import java.io.IOException;
5049 b5e3df1feeb4 WaterlevelParser: Add Wst-Converting functionality. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5016 diff changeset	13 import java.math.BigDecimal;
2845 a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	14 import java.text.NumberFormat;
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	15 import java.text.ParseException;
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	16 import java.util.ArrayList;
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	17 import java.util.List;
2845 a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	18 import java.util.regex.Matcher;
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	19 import java.util.regex.Pattern;
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	20
2845 a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	21 import org.apache.log4j.Logger;
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	22
6319 550cb41d37d9 issue1354: TimeIntervals in Waterlevels from csv files. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6282 diff changeset	23 import org.dive4elements.river.importer.ImportTimeInterval;
5829 18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	24 import org.dive4elements.river.importer.ImportUnit;
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	25
5829 18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	26 import org.dive4elements.river.importer.ImportRange;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	27 import org.dive4elements.river.importer.ImportWst;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	28 import org.dive4elements.river.importer.ImportWstColumn;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	29 import org.dive4elements.river.importer.ImportWstColumnValue;
18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	30 import org.dive4elements.river.importer.ImportWstQRange;
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	31
5049 b5e3df1feeb4 WaterlevelParser: Add Wst-Converting functionality. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5016 diff changeset	32
b5e3df1feeb4 WaterlevelParser: Add Wst-Converting functionality. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5016 diff changeset	33 /**
b5e3df1feeb4 WaterlevelParser: Add Wst-Converting functionality. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5016 diff changeset	34 * Parse CSV Waterlevel files.
b5e3df1feeb4 WaterlevelParser: Add Wst-Converting functionality. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5016 diff changeset	35 * As these waterlevels are probably used in fixation analysis
b5e3df1feeb4 WaterlevelParser: Add Wst-Converting functionality. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5016 diff changeset	36 * only, functionality to export them to "fixation"-wsts
b5e3df1feeb4 WaterlevelParser: Add Wst-Converting functionality. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5016 diff changeset	37 * has been added (the ImportWaterlevel*- stuff is actually
b5e3df1feeb4 WaterlevelParser: Add Wst-Converting functionality. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5016 diff changeset	38 * not needed to do so.)
b5e3df1feeb4 WaterlevelParser: Add Wst-Converting functionality. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5016 diff changeset	39 */
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	40 public class WaterlevelParser extends LineParser {
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	41
2845 a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	42 private static final Logger log = Logger.getLogger(WaterlevelParser.class);
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	43
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	44 private static final NumberFormat nf =
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	45 NumberFormat.getInstance(DEFAULT_LOCALE);
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	46
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	47 private static final Pattern META_Q_RANGE =
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	48 Pattern.compile("Abfluss\\s\\[(.)\\];(.)");
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	49
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	50 public static final Pattern META_UNIT =
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	51 Pattern.compile("^Einheit: \\[(.)\\].");
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	52
5240 9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	53 private List<ImportWst> waterlevels;
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	54
5240 9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	55 private ImportWst current;
9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	56
9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	57 /** The Waterlevel-Wst s will always have but one column. */
9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	58 private ImportWstColumn column;
2845 a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	59
5240 9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	60 /** The current (incomplete) Q Range. */
9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	61 private ImportWstQRange currentQRange;
9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	62
9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	63 /** The current (incomplete) km range for Q Range. */
9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	64 private ImportRange currentRange;
9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	65
2845 a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	66 private String currentDescription;
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	67
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	68
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	69 public WaterlevelParser() {
5240 9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	70 waterlevels = new ArrayList<ImportWst>();
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	71 }
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	72
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	73
5240 9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	74 public List<ImportWst> getWaterlevels() {
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	75 return waterlevels;
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	76 }
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	77
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	78
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	79 @Override
2845 a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	80 public void parse(File file) throws IOException {
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	81 currentDescription = file.getName();
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	82
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	83 super.parse(file);
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	84 }
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	85
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	86
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	87 @Override
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	88 protected void reset() {
5240 9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	89 currentQRange = null;
9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	90 current = new ImportWst(currentDescription);
5264 731030b69c7e Fix Waterlevel-Parser to correctly register the wst-columns. Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5247 diff changeset	91 current.setNumberColumns(1);
731030b69c7e Fix Waterlevel-Parser to correctly register the wst-columns. Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5247 diff changeset	92 column = current.getColumn(0);
731030b69c7e Fix Waterlevel-Parser to correctly register the wst-columns. Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5247 diff changeset	93 column.setName(currentDescription);
731030b69c7e Fix Waterlevel-Parser to correctly register the wst-columns. Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5247 diff changeset	94 column.setDescription(currentDescription);
6319 550cb41d37d9 issue1354: TimeIntervals in Waterlevels from csv files. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6282 diff changeset	95
550cb41d37d9 issue1354: TimeIntervals in Waterlevels from csv files. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6282 diff changeset	96 // Try to extract and set the TimeInterval.
550cb41d37d9 issue1354: TimeIntervals in Waterlevels from csv files. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6282 diff changeset	97 Matcher m = WaterlevelDifferencesParser.YEARS_IN_COLUMN.matcher(currentDescription);
550cb41d37d9 issue1354: TimeIntervals in Waterlevels from csv files. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6282 diff changeset	98
550cb41d37d9 issue1354: TimeIntervals in Waterlevels from csv files. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6282 diff changeset	99 if (m.matches()) {
550cb41d37d9 issue1354: TimeIntervals in Waterlevels from csv files. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6282 diff changeset	100 int startYear = Integer.parseInt(m.group(1));
550cb41d37d9 issue1354: TimeIntervals in Waterlevels from csv files. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6282 diff changeset	101 int endYear = Integer.parseInt(m.group(2));
550cb41d37d9 issue1354: TimeIntervals in Waterlevels from csv files. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6282 diff changeset	102 ImportTimeInterval time = new ImportTimeInterval(
550cb41d37d9 issue1354: TimeIntervals in Waterlevels from csv files. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6282 diff changeset	103 getStartDateFromYear(startYear),
550cb41d37d9 issue1354: TimeIntervals in Waterlevels from csv files. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6282 diff changeset	104 getEndDateFromYear(endYear)
550cb41d37d9 issue1354: TimeIntervals in Waterlevels from csv files. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6282 diff changeset	105 );
550cb41d37d9 issue1354: TimeIntervals in Waterlevels from csv files. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6282 diff changeset	106 column.setTimeInterval(time);
550cb41d37d9 issue1354: TimeIntervals in Waterlevels from csv files. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6282 diff changeset	107 } else {
550cb41d37d9 issue1354: TimeIntervals in Waterlevels from csv files. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6282 diff changeset	108 log.debug("No time interval in column header found: " + currentDescription);
550cb41d37d9 issue1354: TimeIntervals in Waterlevels from csv files. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6282 diff changeset	109 }
550cb41d37d9 issue1354: TimeIntervals in Waterlevels from csv files. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6282 diff changeset	110
6282 62dca91ca229 Switch wst-kind of waterlevel/-differences (7 and 6). Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5992 diff changeset	111 current.setKind(7);
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	112 }
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	113
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	114
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	115 @Override
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	116 protected void finish() {
2845 a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	117 if (current != null) {
5240 9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	118 if (currentQRange != null) {
9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	119 List<ImportWstColumnValue> cValues = column.getColumnValues();
9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	120 // Set end of range to last station.
9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	121 currentRange.setB(cValues.get(cValues.size() -1).getPosition());
9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	122 currentQRange.setRange(currentRange);
9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	123 column.addColumnQRange(currentQRange);
2845 a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	124 }
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	125
2845 a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	126 waterlevels.add(current);
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	127 }
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	128 }
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	129
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	130 @Override
4193 f63b39799d2d Adapted DB schema (added relation measurement_station); improved importer to read files from filesystem with measurement stations. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2845 diff changeset	131 protected void handleLine(int lineNum, String line) {
2845 a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	132 if (line.startsWith(START_META_CHAR)) {
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	133 handleMetaLine(stripMetaLine(line));
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	134 return;
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	135 }
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	136 else if (handleQRange(line)) {
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	137 return;
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	138 }
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	139 else {
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	140 handleDataLine(line);
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	141 return;
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	142 }
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	143 }
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	144
2845 a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	145
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	146 private void handleMetaLine(String meta) {
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	147 Matcher m = META_UNIT.matcher(meta);
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	148
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	149 if (m.matches()) {
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	150 String unit = m.group(1);
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	151 log.debug("Found unit: '" + unit + "'");
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	152
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	153 current.setUnit(new ImportUnit(unit));
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	154 }
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	155 }
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	156
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	157
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	158 private boolean handleQRange(String line) {
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	159 Matcher m = META_Q_RANGE.matcher(line);
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	160
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	161 if (m.matches()) {
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	162 String unitStr = m.group(1);
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	163 String valueStr = m.group(2);
5240 9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	164 try {
9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	165 if (currentQRange != null) {
9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	166 // Finish off the last one.
9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	167 List<ImportWstColumnValue> cValues = column.getColumnValues();
9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	168 // Set end of range to last station.
9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	169 currentRange.setB(cValues.get(cValues.size() -1).getPosition());
9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	170 currentQRange.setRange(currentRange);
9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	171 column.addColumnQRange(currentQRange);
2845 a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	172 }
5240 9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	173 currentQRange = new ImportWstQRange(null,
9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	174 new BigDecimal(nf.parse(valueStr).doubleValue()));
9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	175 currentRange = new ImportRange();
2845 a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	176
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	177 log.debug("Found new Q range: Q=" + valueStr);
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	178
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	179 return true;
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	180 }
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	181 catch (ParseException pe) {
5490 b3dd14fc13a6 Parsers: do not call warnings error Tom Gottfried <tom.gottfried@intevation.de> parents: 5264 diff changeset	182 log.warn("Unparseable Q range: '" + line + "'");
2845 a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	183 }
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	184 }
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	185
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	186 return false;
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	187 }
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	188
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	189
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	190 private void handleDataLine(String line) {
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	191 String[] cols = line.split(SEPERATOR_CHAR);
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	192
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	193 if (cols == null \|\| cols.length < 2) {
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	194 log.warn("skip invalid waterlevel line: '" + line + "'");
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	195 return;
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	196 }
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	197
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	198 try {
5240 9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	199 // Store the value and remember the position for QRange, if needed.
2845 a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	200 Double station = nf.parse(cols[0]).doubleValue();
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	201 Double value = nf.parse(cols[1]).doubleValue();
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	202
5240 9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	203 BigDecimal stationBD = new BigDecimal(station);
9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	204
9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	205 column.addColumnValue(stationBD, new BigDecimal(value));
9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	206
9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	207 if (currentRange.getA() == null) {
9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	208 currentRange.setA(stationBD);
9c024718bffb WaterlevelParser: Use Wst-structures directly (instead of Waterlevel). Felix Wolfsteller <felix.wolfsteller@intevation.de>* parents: 5231 diff changeset	209 }
2845 a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	210 }
a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	211 catch (ParseException pe) {
5490 b3dd14fc13a6 Parsers: do not call warnings error Tom Gottfried <tom.gottfried@intevation.de> parents: 5264 diff changeset	212 log.warn("Unparseable number in data row: " + line);
2845 a65b5b0ade6f Completed the MINFO waterlevel import. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2844 diff changeset	213 }
2844 c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	214 }
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	215 }
c4db0f75a94a Prepared the importer to import MINFO specific waterlevel values and added a stub for a parser. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	216 // vim:set ts=4 sw=4 si et sta sts=4 fenc=utf8 :

Mercurial > dive4elements > river

annotate backend/src/main/java/org/dive4elements/river/importer/parsers/WaterlevelParser.java @ 6328:53d08f33d094