dive4elements/river: backend/src/main/java/org/dive4elements/river/importer/parsers/PRFParser.java annotate

annotate backend/src/main/java/org/dive4elements/river/importer/parsers/PRFParser.java @ 9801:1d7a72a50183 3.2.x tip

Assume Compose V2, consistently

author	Tom Gottfried <tom@intevation.de>
date	Thu, 23 Nov 2023 10:14:13 +0100
parents	0a5239a1e46e
children

rev	line source
5844 4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	1 /* Copyright (C) 2011, 2012, 2013 by Bundesanstalt für Gewässerkunde
4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	2 * Software engineering by Intevation GmbH
4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	3 *
5992 4c3ccf2b0304 Removed trailing whitespace. Sascha L. Teichmann <teichmann@intevation.de> parents: 5929 diff changeset	4 * This file is Free Software under the GNU AGPL (>=v3)
5844 4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	5 * and comes with ABSOLUTELY NO WARRANTY! Check out the
5992 4c3ccf2b0304 Removed trailing whitespace. Sascha L. Teichmann <teichmann@intevation.de> parents: 5929 diff changeset	6 * documentation coming with Dive4Elements River for details.
5844 4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	7 */
4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	8
5829 18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	9 package org.dive4elements.river.importer.parsers;
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	10
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	11 import java.util.Map;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	12 import java.util.TreeMap;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	13 import java.util.List;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	14 import java.util.ArrayList;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	15 import java.util.Collections;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	16
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	17 import java.util.regex.Pattern;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	18 import java.util.regex.Matcher;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	19
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	20 import java.io.File;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	21 import java.io.InputStreamReader;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	22 import java.io.LineNumberReader;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	23 import java.io.FileInputStream;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	24 import java.io.IOException;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	25
9726 0a5239a1e46e Upgrade to Log4j 2 Tom Gottfried <tom@intevation.de> parents: 8856 diff changeset	26 import org.apache.logging.log4j.Logger;
0a5239a1e46e Upgrade to Log4j 2 Tom Gottfried <tom@intevation.de> parents: 8856 diff changeset	27 import org.apache.logging.log4j.LogManager;
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	28
5829 18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	29 import org.dive4elements.river.importer.XY;
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	30
5829 18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	31 import org.dive4elements.artifacts.common.utils.FileTools;
1213 cc88db4a5b34 Added method Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	32
4680 e8381265871f Doc. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 3660 diff changeset	33
e8381265871f Doc. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 3660 diff changeset	34 /**
e8381265871f Doc. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 3660 diff changeset	35 * Parse files in .prf format and generate a mapping of double
e8381265871f Doc. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 3660 diff changeset	36 * (km) to List of Points (XY).
e8381265871f Doc. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 3660 diff changeset	37 */
4715 2f7a509f5acf Implement new CrossSectionParser interface. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4680 diff changeset	38 public class PRFParser implements CrossSectionParser
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	39 {
9726 0a5239a1e46e Upgrade to Log4j 2 Tom Gottfried <tom@intevation.de> parents: 8856 diff changeset	40 private static Logger log = LogManager.getLogger(PRFParser.class);
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	41
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	42 public static final String ENCODING =
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	43 System.getProperty("flys.backend.prf.encoding", "ISO-8859-1");
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	44
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	45 public static final Pattern DATA_PATTERN =
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	46 Pattern.compile(
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	47 "\\((\\d+)x\\s,\\s(\\d+)\\(" +
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	48 "\\sf(\\d+)\\.(\\d+)\\s,\\sf(\\d+)\\.(\\d+)\\s\\)?\\)?");
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	49
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	50 public static final Pattern KM_PATTERN =
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	51 Pattern.compile("\\((\\d+)x\\s,\\sf(\\d+)\\.(\\d+)\\s*\\)?");
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	52
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	53 public static final Pattern YEAR_PATTERN =
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	54 Pattern.compile("(\\d{4})");
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	55
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	56 public static final int MIN_YEAR = 1800;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	57 public static final int MAX_YEAR = 2100;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	58
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	59 public static class DataFormat {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	60
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	61 protected int deleteChars;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	62 protected int maxRepetitions;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	63 protected int firstIntegerPlaces;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	64 protected int firstFractionPlaces;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	65 protected int secondIntegerPlaces;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	66 protected int secondFractionPlaces;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	67
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	68 protected double firstShift;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	69 protected double secondShift;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	70
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	71 public DataFormat() {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	72 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	73
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	74 public DataFormat(Matcher m) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	75 deleteChars = Integer.parseInt(m.group(1));
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	76 maxRepetitions = Integer.parseInt(m.group(2));
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	77 firstIntegerPlaces = Integer.parseInt(m.group(3));
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	78 firstFractionPlaces = Integer.parseInt(m.group(4));
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	79 secondIntegerPlaces = Integer.parseInt(m.group(5));
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	80 secondFractionPlaces = Integer.parseInt(m.group(6));
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	81
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	82 firstShift = Math.pow(10, firstFractionPlaces);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	83 secondShift = Math.pow(10, secondFractionPlaces);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	84 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	85
5924 454b7b455cb6 PRFParser: Documentation. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5844 diff changeset	86 /**
454b7b455cb6 PRFParser: Documentation. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5844 diff changeset	87 * @param kmData where data points will be added to.
454b7b455cb6 PRFParser: Documentation. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5844 diff changeset	88 * @param line Line to parse.
454b7b455cb6 PRFParser: Documentation. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5844 diff changeset	89 */
5925 59f6a47822a4 PRFParser: Ignore skip-lines field, simplifies code a bit. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5924 diff changeset	90 public void extractData(String line, List<XY> kmData) {
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	91 int L = line.length();
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	92 if (L <= deleteChars) {
5929 4d526e313fa0 Fixed build error. Is this really supposed to work? Sascha L. Teichmann <teichmann@intevation.de> parents: 5925 diff changeset	93 return;
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	94 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	95
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	96 int pos = deleteChars;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	97
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	98 boolean debug = log.isDebugEnabled();
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	99
5924 454b7b455cb6 PRFParser: Documentation. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5844 diff changeset	100 // Repetitions are values per line ( ... 10.0 12.5 15.3 ... )
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	101 int rep = 0;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	102 for (;rep < maxRepetitions; ++rep) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	103 if (pos >= L \|\| pos + firstIntegerPlaces >= L) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	104 break;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	105 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	106 String first = line.substring(
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	107 pos, pos + firstIntegerPlaces);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	108
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	109 String second = line.substring(
3334 2ae732e2c65c FLYS backend: Removed trailing whitespace. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1234 diff changeset	110 pos + firstIntegerPlaces,
8856 5e38e2924c07 Fix code style. Tom Gottfried <tom@intevation.de> parents: 6442 diff changeset	111 Math.min(
5e38e2924c07 Fix code style. Tom Gottfried <tom@intevation.de> parents: 6442 diff changeset	112 L, pos + firstIntegerPlaces + secondIntegerPlaces));
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	113
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	114 double x, y;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	115 try {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	116 x = Double.parseDouble(first);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	117 y = Double.parseDouble(second);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	118 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	119 catch (NumberFormatException nfe) {
5925 59f6a47822a4 PRFParser: Ignore skip-lines field, simplifies code a bit. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5924 diff changeset	120 // "Dummy" line to separate datasets, or missing values.
59f6a47822a4 PRFParser: Ignore skip-lines field, simplifies code a bit. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5924 diff changeset	121 log.debug("PRFParser: Broken line: " + line);
59f6a47822a4 PRFParser: Ignore skip-lines field, simplifies code a bit. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5924 diff changeset	122 return;
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	123 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	124
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	125 if (first.indexOf('.') < 0) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	126 x /= firstShift;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	127 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	128
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	129 if (firstFractionPlaces > 0) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	130 x = (int)(x*firstShift)/firstShift;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	131 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	132
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	133 if (second.indexOf('.') < 0) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	134 y /= secondShift;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	135 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	136
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	137 if (secondFractionPlaces > 0) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	138 y = (int)(y*secondShift)/secondShift;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	139 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	140
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	141 kmData.add(new XY(x, y, kmData.size()));
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	142
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	143 pos += firstIntegerPlaces + secondIntegerPlaces;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	144 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	145
5925 59f6a47822a4 PRFParser: Ignore skip-lines field, simplifies code a bit. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5924 diff changeset	146 return;
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	147 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	148 } // class DataFormat
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	149
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	150 public static class KMFormat {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	151
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	152 protected int deleteChars;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	153 protected int integerPlaces;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	154 protected int fractionPlaces;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	155
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	156 protected double shift;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	157
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	158 public KMFormat() {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	159 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	160
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	161 public KMFormat(Matcher m) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	162 deleteChars = Integer.parseInt(m.group(1));
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	163 integerPlaces = Integer.parseInt(m.group(2));
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	164 fractionPlaces = Integer.parseInt(m.group(3));
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	165
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	166 shift = Math.pow(10, fractionPlaces);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	167 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	168
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	169 public double extractKm(String line) throws NumberFormatException {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	170
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	171 if (line.length() <= deleteChars) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	172 throw new NumberFormatException("line too short");
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	173 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	174
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	175 String kmS =
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	176 line.substring(deleteChars, deleteChars+integerPlaces);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	177
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	178 double km = Double.parseDouble(kmS.trim());
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	179
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	180 if (kmS.indexOf('.') < 0) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	181 km /= shift;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	182 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	183
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	184 return fractionPlaces > 0
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	185 ? ((int)(km*shift))/shift
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	186 : km;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	187 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	188 } // class KMFormat
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	189
5924 454b7b455cb6 PRFParser: Documentation. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5844 diff changeset	190 /** Mapping stations (km) to measured points. */
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	191 protected Map<Double, List<XY>> data;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	192
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	193 protected Integer year;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	194
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	195 protected String description;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	196
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	197
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	198 public PRFParser() {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	199 data = new TreeMap<Double, List<XY>>();
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	200 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	201
4715 2f7a509f5acf Implement new CrossSectionParser interface. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4680 diff changeset	202 @Override
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	203 public Integer getYear() {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	204 return year;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	205 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	206
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	207 public void setYear(Integer year) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	208 this.year = year;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	209 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	210
4715 2f7a509f5acf Implement new CrossSectionParser interface. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4680 diff changeset	211 @Override
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	212 public String getDescription() {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	213 return description;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	214 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	215
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	216 public void setDescription(String description) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	217 this.description = description;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	218 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	219
4715 2f7a509f5acf Implement new CrossSectionParser interface. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4680 diff changeset	220 @Override
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	221 public Map<Double, List<XY>> getData() {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	222 return data;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	223 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	224
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	225 public void setData(Map<Double, List<XY>> data) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	226 this.data = data;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	227 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	228
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	229 protected void sortLists() {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	230 for (List<XY> xy: data.values()) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	231 Collections.sort(xy);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	232 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	233 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	234
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	235 public static final Integer findYear(String s) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	236 Matcher m = YEAR_PATTERN.matcher(s);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	237 while (m.find()) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	238 int year = Integer.parseInt(m.group(1));
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	239 if (year >= MIN_YEAR && year <= MAX_YEAR) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	240 return Integer.valueOf(year);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	241 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	242 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	243 return null;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	244 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	245
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	246 public boolean parse(File file) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	247
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	248 if (!(file.isFile() && file.canRead())) {
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	249 log.warn("PRF: cannot open file '" + file + "'");
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	250 return false;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	251 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	252
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	253 log.info("parsing PRF file: '" + file + "'");
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	254
4729 0df1cac6c4b5 Removed removeExtension implementations, which have been moved to FileTools, Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4715 diff changeset	255 description = FileTools.removeExtension(file.getName());
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	256
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	257 year = findYear(file.getName());
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	258
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	259 if (year == null) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	260 File parent = file.getParentFile();
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	261 if (parent != null) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	262 description = parent.getName() + "/" + description;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	263 year = findYear(parent.getName());
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	264 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	265 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	266
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	267 if (year != null) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	268 log.info("year of sounding: " + year);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	269 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	270
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	271 LineNumberReader in = null;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	272
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	273 try {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	274 in =
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	275 new LineNumberReader(
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	276 new InputStreamReader(
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	277 new FileInputStream(file), ENCODING));
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	278
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	279 String line = in.readLine();
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	280
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	281 if (line == null \|\| (line = line.trim()).length() == 0) {
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	282 log.warn("PRF: file is empty.");
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	283 return false;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	284 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	285
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	286 Matcher m = DATA_PATTERN.matcher(line);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	287
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	288 if (!m.matches()) {
8856 5e38e2924c07 Fix code style. Tom Gottfried <tom@intevation.de> parents: 6442 diff changeset	289 log.warn(
5e38e2924c07 Fix code style. Tom Gottfried <tom@intevation.de> parents: 6442 diff changeset	290 "PRF: First line does not look like a PRF data pattern.");
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	291 return false;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	292 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	293
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	294 DataFormat dataFormat = new DataFormat(m);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	295
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	296 if ((line = in.readLine()) == null
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	297 \|\| (line = line.trim()).length() == 0) {
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	298 log.warn("PRF: premature EOF. Expected integer in line 2");
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	299 return false;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	300 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	301
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	302 try {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	303 if (Integer.parseInt(line) != dataFormat.maxRepetitions) {
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	304 log.warn("PRF: Expected " +
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	305 dataFormat.maxRepetitions + " in line 2");
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	306 return false;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	307 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	308 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	309 catch (NumberFormatException nfe) {
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	310 log.warn("PRF: invalid integer in line 2", nfe);
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	311 return false;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	312 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	313
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	314 if ((line = in.readLine()) == null) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	315 log.warn(
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	316 "PRF: premature EOF. Expected pattern for km extraction");
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	317 return false;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	318 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	319
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	320 m = KM_PATTERN.matcher(line);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	321
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	322 if (!m.matches()) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	323 log.warn(
8856 5e38e2924c07 Fix code style. Tom Gottfried <tom@intevation.de> parents: 6442 diff changeset	324 "PRF: line 4 does not look like "
5e38e2924c07 Fix code style. Tom Gottfried <tom@intevation.de> parents: 6442 diff changeset	325 + "a PRF km extraction pattern.");
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	326 return false;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	327 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	328
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	329 KMFormat kmFormat = new KMFormat(m);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	330
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	331 if ((line = in.readLine()) == null
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	332 \|\| (line = line.trim()).length() == 0) {
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	333 log.warn("PRF: premature EOF. Expected skip row count.");
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	334 return false;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	335 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	336
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	337 int lineSkipCount;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	338 try {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	339 if ((lineSkipCount = Integer.parseInt(line)) < 0) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	340 throw new IllegalArgumentException(lineSkipCount + " < 0");
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	341 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	342 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	343 catch (NumberFormatException nfe) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	344 log.warn(
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	345 "PRF: line 5 is not an positive integer.");
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	346 return false;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	347 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	348
6442 f3078357ec65 issue1313: Prevent double skip when looking at the first lines of a prf file. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6407 diff changeset	349 int skip = 0;
6015 e514cab94026 PRFParser: Re-enable line skipping. Act so on station change. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5992 diff changeset	350
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	351 while ((line = in.readLine()) != null) {
6015 e514cab94026 PRFParser: Re-enable line skipping. Act so on station change. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5992 diff changeset	352 // Expecting dummy lines.
e514cab94026 PRFParser: Re-enable line skipping. Act so on station change. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5992 diff changeset	353 if (skip > 0) {
e514cab94026 PRFParser: Re-enable line skipping. Act so on station change. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5992 diff changeset	354 skip--;
e514cab94026 PRFParser: Re-enable line skipping. Act so on station change. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5992 diff changeset	355 continue;
e514cab94026 PRFParser: Re-enable line skipping. Act so on station change. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5992 diff changeset	356 }
e514cab94026 PRFParser: Re-enable line skipping. Act so on station change. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5992 diff changeset	357
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	358 double km;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	359 try {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	360 km = kmFormat.extractKm(line);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	361 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	362 catch (NumberFormatException iae) {
8856 5e38e2924c07 Fix code style. Tom Gottfried <tom@intevation.de> parents: 6442 diff changeset	363 log.warn("PRF: cannot extract km in line "
5e38e2924c07 Fix code style. Tom Gottfried <tom@intevation.de> parents: 6442 diff changeset	364 + in.getLineNumber());
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	365 return false;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	366 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	367
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	368 Double station = Double.valueOf(km);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	369
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	370 List<XY> kmData = data.get(station);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	371
6407 3158f8f227bf issue1313: Use correct skip lines. In case of recognizing skip, the Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6015 diff changeset	372 // When the station changed (no data yet in line) we expect
3158f8f227bf issue1313: Use correct skip lines. In case of recognizing skip, the Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6015 diff changeset	373 // skip/dummy lines to follow
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	374 if (kmData == null) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	375 kmData = new ArrayList<XY>();
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	376 data.put(station, kmData);
8856 5e38e2924c07 Fix code style. Tom Gottfried <tom@intevation.de> parents: 6442 diff changeset	377 // When a station change occurs,
5e38e2924c07 Fix code style. Tom Gottfried <tom@intevation.de> parents: 6442 diff changeset	378 // dummy lines will occur, too.
6407 3158f8f227bf issue1313: Use correct skip lines. In case of recognizing skip, the Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 6015 diff changeset	379 skip = lineSkipCount -1;
6015 e514cab94026 PRFParser: Re-enable line skipping. Act so on station change. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5992 diff changeset	380 continue;
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	381 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	382
5925 59f6a47822a4 PRFParser: Ignore skip-lines field, simplifies code a bit. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5924 diff changeset	383 dataFormat.extractData(line, kmData);
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	384 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	385
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	386 // sort all the lists by x and index
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	387 sortLists();
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	388 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	389 catch (IOException ioe) {
3659 36edf9a71cbd backend: Mention backend errors in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3340 diff changeset	390 log.error("Error reading PRF file.", ioe);
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	391 return false;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	392 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	393 finally {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	394 if (in != null) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	395 try {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	396 in.close();
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	397 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	398 catch (IOException ioe) {
3659 36edf9a71cbd backend: Mention backend errors in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3340 diff changeset	399 log.error("Error closing PRF file.", ioe);
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	400 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	401 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	402 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	403
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	404 return true;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	405 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	406
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	407 public void reset() {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	408 data.clear();
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	409 year = null;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	410 description = null;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	411 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	412
8856 5e38e2924c07 Fix code style. Tom Gottfried <tom@intevation.de> parents: 6442 diff changeset	413 public void parsePRFs(
5e38e2924c07 Fix code style. Tom Gottfried <tom@intevation.de> parents: 6442 diff changeset	414 File root,
5e38e2924c07 Fix code style. Tom Gottfried <tom@intevation.de> parents: 6442 diff changeset	415 final CrossSectionParser.Callback callback
5e38e2924c07 Fix code style. Tom Gottfried <tom@intevation.de> parents: 6442 diff changeset	416 ) {
1213 cc88db4a5b34 Added method Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	417 FileTools.walkTree(root, new FileTools.FileVisitor() {
cc88db4a5b34 Added method Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	418 @Override
cc88db4a5b34 Added method Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	419 public boolean visit(File file) {
1216 f8b5c37f15e4 Fixes for the HYK parser Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1213 diff changeset	420 if (file.isFile() && file.canRead()
1213 cc88db4a5b34 Added method Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	421 && file.getName().toLowerCase().endsWith(".prf")
4715 2f7a509f5acf Implement new CrossSectionParser interface. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4680 diff changeset	422 && (callback == null \|\| callback.accept(file))) {
1213 cc88db4a5b34 Added method Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	423 reset();
cc88db4a5b34 Added method Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	424 boolean success = parse(file);
cc88db4a5b34 Added method Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	425 log.info("parsing " + (success ? "succeeded" : "failed"));
cc88db4a5b34 Added method Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	426 if (success && callback != null) {
4715 2f7a509f5acf Implement new CrossSectionParser interface. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4680 diff changeset	427 callback.parsed(PRFParser.this);
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	428 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	429 }
1213 cc88db4a5b34 Added method Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	430 return true;
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	431 }
1213 cc88db4a5b34 Added method Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	432 });
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	433 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	434
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	435 public static void main(String [] args) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	436
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	437 PRFParser parser = new PRFParser();
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	438
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	439 for (String arg: args) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	440 parser.parsePRFs(new File(arg), null);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	441 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	442 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	443 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	444 // vim:set ts=4 sw=4 si et sta sts=4 fenc=utf8 :

Mercurial > dive4elements > river

annotate backend/src/main/java/org/dive4elements/river/importer/parsers/PRFParser.java @ 9801:1d7a72a50183 3.2.x tip