dive4elements/river: backend/src/main/java/org/dive4elements/river/importer/parsers/PRFParser.java annotate

annotate backend/src/main/java/org/dive4elements/river/importer/parsers/PRFParser.java @ 5925:59f6a47822a4

PRFParser: Ignore skip-lines field, simplifies code a bit.

author	Felix Wolfsteller <felix.wolfsteller@intevation.de>
date	Wed, 08 May 2013 15:04:04 +0200
parents	454b7b455cb6
children	4d526e313fa0

rev	line source
5844 4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	1 /* Copyright (C) 2011, 2012, 2013 by Bundesanstalt für Gewässerkunde
4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	2 * Software engineering by Intevation GmbH
4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	3 *
4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	4 * This file is Free Software under the GNU AGPL (>=v3)
4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	5 * and comes with ABSOLUTELY NO WARRANTY! Check out the
4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	6 * documentation coming with Dive4Elements River for details.
4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	7 */
4dd33b86dc61 Added header to river backend. Sascha L. Teichmann <teichmann@intevation.de> parents: 5838 diff changeset	8
5829 18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	9 package org.dive4elements.river.importer.parsers;
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	10
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	11 import java.util.Map;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	12 import java.util.TreeMap;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	13 import java.util.List;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	14 import java.util.ArrayList;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	15 import java.util.Collections;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	16
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	17 import java.util.regex.Pattern;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	18 import java.util.regex.Matcher;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	19
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	20 import java.io.File;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	21 import java.io.InputStreamReader;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	22 import java.io.LineNumberReader;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	23 import java.io.FileInputStream;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	24 import java.io.IOException;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	25
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	26 import org.apache.log4j.Logger;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	27
5829 18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	28 import org.dive4elements.river.importer.XY;
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	29
5829 18619c1e7c2a Repaired internal references. Sascha L. Teichmann <teichmann@intevation.de> parents: 5828 diff changeset	30 import org.dive4elements.artifacts.common.utils.FileTools;
1213 cc88db4a5b34 Added method Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	31
4680 e8381265871f Doc. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 3660 diff changeset	32
e8381265871f Doc. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 3660 diff changeset	33 /**
e8381265871f Doc. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 3660 diff changeset	34 * Parse files in .prf format and generate a mapping of double
e8381265871f Doc. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 3660 diff changeset	35 * (km) to List of Points (XY).
e8381265871f Doc. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 3660 diff changeset	36 */
4715 2f7a509f5acf Implement new CrossSectionParser interface. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4680 diff changeset	37 public class PRFParser implements CrossSectionParser
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	38 {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	39 private static Logger log = Logger.getLogger(PRFParser.class);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	40
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	41 public static final String ENCODING =
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	42 System.getProperty("flys.backend.prf.encoding", "ISO-8859-1");
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	43
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	44 public static final Pattern DATA_PATTERN =
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	45 Pattern.compile(
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	46 "\\((\\d+)x\\s,\\s(\\d+)\\(" +
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	47 "\\sf(\\d+)\\.(\\d+)\\s,\\sf(\\d+)\\.(\\d+)\\s\\)?\\)?");
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	48
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	49 public static final Pattern KM_PATTERN =
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	50 Pattern.compile("\\((\\d+)x\\s,\\sf(\\d+)\\.(\\d+)\\s*\\)?");
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	51
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	52 public static final Pattern YEAR_PATTERN =
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	53 Pattern.compile("(\\d{4})");
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	54
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	55 public static final int MIN_YEAR = 1800;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	56 public static final int MAX_YEAR = 2100;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	57
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	58 public static class DataFormat {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	59
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	60 protected int deleteChars;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	61 protected int maxRepetitions;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	62 protected int firstIntegerPlaces;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	63 protected int firstFractionPlaces;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	64 protected int secondIntegerPlaces;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	65 protected int secondFractionPlaces;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	66
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	67 protected double firstShift;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	68 protected double secondShift;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	69
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	70 public DataFormat() {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	71 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	72
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	73 public DataFormat(Matcher m) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	74 deleteChars = Integer.parseInt(m.group(1));
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	75 maxRepetitions = Integer.parseInt(m.group(2));
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	76 firstIntegerPlaces = Integer.parseInt(m.group(3));
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	77 firstFractionPlaces = Integer.parseInt(m.group(4));
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	78 secondIntegerPlaces = Integer.parseInt(m.group(5));
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	79 secondFractionPlaces = Integer.parseInt(m.group(6));
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	80
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	81 firstShift = Math.pow(10, firstFractionPlaces);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	82 secondShift = Math.pow(10, secondFractionPlaces);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	83 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	84
5924 454b7b455cb6 PRFParser: Documentation. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5844 diff changeset	85 /**
454b7b455cb6 PRFParser: Documentation. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5844 diff changeset	86 * @param kmData where data points will be added to.
454b7b455cb6 PRFParser: Documentation. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5844 diff changeset	87 * @param line Line to parse.
454b7b455cb6 PRFParser: Documentation. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5844 diff changeset	88 */
5925 59f6a47822a4 PRFParser: Ignore skip-lines field, simplifies code a bit. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5924 diff changeset	89 public void extractData(String line, List<XY> kmData) {
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	90 int L = line.length();
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	91 if (L <= deleteChars) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	92 return -1;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	93 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	94
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	95 int pos = deleteChars;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	96
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	97 boolean debug = log.isDebugEnabled();
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	98
5924 454b7b455cb6 PRFParser: Documentation. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5844 diff changeset	99 // Repetitions are values per line ( ... 10.0 12.5 15.3 ... )
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	100 int rep = 0;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	101 for (;rep < maxRepetitions; ++rep) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	102 if (pos >= L \|\| pos + firstIntegerPlaces >= L) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	103 break;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	104 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	105 String first = line.substring(
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	106 pos, pos + firstIntegerPlaces);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	107
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	108 String second = line.substring(
3334 2ae732e2c65c FLYS backend: Removed trailing whitespace. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1234 diff changeset	109 pos + firstIntegerPlaces,
5924 454b7b455cb6 PRFParser: Documentation. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5844 diff changeset	110 Math.min(L, pos + firstIntegerPlaces + secondIntegerPlaces));
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	111
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	112 double x, y;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	113 try {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	114 x = Double.parseDouble(first);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	115 y = Double.parseDouble(second);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	116 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	117 catch (NumberFormatException nfe) {
5925 59f6a47822a4 PRFParser: Ignore skip-lines field, simplifies code a bit. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5924 diff changeset	118 // "Dummy" line to separate datasets, or missing values.
59f6a47822a4 PRFParser: Ignore skip-lines field, simplifies code a bit. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5924 diff changeset	119 log.debug("PRFParser: Broken line: " + line);
59f6a47822a4 PRFParser: Ignore skip-lines field, simplifies code a bit. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5924 diff changeset	120 return;
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	121 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	122
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	123 if (first.indexOf('.') < 0) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	124 x /= firstShift;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	125 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	126
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	127 if (firstFractionPlaces > 0) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	128 x = (int)(x*firstShift)/firstShift;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	129 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	130
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	131 if (second.indexOf('.') < 0) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	132 y /= secondShift;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	133 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	134
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	135 if (secondFractionPlaces > 0) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	136 y = (int)(y*secondShift)/secondShift;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	137 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	138
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	139 kmData.add(new XY(x, y, kmData.size()));
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	140
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	141 pos += firstIntegerPlaces + secondIntegerPlaces;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	142 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	143
5925 59f6a47822a4 PRFParser: Ignore skip-lines field, simplifies code a bit. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5924 diff changeset	144 return;
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	145 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	146 } // class DataFormat
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	147
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	148 public static class KMFormat {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	149
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	150 protected int deleteChars;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	151 protected int integerPlaces;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	152 protected int fractionPlaces;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	153
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	154 protected double shift;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	155
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	156 public KMFormat() {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	157 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	158
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	159 public KMFormat(Matcher m) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	160 deleteChars = Integer.parseInt(m.group(1));
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	161 integerPlaces = Integer.parseInt(m.group(2));
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	162 fractionPlaces = Integer.parseInt(m.group(3));
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	163
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	164 shift = Math.pow(10, fractionPlaces);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	165 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	166
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	167 public double extractKm(String line) throws NumberFormatException {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	168
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	169 if (line.length() <= deleteChars) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	170 throw new NumberFormatException("line too short");
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	171 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	172
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	173 String kmS =
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	174 line.substring(deleteChars, deleteChars+integerPlaces);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	175
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	176 double km = Double.parseDouble(kmS.trim());
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	177
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	178 if (kmS.indexOf('.') < 0) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	179 km /= shift;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	180 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	181
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	182 return fractionPlaces > 0
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	183 ? ((int)(km*shift))/shift
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	184 : km;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	185 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	186 } // class KMFormat
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	187
5924 454b7b455cb6 PRFParser: Documentation. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5844 diff changeset	188 /** Mapping stations (km) to measured points. */
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	189 protected Map<Double, List<XY>> data;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	190
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	191 protected Integer year;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	192
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	193 protected String description;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	194
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	195
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	196 public PRFParser() {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	197 data = new TreeMap<Double, List<XY>>();
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	198 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	199
4715 2f7a509f5acf Implement new CrossSectionParser interface. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4680 diff changeset	200 @Override
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	201 public Integer getYear() {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	202 return year;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	203 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	204
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	205 public void setYear(Integer year) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	206 this.year = year;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	207 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	208
4715 2f7a509f5acf Implement new CrossSectionParser interface. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4680 diff changeset	209 @Override
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	210 public String getDescription() {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	211 return description;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	212 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	213
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	214 public void setDescription(String description) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	215 this.description = description;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	216 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	217
4715 2f7a509f5acf Implement new CrossSectionParser interface. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4680 diff changeset	218 @Override
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	219 public Map<Double, List<XY>> getData() {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	220 return data;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	221 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	222
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	223 public void setData(Map<Double, List<XY>> data) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	224 this.data = data;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	225 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	226
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	227 protected void sortLists() {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	228 for (List<XY> xy: data.values()) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	229 Collections.sort(xy);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	230 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	231 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	232
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	233 public static final Integer findYear(String s) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	234 Matcher m = YEAR_PATTERN.matcher(s);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	235 while (m.find()) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	236 int year = Integer.parseInt(m.group(1));
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	237 if (year >= MIN_YEAR && year <= MAX_YEAR) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	238 return Integer.valueOf(year);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	239 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	240 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	241 return null;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	242 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	243
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	244 public boolean parse(File file) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	245
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	246 if (!(file.isFile() && file.canRead())) {
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	247 log.warn("PRF: cannot open file '" + file + "'");
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	248 return false;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	249 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	250
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	251 log.info("parsing PRF file: '" + file + "'");
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	252
4729 0df1cac6c4b5 Removed removeExtension implementations, which have been moved to FileTools, Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4715 diff changeset	253 description = FileTools.removeExtension(file.getName());
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	254
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	255 year = findYear(file.getName());
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	256
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	257 if (year == null) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	258 File parent = file.getParentFile();
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	259 if (parent != null) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	260 description = parent.getName() + "/" + description;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	261 year = findYear(parent.getName());
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	262 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	263 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	264
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	265 if (year != null) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	266 log.info("year of sounding: " + year);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	267 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	268
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	269 LineNumberReader in = null;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	270
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	271 try {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	272 in =
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	273 new LineNumberReader(
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	274 new InputStreamReader(
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	275 new FileInputStream(file), ENCODING));
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	276
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	277 String line = in.readLine();
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	278
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	279 if (line == null \|\| (line = line.trim()).length() == 0) {
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	280 log.warn("PRF: file is empty.");
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	281 return false;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	282 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	283
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	284 Matcher m = DATA_PATTERN.matcher(line);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	285
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	286 if (!m.matches()) {
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	287 log.warn("PRF: First line does not look like a PRF data pattern.");
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	288 return false;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	289 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	290
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	291 DataFormat dataFormat = new DataFormat(m);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	292
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	293 if ((line = in.readLine()) == null
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	294 \|\| (line = line.trim()).length() == 0) {
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	295 log.warn("PRF: premature EOF. Expected integer in line 2");
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	296 return false;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	297 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	298
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	299 try {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	300 if (Integer.parseInt(line) != dataFormat.maxRepetitions) {
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	301 log.warn("PRF: Expected " +
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	302 dataFormat.maxRepetitions + " in line 2");
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	303 return false;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	304 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	305 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	306 catch (NumberFormatException nfe) {
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	307 log.warn("PRF: invalid integer in line 2", nfe);
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	308 return false;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	309 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	310
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	311 if ((line = in.readLine()) == null) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	312 log.warn(
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	313 "PRF: premature EOF. Expected pattern for km extraction");
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	314 return false;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	315 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	316
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	317 m = KM_PATTERN.matcher(line);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	318
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	319 if (!m.matches()) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	320 log.warn(
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	321 "PRF: line 4 does not look like a PRF km extraction pattern.");
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	322 return false;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	323 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	324
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	325 KMFormat kmFormat = new KMFormat(m);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	326
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	327 if ((line = in.readLine()) == null
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	328 \|\| (line = line.trim()).length() == 0) {
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	329 log.warn("PRF: premature EOF. Expected skip row count.");
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	330 return false;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	331 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	332
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	333 int lineSkipCount;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	334 try {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	335 if ((lineSkipCount = Integer.parseInt(line)) < 0) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	336 throw new IllegalArgumentException(lineSkipCount + " < 0");
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	337 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	338 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	339 catch (NumberFormatException nfe) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	340 log.warn(
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	341 "PRF: line 5 is not an positive integer.");
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	342 return false;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	343 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	344
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	345 while ((line = in.readLine()) != null) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	346 double km;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	347 try {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	348 km = kmFormat.extractKm(line);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	349 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	350 catch (NumberFormatException iae) {
3660 976ead36192d backend: Mention backend warnings in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3659 diff changeset	351 log.warn("PRF: cannot extract km in line " + in.getLineNumber());
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	352 return false;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	353 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	354
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	355 Double station = Double.valueOf(km);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	356
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	357 List<XY> kmData = data.get(station);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	358
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	359 if (kmData == null) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	360 //log.debug("found new km: " + station);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	361 kmData = new ArrayList<XY>();
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	362 data.put(station, kmData);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	363 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	364
5925 59f6a47822a4 PRFParser: Ignore skip-lines field, simplifies code a bit. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 5924 diff changeset	365 dataFormat.extractData(line, kmData);
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	366 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	367
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	368 // sort all the lists by x and index
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	369 sortLists();
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	370 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	371 catch (IOException ioe) {
3659 36edf9a71cbd backend: Mention backend errors in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3340 diff changeset	372 log.error("Error reading PRF file.", ioe);
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	373 return false;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	374 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	375 finally {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	376 if (in != null) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	377 try {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	378 in.close();
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	379 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	380 catch (IOException ioe) {
3659 36edf9a71cbd backend: Mention backend errors in importer. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 3340 diff changeset	381 log.error("Error closing PRF file.", ioe);
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	382 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	383 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	384 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	385
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	386 return true;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	387 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	388
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	389 public void reset() {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	390 data.clear();
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	391 year = null;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	392 description = null;
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	393 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	394
4715 2f7a509f5acf Implement new CrossSectionParser interface. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4680 diff changeset	395 public void parsePRFs(File root, final CrossSectionParser.Callback callback) {
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	396
1213 cc88db4a5b34 Added method Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	397 FileTools.walkTree(root, new FileTools.FileVisitor() {
cc88db4a5b34 Added method Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	398 @Override
cc88db4a5b34 Added method Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	399 public boolean visit(File file) {
1216 f8b5c37f15e4 Fixes for the HYK parser Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1213 diff changeset	400 if (file.isFile() && file.canRead()
1213 cc88db4a5b34 Added method Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	401 && file.getName().toLowerCase().endsWith(".prf")
4715 2f7a509f5acf Implement new CrossSectionParser interface. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4680 diff changeset	402 && (callback == null \|\| callback.accept(file))) {
1213 cc88db4a5b34 Added method Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	403 reset();
cc88db4a5b34 Added method Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	404 boolean success = parse(file);
cc88db4a5b34 Added method Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	405 log.info("parsing " + (success ? "succeeded" : "failed"));
cc88db4a5b34 Added method Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	406 if (success && callback != null) {
4715 2f7a509f5acf Implement new CrossSectionParser interface. Felix Wolfsteller <felix.wolfsteller@intevation.de> parents: 4680 diff changeset	407 callback.parsed(PRFParser.this);
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	408 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	409 }
1213 cc88db4a5b34 Added method Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	410 return true;
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	411 }
1213 cc88db4a5b34 Added method Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1211 diff changeset	412 });
1211 f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	413 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	414
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	415 public static void main(String [] args) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	416
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	417 PRFParser parser = new PRFParser();
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	418
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	419 for (String arg: args) {
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	420 parser.parsePRFs(new File(arg), null);
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	421 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	422 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	423 }
f08fe480092c Moved file parsers to separate package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	424 // vim:set ts=4 sw=4 si et sta sts=4 fenc=utf8 :

Mercurial > dive4elements > river

annotate backend/src/main/java/org/dive4elements/river/importer/parsers/PRFParser.java @ 5925:59f6a47822a4