dive4elements/river: backend/src/main/java/org/dive4elements/river/importer/sinfo/parsers/CollisionParser.java annotate

annotate backend/src/main/java/org/dive4elements/river/importer/sinfo/parsers/CollisionParser.java @ 9658:d86c7cb68b41

Importer (s/u-info) extensions: daily discharge: detecting, logging and skipping lines with missing date or q, or duplicate date, detecting wrong column titles and cancelling the import, specific error message if gauge not found

author	mschaefer
date	Mon, 23 Mar 2020 15:33:40 +0100
parents	8a2a777a8372
children	7c1da1b3f6b8

rev	line source
8971 50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	1 /* Copyright (C) 2017 by Bundesanstalt für Gewässerkunde
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	2 * Software engineering by
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	3 * Björnsen Beratende Ingenieure GmbH
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	4 * Dr. Schumacher Ingenieurbüro für Wasser und Umwelt
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	5 *
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	6 * This file is Free Software under the GNU AGPL (>=v3)
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	7 * and comes with ABSOLUTELY NO WARRANTY! Check out the
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	8 * documentation coming with Dive4Elements River for details.
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	9 */
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	10
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	11 package org.dive4elements.river.importer.sinfo.parsers;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	12
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	13 import java.io.File;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	14 import java.text.DateFormat;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	15 import java.text.SimpleDateFormat;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	16 import java.util.ArrayList;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	17 import java.util.Date;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	18 import java.util.EnumMap;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	19 import java.util.HashMap;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	20 import java.util.List;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	21 import java.util.regex.Matcher;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	22 import java.util.regex.Pattern;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	23
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	24 import org.apache.log4j.Logger;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	25 import org.dive4elements.river.importer.Config;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	26 import org.dive4elements.river.importer.ImportRiver;
9578 3dfcb6e1c4d6 Use of SessionHolder replaced by ImporterSession if query executed in the importer mschaefer parents: 9012 diff changeset	27 import org.dive4elements.river.importer.ImporterSession;
8971 50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	28 import org.dive4elements.river.importer.common.AbstractParser;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	29 import org.dive4elements.river.importer.common.ParsingState;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	30 import org.dive4elements.river.importer.sinfo.importitem.CollisionKmLineImport;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	31 import org.dive4elements.river.importer.sinfo.importitem.CollisionSeriesImport;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	32 import org.dive4elements.river.importer.sinfo.importitem.CollisionTypeImport;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	33 import org.dive4elements.river.model.sinfo.Collision;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	34 import org.dive4elements.river.model.sinfo.CollisionType;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	35 import org.dive4elements.river.model.sinfo.CollisionValue;
9579 67a42c9c46a7 Debug message added mschaefer parents: 9578 diff changeset	36 import org.hibernate.Session;
8971 50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	37
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	38 /**
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	39 * Reads and parses a collision file
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	40 *
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	41 * @author Matthias Schäfer
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	42 *
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	43 */
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	44 public class CollisionParser extends AbstractParser<Collision, CollisionValue, CollisionKmLineImport, CollisionSeriesImport> {
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	45
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	46 /*** FIELDS ***/
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	47
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	48 private static final Logger log = Logger.getLogger(CollisionParser.class);
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	49
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	50 private static final Pattern META_YEAR = Pattern.compile("^#\\sJahr:\\s([12]\\d\\d\\d).", Pattern.CASE_INSENSITIVE);
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	51
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	52 private enum ColTitlePattern {
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	53 DATE("Datum.*"), //
9654 8a2a777a8372 Importer (s/u-info) extensions: check and log message for missing values (km, date, waterlevel etc.) and wrong waterlevel unit mschaefer parents: 9579 diff changeset	54 GAUGE_W("Pegelstand\\s\\[cm\\]."), //
8971 50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	55 GAUGE_NAME("Bezugspegel.*"), //
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	56 TYPE("Unfallart.*");
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	57
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	58 private final Pattern pattern;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	59
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	60 ColTitlePattern(final String regexp) {
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	61 this.pattern = Pattern.compile(regexp, Pattern.CASE_INSENSITIVE);
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	62 }
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	63
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	64 public Pattern getPattern() {
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	65 return this.pattern;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	66 }
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	67 }
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	68
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	69 private static final DateFormat dateFormat = new SimpleDateFormat("dd.MM.yyyy");
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	70
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	71 private final EnumMap<ColTitlePattern, Integer> cols = new EnumMap<>(ColTitlePattern.class);
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	72
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	73 private final HashMap<String, CollisionTypeImport> types;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	74
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	75
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	76 /*** CONSTRUCTORS ***/
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	77
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	78 public CollisionParser(final File importPath, final File rootRelativePath, final ImportRiver river) {
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	79 super(importPath, rootRelativePath, river);
9579 67a42c9c46a7 Debug message added mschaefer parents: 9578 diff changeset	80 logDebug("CollisionParser.new: calling ImporterSession.getInstance");
67a42c9c46a7 Debug message added mschaefer parents: 9578 diff changeset	81 final Session session = ImporterSession.getInstance().getDatabaseSession();
8971 50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	82 this.types = new HashMap<>();
9579 67a42c9c46a7 Debug message added mschaefer parents: 9578 diff changeset	83 for (final CollisionType type : CollisionType.getTypes(session))
8971 50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	84 this.types.put(type.getName().trim().toLowerCase(), new CollisionTypeImport(type.getName()));
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	85 }
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	86
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	87
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	88 /*** METHODS ***/
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	89
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	90 @Override
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	91 protected Logger getLog() {
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	92 return log;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	93 }
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	94
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	95 /**
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	96 * Whether this import type shall be skipped
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	97 */
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	98 public static boolean shallSkip() {
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	99 return Config.INSTANCE.skipSInfoCollision();
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	100 }
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	101
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	102 /**
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	103 * Creates a list of parsers for all collision import files in a directory
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	104 */
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	105 public static List<CollisionParser> createParsers(final File importDir, final File relativeDir, final ImportRiver river) {
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	106 final List<CollisionParser> parsers = new ArrayList<>();
8988 ae76f618d990 Checks added for missing import directory mschaefer parents: 8971 diff changeset	107 if (importDir.exists()) {
ae76f618d990 Checks added for missing import directory mschaefer parents: 8971 diff changeset	108 for (final File file : listFiles(importDir, ".csv"))
ae76f618d990 Checks added for missing import directory mschaefer parents: 8971 diff changeset	109 parsers.add(new CollisionParser(file, new File(relativeDir, file.getName()), river));
ae76f618d990 Checks added for missing import directory mschaefer parents: 8971 diff changeset	110 }
8971 50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	111 return parsers;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	112 }
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	113
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	114 @Override
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	115 protected CollisionSeriesImport createSeriesImport(final String filename) {
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	116 return new CollisionSeriesImport(filename);
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	117 }
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	118
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	119 @Override
9012 abe069eb180c Import of vegetation zones added mschaefer parents: 8988 diff changeset	120 protected KmMode kmMode() {
abe069eb180c Import of vegetation zones added mschaefer parents: 8988 diff changeset	121 return KmMode.DUPLICATES;
8971 50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	122 }
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	123
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	124 @Override
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	125 protected boolean handleMetaOther() {
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	126 if (handleMetaYear())
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	127 return true;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	128 else
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	129 return false;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	130 }
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	131
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	132 private boolean handleMetaYear() {
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	133 final Matcher m = META_YEAR.matcher(this.currentLine);
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	134 if (m.matches()) {
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	135 this.metaPatternsMatched.add(META_YEAR);
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	136 this.seriesHeader.setYear(Integer.parseInt(m.group(1)));
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	137 return true;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	138 }
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	139 return false;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	140 }
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	141
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	142 @Override
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	143 protected boolean handleMetaColumnTitles() {
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	144 if (!super.handleMetaColumnTitles())
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	145 return false;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	146 for (final ColTitlePattern col : ColTitlePattern.values())
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	147 this.cols.put(col, -1);
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	148 for (int i = 1; i <= this.columnTitles.size() - 1; i++) {
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	149 for (final ColTitlePattern col : ColTitlePattern.values()) {
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	150 if (col.getPattern().matcher(this.columnTitles.get(i)).matches()) {
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	151 this.cols.put(col, i);
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	152 break;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	153 }
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	154 }
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	155 }
9654 8a2a777a8372 Importer (s/u-info) extensions: check and log message for missing values (km, date, waterlevel etc.) and wrong waterlevel unit mschaefer parents: 9579 diff changeset	156 if (this.cols.get(ColTitlePattern.DATE) < 0) {
8a2a777a8372 Importer (s/u-info) extensions: check and log message for missing values (km, date, waterlevel etc.) and wrong waterlevel unit mschaefer parents: 9579 diff changeset	157 logLineError("Column of the event dates could not be identified, missing column title 'Datum'");
8a2a777a8372 Importer (s/u-info) extensions: check and log message for missing values (km, date, waterlevel etc.) and wrong waterlevel unit mschaefer parents: 9579 diff changeset	158 this.headerParsingState = ParsingState.STOP;
8a2a777a8372 Importer (s/u-info) extensions: check and log message for missing values (km, date, waterlevel etc.) and wrong waterlevel unit mschaefer parents: 9579 diff changeset	159 return true;
8a2a777a8372 Importer (s/u-info) extensions: check and log message for missing values (km, date, waterlevel etc.) and wrong waterlevel unit mschaefer parents: 9579 diff changeset	160 }
8a2a777a8372 Importer (s/u-info) extensions: check and log message for missing values (km, date, waterlevel etc.) and wrong waterlevel unit mschaefer parents: 9579 diff changeset	161 if (this.cols.get(ColTitlePattern.GAUGE_W) < 0) {
8a2a777a8372 Importer (s/u-info) extensions: check and log message for missing values (km, date, waterlevel etc.) and wrong waterlevel unit mschaefer parents: 9579 diff changeset	162 logLineError("Column of the waterlevel could not be identified, missing column title 'Pegelstand [cm]'");
8a2a777a8372 Importer (s/u-info) extensions: check and log message for missing values (km, date, waterlevel etc.) and wrong waterlevel unit mschaefer parents: 9579 diff changeset	163 this.headerParsingState = ParsingState.STOP;
8a2a777a8372 Importer (s/u-info) extensions: check and log message for missing values (km, date, waterlevel etc.) and wrong waterlevel unit mschaefer parents: 9579 diff changeset	164 return true;
8a2a777a8372 Importer (s/u-info) extensions: check and log message for missing values (km, date, waterlevel etc.) and wrong waterlevel unit mschaefer parents: 9579 diff changeset	165 }
8a2a777a8372 Importer (s/u-info) extensions: check and log message for missing values (km, date, waterlevel etc.) and wrong waterlevel unit mschaefer parents: 9579 diff changeset	166 if (this.cols.get(ColTitlePattern.GAUGE_W) < 0) {
8a2a777a8372 Importer (s/u-info) extensions: check and log message for missing values (km, date, waterlevel etc.) and wrong waterlevel unit mschaefer parents: 9579 diff changeset	167 logLineError("Column of the reference gauge could not be identified, missing column title 'Bezugspegel'");
8a2a777a8372 Importer (s/u-info) extensions: check and log message for missing values (km, date, waterlevel etc.) and wrong waterlevel unit mschaefer parents: 9579 diff changeset	168 this.headerParsingState = ParsingState.STOP;
8a2a777a8372 Importer (s/u-info) extensions: check and log message for missing values (km, date, waterlevel etc.) and wrong waterlevel unit mschaefer parents: 9579 diff changeset	169 return true;
8a2a777a8372 Importer (s/u-info) extensions: check and log message for missing values (km, date, waterlevel etc.) and wrong waterlevel unit mschaefer parents: 9579 diff changeset	170 }
8971 50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	171 if (this.cols.get(ColTitlePattern.TYPE) < 0) {
9654 8a2a777a8372 Importer (s/u-info) extensions: check and log message for missing values (km, date, waterlevel etc.) and wrong waterlevel unit mschaefer parents: 9579 diff changeset	172 logLineError("Column of the collision types could not be identified, missing column title 'Unfallart'");
8971 50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	173 this.headerParsingState = ParsingState.STOP;
9654 8a2a777a8372 Importer (s/u-info) extensions: check and log message for missing values (km, date, waterlevel etc.) and wrong waterlevel unit mschaefer parents: 9579 diff changeset	174 return true;
8971 50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	175 }
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	176 if (!this.metaPatternsMatched.contains(META_YEAR)) {
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	177 logError("Required meta info for the year is missing");
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	178 this.headerParsingState = ParsingState.STOP;
9654 8a2a777a8372 Importer (s/u-info) extensions: check and log message for missing values (km, date, waterlevel etc.) and wrong waterlevel unit mschaefer parents: 9579 diff changeset	179 return true;
8971 50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	180 }
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	181 return true;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	182 }
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	183
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	184 @Override
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	185 protected CollisionKmLineImport createKmLineImport(final Double km, final String[] values) {
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	186 Date eventDate = null;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	187 try {
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	188 eventDate = dateFormat.parse(values[this.cols.get(ColTitlePattern.DATE)]);
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	189 }
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	190 catch (final Exception e) {
9654 8a2a777a8372 Importer (s/u-info) extensions: check and log message for missing values (km, date, waterlevel etc.) and wrong waterlevel unit mschaefer parents: 9579 diff changeset	191 logLineWarning("Invalid or missing date");
8971 50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	192 return null;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	193 }
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	194 final String typeName = values[this.cols.get(ColTitlePattern.TYPE)].trim();
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	195 final String typeKey = typeName.toLowerCase();
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	196 CollisionTypeImport type = null;
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	197 if (this.types.containsKey(typeKey))
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	198 type = this.types.get(typeKey);
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	199 else {
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	200 type = new CollisionTypeImport(typeName);
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	201 this.types.put(typeKey, type);
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	202 }
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	203 String gaugeName = null;
9654 8a2a777a8372 Importer (s/u-info) extensions: check and log message for missing values (km, date, waterlevel etc.) and wrong waterlevel unit mschaefer parents: 9579 diff changeset	204 gaugeName = values[this.cols.get(ColTitlePattern.GAUGE_NAME)].trim();
8a2a777a8372 Importer (s/u-info) extensions: check and log message for missing values (km, date, waterlevel etc.) and wrong waterlevel unit mschaefer parents: 9579 diff changeset	205 final Number gaugeW = parseDoubleCheckNull(values, this.cols.get(ColTitlePattern.GAUGE_W));
8a2a777a8372 Importer (s/u-info) extensions: check and log message for missing values (km, date, waterlevel etc.) and wrong waterlevel unit mschaefer parents: 9579 diff changeset	206 if ((gaugeW == null) \|\| Double.isNaN(gaugeW.doubleValue())) {
8a2a777a8372 Importer (s/u-info) extensions: check and log message for missing values (km, date, waterlevel etc.) and wrong waterlevel unit mschaefer parents: 9579 diff changeset	207 logLineWarning(INVALID_VALUE_ERROR_FORMAT, "waterlevel");
8a2a777a8372 Importer (s/u-info) extensions: check and log message for missing values (km, date, waterlevel etc.) and wrong waterlevel unit mschaefer parents: 9579 diff changeset	208 return null;
8a2a777a8372 Importer (s/u-info) extensions: check and log message for missing values (km, date, waterlevel etc.) and wrong waterlevel unit mschaefer parents: 9579 diff changeset	209 }
8a2a777a8372 Importer (s/u-info) extensions: check and log message for missing values (km, date, waterlevel etc.) and wrong waterlevel unit mschaefer parents: 9579 diff changeset	210 return new CollisionKmLineImport(km, type, eventDate, gaugeName, gaugeW.doubleValue());
8971 50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	211 }
50416a0df385 Importer for the Schifffahrt (S-INFO) and Oekologie (U-INFO) files mschaefer parents: diff changeset	212 }

Mercurial > dive4elements > river

annotate backend/src/main/java/org/dive4elements/river/importer/sinfo/parsers/CollisionParser.java @ 9658:d86c7cb68b41