dive4elements/river: backend/contrib/shpimporter/hws.py annotate

annotate backend/contrib/shpimporter/hws.py @ 9803:a440ebd5c23b 3.2.x tip

Avoid using outdated mod_wsgi in Docker setup Run Wiki in standalone mode behind reverse proxy, which is provided by a more up-to-date Apache web server. The wiki container is still based on CentOS 7, because the included SSO integration component cannot be build with more recent libraries.

author	Tom Gottfried <tom@intevation.de>
date	Wed, 21 Aug 2024 16:54:17 +0200
parents	aef987124822
children

rev	line source
4875 37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	1 # -- coding: utf-8 --
37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	2 try:
37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	3 from osgeo import ogr
5077 c5187ab9f571 Fix Syntax Errror Andre Heinecke <aheinecke@intevation.de> parents: 5006 diff changeset	4 except ImportError:
4875 37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	5 import ogr
2862 998f1a7dcfde New shape importers and schema modifications. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	6
998f1a7dcfde New shape importers and schema modifications. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	7 from importer import Importer
4875 37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	8 import utils
2862 998f1a7dcfde New shape importers and schema modifications. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	9
5006 769593a84606 Importer: Behold, Logging! Andre Heinecke <aheinecke@intevation.de> parents: 5003 diff changeset	10 import logging
5215 c8e79cff622a Importer use different name for HWS log output Andre Heinecke <aheinecke@intevation.de> parents: 5178 diff changeset	11 logger = logging.getLogger("HWS")
5006 769593a84606 Importer: Behold, Logging! Andre Heinecke <aheinecke@intevation.de> parents: 5003 diff changeset	12
2862 998f1a7dcfde New shape importers and schema modifications. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	13 PATH="Hydrologie/HW-Schutzanlagen"
3654 59ca5dab2782 Shape importer: use python's OptionParse to read user specific configuration from command line. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: 2862 diff changeset	14 NAME="HWS"
2862 998f1a7dcfde New shape importers and schema modifications. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	15
4875 37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	16 # Keep in sync with hws_kinds table:
5178 13f3484d4618 Extract Bundesland from path as a fallback if bundesland field is not set. Andre Heinecke <aheinecke@intevation.de> parents: 5143 diff changeset	17 # strings need to be lowercase
4875 37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	18 HWS_KIND = {
5002 baa32f1df47d Importer HWS: case insensitive matching for HWS_KIND and FED_STATES Andre Heinecke <aheinecke@intevation.de> parents: 4955 diff changeset	19 "durchlass" : 1,
baa32f1df47d Importer HWS: case insensitive matching for HWS_KIND and FED_STATES Andre Heinecke <aheinecke@intevation.de> parents: 4955 diff changeset	20 "damm" : 2,
baa32f1df47d Importer HWS: case insensitive matching for HWS_KIND and FED_STATES Andre Heinecke <aheinecke@intevation.de> parents: 4955 diff changeset	21 "deich" : 2,
baa32f1df47d Importer HWS: case insensitive matching for HWS_KIND and FED_STATES Andre Heinecke <aheinecke@intevation.de> parents: 4955 diff changeset	22 "hochufer" : 2,
baa32f1df47d Importer HWS: case insensitive matching for HWS_KIND and FED_STATES Andre Heinecke <aheinecke@intevation.de> parents: 4955 diff changeset	23 "graben" : 3,
baa32f1df47d Importer HWS: case insensitive matching for HWS_KIND and FED_STATES Andre Heinecke <aheinecke@intevation.de> parents: 4955 diff changeset	24 "rohr1" : 1,
5218 028ff568b196 added HWS_KINDS to be accepted by importer Tom Gottfried <tom@intevation.de> parents: 5215 diff changeset	25 "rohr 1" : 1,
028ff568b196 added HWS_KINDS to be accepted by importer Tom Gottfried <tom@intevation.de> parents: 5215 diff changeset	26 "rohr 2" : 1,
5143 d25eebfc5cee corrected HWS_KIND field-map Tom Gottfried <tom.gottfried@intevation.de> parents: 5142 diff changeset	27 "hauptdeich" : 2,
d25eebfc5cee corrected HWS_KIND field-map Tom Gottfried <tom.gottfried@intevation.de> parents: 5142 diff changeset	28 "sommerdeich" : 2
4875 37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	29 }
2862 998f1a7dcfde New shape importers and schema modifications. Ingo Weinzierl <ingo.weinzierl@intevation.de> parents: diff changeset	30
4875 37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	31 # Keep in sync with fed_states table:
5178 13f3484d4618 Extract Bundesland from path as a fallback if bundesland field is not set. Andre Heinecke <aheinecke@intevation.de> parents: 5143 diff changeset	32 # strings need to be lowercase
4875 37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	33 FED_STATES = {
5002 baa32f1df47d Importer HWS: case insensitive matching for HWS_KIND and FED_STATES Andre Heinecke <aheinecke@intevation.de> parents: 4955 diff changeset	34 "bayern" : 1,
baa32f1df47d Importer HWS: case insensitive matching for HWS_KIND and FED_STATES Andre Heinecke <aheinecke@intevation.de> parents: 4955 diff changeset	35 "hessen" : 2,
baa32f1df47d Importer HWS: case insensitive matching for HWS_KIND and FED_STATES Andre Heinecke <aheinecke@intevation.de> parents: 4955 diff changeset	36 "niedersachsen" : 3,
baa32f1df47d Importer HWS: case insensitive matching for HWS_KIND and FED_STATES Andre Heinecke <aheinecke@intevation.de> parents: 4955 diff changeset	37 "nordrhein-westfalen" : 4,
baa32f1df47d Importer HWS: case insensitive matching for HWS_KIND and FED_STATES Andre Heinecke <aheinecke@intevation.de> parents: 4955 diff changeset	38 "nordrhein westfalen" : 4,
baa32f1df47d Importer HWS: case insensitive matching for HWS_KIND and FED_STATES Andre Heinecke <aheinecke@intevation.de> parents: 4955 diff changeset	39 "rheinland-pfalz" : 5,
baa32f1df47d Importer HWS: case insensitive matching for HWS_KIND and FED_STATES Andre Heinecke <aheinecke@intevation.de> parents: 4955 diff changeset	40 "rheinland pfalz" : 5,
baa32f1df47d Importer HWS: case insensitive matching for HWS_KIND and FED_STATES Andre Heinecke <aheinecke@intevation.de> parents: 4955 diff changeset	41 "saarland" : 6,
baa32f1df47d Importer HWS: case insensitive matching for HWS_KIND and FED_STATES Andre Heinecke <aheinecke@intevation.de> parents: 4955 diff changeset	42 "schleswig-holstein" : 7,
baa32f1df47d Importer HWS: case insensitive matching for HWS_KIND and FED_STATES Andre Heinecke <aheinecke@intevation.de> parents: 4955 diff changeset	43 "schleswig holstein" : 7,
baa32f1df47d Importer HWS: case insensitive matching for HWS_KIND and FED_STATES Andre Heinecke <aheinecke@intevation.de> parents: 4955 diff changeset	44 "brandenburg" : 8,
baa32f1df47d Importer HWS: case insensitive matching for HWS_KIND and FED_STATES Andre Heinecke <aheinecke@intevation.de> parents: 4955 diff changeset	45 "mecklenburg-vorpommern" : 9,
baa32f1df47d Importer HWS: case insensitive matching for HWS_KIND and FED_STATES Andre Heinecke <aheinecke@intevation.de> parents: 4955 diff changeset	46 "mecklenburg vorpommern" : 9,
baa32f1df47d Importer HWS: case insensitive matching for HWS_KIND and FED_STATES Andre Heinecke <aheinecke@intevation.de> parents: 4955 diff changeset	47 "thüringen" : 10,
baa32f1df47d Importer HWS: case insensitive matching for HWS_KIND and FED_STATES Andre Heinecke <aheinecke@intevation.de> parents: 4955 diff changeset	48 "baden-württemberg" : 11,
baa32f1df47d Importer HWS: case insensitive matching for HWS_KIND and FED_STATES Andre Heinecke <aheinecke@intevation.de> parents: 4955 diff changeset	49 "baden württemberg" : 11,
baa32f1df47d Importer HWS: case insensitive matching for HWS_KIND and FED_STATES Andre Heinecke <aheinecke@intevation.de> parents: 4955 diff changeset	50 "sachsen-anhalt" : 12,
baa32f1df47d Importer HWS: case insensitive matching for HWS_KIND and FED_STATES Andre Heinecke <aheinecke@intevation.de> parents: 4955 diff changeset	51 "sachsen anhalt" : 12,
baa32f1df47d Importer HWS: case insensitive matching for HWS_KIND and FED_STATES Andre Heinecke <aheinecke@intevation.de> parents: 4955 diff changeset	52 "sachsen" : 13,
baa32f1df47d Importer HWS: case insensitive matching for HWS_KIND and FED_STATES Andre Heinecke <aheinecke@intevation.de> parents: 4955 diff changeset	53 "berlin" : 14,
baa32f1df47d Importer HWS: case insensitive matching for HWS_KIND and FED_STATES Andre Heinecke <aheinecke@intevation.de> parents: 4955 diff changeset	54 "bremen" : 15,
baa32f1df47d Importer HWS: case insensitive matching for HWS_KIND and FED_STATES Andre Heinecke <aheinecke@intevation.de> parents: 4955 diff changeset	55 "hamburg" : 16,
4875 37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	56 }
37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	57
37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	58 class HWSPoints(Importer):
37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	59 fieldmap = {
4935 c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	60 "name$" : "name",
c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	61 "quelle$" : "source",
c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	62 "anmerkung$" : "description",
c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	63 "stand$" : "status_date",
c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	64 "verband$" : "agency",
c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	65 "Deich_{0,1}KM$" : "dike_km",
c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	66 "Bereich$" : "range",
c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	67 "H[oeö]{0,2}he_{0,1}SOLL$" : "z_target",
c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	68 "(WSP_){0,1}BfG_{0,1}100$" : "rated_level",
c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	69 "H[oeö]{0,2}he_{0,1}IST$" : "z",
4875 37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	70 }
37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	71
5178 13f3484d4618 Extract Bundesland from path as a fallback if bundesland field is not set. Andre Heinecke <aheinecke@intevation.de> parents: 5143 diff changeset	72 printedforpath=[]
13f3484d4618 Extract Bundesland from path as a fallback if bundesland field is not set. Andre Heinecke <aheinecke@intevation.de> parents: 5143 diff changeset	73
4875 37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	74 def getPath(self, base):
37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	75 return "%s/%s" % (base, PATH)
37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	76
37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	77 def getTablename(self):
37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	78 return "hws_points"
37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	79
37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	80 def getName(self):
37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	81 return "HWS_POINTS"
37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	82
37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	83 def isGeometryValid(self, geomType):
4934 11b459a3eb5c Importer: Import hws_points based on geom type Andre Heinecke <aheinecke@intevation.de> parents: 4933 diff changeset	84 return geomType == ogr.wkbPoint or geomType == ogr.wkbPoint25D
4875 37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	85
37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	86 def isShapeRelevant(self, name, path):
4934 11b459a3eb5c Importer: Import hws_points based on geom type Andre Heinecke <aheinecke@intevation.de> parents: 4933 diff changeset	87 shp = ogr.Open(path)
4955 7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	88 return self.isGeometryValid(shp.GetLayerByName(name).GetGeomType())
4875 37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	89
5178 13f3484d4618 Extract Bundesland from path as a fallback if bundesland field is not set. Andre Heinecke <aheinecke@intevation.de> parents: 5143 diff changeset	90 def getFedStateIDfromPath(self, path):
13f3484d4618 Extract Bundesland from path as a fallback if bundesland field is not set. Andre Heinecke <aheinecke@intevation.de> parents: 5143 diff changeset	91 """
13f3484d4618 Extract Bundesland from path as a fallback if bundesland field is not set. Andre Heinecke <aheinecke@intevation.de> parents: 5143 diff changeset	92 Tries to get extract a bundesland from the path
13f3484d4618 Extract Bundesland from path as a fallback if bundesland field is not set. Andre Heinecke <aheinecke@intevation.de> parents: 5143 diff changeset	93 """
13f3484d4618 Extract Bundesland from path as a fallback if bundesland field is not set. Andre Heinecke <aheinecke@intevation.de> parents: 5143 diff changeset	94 for state in sorted(FED_STATES.keys(), key = len, reverse = True):
13f3484d4618 Extract Bundesland from path as a fallback if bundesland field is not set. Andre Heinecke <aheinecke@intevation.de> parents: 5143 diff changeset	95 if state in path.lower():
13f3484d4618 Extract Bundesland from path as a fallback if bundesland field is not set. Andre Heinecke <aheinecke@intevation.de> parents: 5143 diff changeset	96 if not path in self.printedforpath:
13f3484d4618 Extract Bundesland from path as a fallback if bundesland field is not set. Andre Heinecke <aheinecke@intevation.de> parents: 5143 diff changeset	97 logger.info("Extracted federal state from path: %s" % state)
13f3484d4618 Extract Bundesland from path as a fallback if bundesland field is not set. Andre Heinecke <aheinecke@intevation.de> parents: 5143 diff changeset	98 self.printedforpath.append(path)
13f3484d4618 Extract Bundesland from path as a fallback if bundesland field is not set. Andre Heinecke <aheinecke@intevation.de> parents: 5143 diff changeset	99 return FED_STATES[state]
13f3484d4618 Extract Bundesland from path as a fallback if bundesland field is not set. Andre Heinecke <aheinecke@intevation.de> parents: 5143 diff changeset	100
4875 37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	101 def createNewFeature(self, featureDef, feat, **args):
37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	102 newFeat = ogr.Feature(featureDef)
37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	103 geometry = feat.GetGeometryRef()
4881 9b03cf6b85c9 (importer) calculate freeboard and expect sql Andre Heinecke <aheinecke@intevation.de> parents: 4875 diff changeset	104 geometry.SetCoordinateDimension(2)
4875 37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	105
4884 b457532dae63 Importer: Move copy fields into importer class and track imported/unimported fields Andre Heinecke <aheinecke@intevation.de> parents: 4881 diff changeset	106 self.copyFields(feat, newFeat, self.fieldmap)
4875 37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	107
37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	108 newFeat.SetGeometry(geometry)
37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	109
4935 c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	110 artname = self.searchField("art$")
c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	111 if self.IsFieldSet(feat, artname):
c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	112 self.handled(artname)
5002 baa32f1df47d Importer HWS: case insensitive matching for HWS_KIND and FED_STATES Andre Heinecke <aheinecke@intevation.de> parents: 4955 diff changeset	113 kind_id = HWS_KIND.get(feat.GetField(artname).lower())
4875 37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	114 if not kind_id:
5006 769593a84606 Importer: Behold, Logging! Andre Heinecke <aheinecke@intevation.de> parents: 5003 diff changeset	115 logger.warn("Unknown Art: %s" % \
4935 c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	116 feat.GetField(artname))
5382 f66a6c1a73e7 Explicitly force the kind to be 2 when it is not set. Andre Heinecke <aheinecke@intevation.de> parents: 5218 diff changeset	117 newFeat.SetField("kind_id", 2)
4875 37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	118 else:
37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	119 newFeat.SetField("kind_id", kind_id)
5382 f66a6c1a73e7 Explicitly force the kind to be 2 when it is not set. Andre Heinecke <aheinecke@intevation.de> parents: 5218 diff changeset	120 else:
f66a6c1a73e7 Explicitly force the kind to be 2 when it is not set. Andre Heinecke <aheinecke@intevation.de> parents: 5218 diff changeset	121 newFeat.SetField("kind_id", 2)
4875 37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	122
4935 c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	123 fname = self.searchField("Bundesland$")
c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	124 if self.IsFieldSet(feat, fname):
c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	125 self.handled(fname)
5002 baa32f1df47d Importer HWS: case insensitive matching for HWS_KIND and FED_STATES Andre Heinecke <aheinecke@intevation.de> parents: 4955 diff changeset	126 fed_id = FED_STATES.get(feat.GetField(fname).lower())
4875 37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	127
37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	128 if not fed_id:
5006 769593a84606 Importer: Behold, Logging! Andre Heinecke <aheinecke@intevation.de> parents: 5003 diff changeset	129 logger.warn("Unknown Bundesland: %s" % \
5178 13f3484d4618 Extract Bundesland from path as a fallback if bundesland field is not set. Andre Heinecke <aheinecke@intevation.de> parents: 5143 diff changeset	130 feat.GetField(fname))
4875 37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	131 else:
37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	132 newFeat.SetField("fed_state_id", fed_id)
5178 13f3484d4618 Extract Bundesland from path as a fallback if bundesland field is not set. Andre Heinecke <aheinecke@intevation.de> parents: 5143 diff changeset	133 else:
13f3484d4618 Extract Bundesland from path as a fallback if bundesland field is not set. Andre Heinecke <aheinecke@intevation.de> parents: 5143 diff changeset	134 # Try to get the bundesland from path
13f3484d4618 Extract Bundesland from path as a fallback if bundesland field is not set. Andre Heinecke <aheinecke@intevation.de> parents: 5143 diff changeset	135 fed_id = self.getFedStateIDfromPath(args['path'])
13f3484d4618 Extract Bundesland from path as a fallback if bundesland field is not set. Andre Heinecke <aheinecke@intevation.de> parents: 5143 diff changeset	136 if fed_id:
13f3484d4618 Extract Bundesland from path as a fallback if bundesland field is not set. Andre Heinecke <aheinecke@intevation.de> parents: 5143 diff changeset	137 newFeat.SetField("fed_state_id", fed_id)
4875 37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	138
4935 c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	139 fname = self.searchField("(ufer$)\|(flussseite$)")
c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	140 if self.IsFieldSet(feat, fname):
c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	141 self.handled(fname)
c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	142 shoreString = feat.GetField(fname)
4875 37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	143 if "links" in shoreString.lower():
37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	144 newFeat.SetField("shore_side", True)
37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	145 elif "rechts" in shoreString.lower():
37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	146 newFeat.SetField("shore_side", False)
37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	147
4935 c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	148
c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	149 fname = self.searchField("river_{0,1}id$")
c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	150 if self.IsFieldSet(feat, fname):
c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	151 self.handled(fname)
c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	152 if feat.GetField(fname) != self.river_id:
5006 769593a84606 Importer: Behold, Logging! Andre Heinecke <aheinecke@intevation.de> parents: 5003 diff changeset	153 logger.warn("River_id mismatch between shapefile and"
4935 c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	154 " importer parameter.")
c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	155 newFeat.SetField("river_id", feat.GetField(fname))
c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	156 else:
c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	157 newFeat.SetField("river_id", self.river_id)
c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	158
c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	159 fname = self.searchField("name$")
c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	160 if not self.IsFieldSet(feat, fname):
4875 37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	161 newFeat.SetField("name", args['name'])
37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	162
9713 aef987124822 Do not rely on database default for setting hws_lines.official to 0 Tom Gottfried <tom@intevation.de> parents: 5838 diff changeset	163 official = False
4935 c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	164 fname = self.searchField("offiziell$")
c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	165 if self.IsFieldSet(feat, fname):
c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	166 self.handled(fname)
c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	167 offiziell = feat.GetField(fname)
4881 9b03cf6b85c9 (importer) calculate freeboard and expect sql Andre Heinecke <aheinecke@intevation.de> parents: 4875 diff changeset	168 if offiziell == "1" or offiziell == 1:
9713 aef987124822 Do not rely on database default for setting hws_lines.official to 0 Tom Gottfried <tom@intevation.de> parents: 5838 diff changeset	169 official = True
5003 563ff8893d47 Importer: Fix fieldname of "official" in the new feature and set it Andre Heinecke <aheinecke@intevation.de> parents: 5002 diff changeset	170 # Set the official value based on the file name as a fallback
563ff8893d47 Importer: Fix fieldname of "official" in the new feature and set it Andre Heinecke <aheinecke@intevation.de> parents: 5002 diff changeset	171 elif args.get("name", "").lower() == "rohre_und_sperren" or \
563ff8893d47 Importer: Fix fieldname of "official" in the new feature and set it Andre Heinecke <aheinecke@intevation.de> parents: 5002 diff changeset	172 args.get("name", "").lower() == "rohre-und-sperren":
9713 aef987124822 Do not rely on database default for setting hws_lines.official to 0 Tom Gottfried <tom@intevation.de> parents: 5838 diff changeset	173 official = True
aef987124822 Do not rely on database default for setting hws_lines.official to 0 Tom Gottfried <tom@intevation.de> parents: 5838 diff changeset	174 newFeat.SetField("official", official)
4881 9b03cf6b85c9 (importer) calculate freeboard and expect sql Andre Heinecke <aheinecke@intevation.de> parents: 4875 diff changeset	175
9b03cf6b85c9 (importer) calculate freeboard and expect sql Andre Heinecke <aheinecke@intevation.de> parents: 4875 diff changeset	176 if self.IsFieldSet(newFeat, "z") and \
9b03cf6b85c9 (importer) calculate freeboard and expect sql Andre Heinecke <aheinecke@intevation.de> parents: 4875 diff changeset	177 self.IsFieldSet(newFeat, "rated_level"):
4935 c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	178 fname = self.searchField("freibord(_m){0,1}$")
c0a58558b817 Importer: - Handle regular expressions for attribute names Andre Heinecke <aheinecke@intevation.de> parents: 4934 diff changeset	179 self.handled(fname)
4881 9b03cf6b85c9 (importer) calculate freeboard and expect sql Andre Heinecke <aheinecke@intevation.de> parents: 4875 diff changeset	180 z = newFeat.GetFieldAsDouble("z")
9b03cf6b85c9 (importer) calculate freeboard and expect sql Andre Heinecke <aheinecke@intevation.de> parents: 4875 diff changeset	181 rl = newFeat.GetFieldAsDouble("rated_level")
9b03cf6b85c9 (importer) calculate freeboard and expect sql Andre Heinecke <aheinecke@intevation.de> parents: 4875 diff changeset	182 newFeat.SetField("freeboard", z - rl)
4875 37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	183
37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	184 return newFeat
37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	185
4955 7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	186 class HWSLines(HWSPoints):
4875 37fa93f65971 (importer) Add classes for hws_points and hws_lines Andre Heinecke <aheinecke@intevation.de> parents: 3654 diff changeset	187
4955 7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	188 # TODO: GEOM_target, GEOM_rated_level, dike_km_from, dike_km_to
7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	189 fieldmap = {
7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	190 "name$" : "name",
7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	191 "quelle$" : "source",
7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	192 "anmerkung$" : "description",
7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	193 "stand$" : "status_date",
7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	194 "verband$" : "agency",
7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	195 "Bereich$" : "range",
7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	196 }
7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	197
7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	198 def getPath(self, base):
7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	199 return "%s/%s" % (base, PATH)
7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	200
7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	201 def getTablename(self):
7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	202 return "hws_lines"
7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	203
7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	204 def getName(self):
7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	205 return "HWS_LINES"
7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	206
7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	207 def isGeometryValid(self, geomType):
5137 04eb62eae722 River Axes and HWS_lines are now multiline Andre Heinecke <aheinecke@intevation.de> parents: 5122 diff changeset	208 return geomType in [ogr.wkbLineString,
04eb62eae722 River Axes and HWS_lines are now multiline Andre Heinecke <aheinecke@intevation.de> parents: 5122 diff changeset	209 ogr.wkbLineString25D,
04eb62eae722 River Axes and HWS_lines are now multiline Andre Heinecke <aheinecke@intevation.de> parents: 5122 diff changeset	210 ogr.wkbMultiLineString25D,
04eb62eae722 River Axes and HWS_lines are now multiline Andre Heinecke <aheinecke@intevation.de> parents: 5122 diff changeset	211 ogr.wkbMultiLineString]
4955 7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	212
7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	213 def isShapeRelevant(self, name, path):
7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	214 shp = ogr.Open(path)
7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	215 return self.isGeometryValid(shp.GetLayerByName(name).GetGeomType())
7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	216
7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	217 def createNewFeature(self, featureDef, feat, **args):
7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	218 newFeat = HWSPoints.createNewFeature(self, featureDef, feat, **args)
7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	219 geometry = feat.GetGeometryRef()
5137 04eb62eae722 River Axes and HWS_lines are now multiline Andre Heinecke <aheinecke@intevation.de> parents: 5122 diff changeset	220 if geometry.GetCoordinateDimension() == 2:
04eb62eae722 River Axes and HWS_lines are now multiline Andre Heinecke <aheinecke@intevation.de> parents: 5122 diff changeset	221 geometry.SetCoordinateDimension(3)
5139 76db0e48dbc0 Importer: When a hws linestring was two dimensional import it with z=9999 Andre Heinecke <aheinecke@intevation.de> parents: 5137 diff changeset	222 for i in range(0, geometry.GetPointCount()):
76db0e48dbc0 Importer: When a hws linestring was two dimensional import it with z=9999 Andre Heinecke <aheinecke@intevation.de> parents: 5137 diff changeset	223 x,y,z = geometry.GetPoint(i)
76db0e48dbc0 Importer: When a hws linestring was two dimensional import it with z=9999 Andre Heinecke <aheinecke@intevation.de> parents: 5137 diff changeset	224 z = 9999
76db0e48dbc0 Importer: When a hws linestring was two dimensional import it with z=9999 Andre Heinecke <aheinecke@intevation.de> parents: 5137 diff changeset	225 geometry.SetPoint(i, x, y, z)
4955 7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	226 newFeat.SetGeometry(geometry)
7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	227
5137 04eb62eae722 River Axes and HWS_lines are now multiline Andre Heinecke <aheinecke@intevation.de> parents: 5122 diff changeset	228 return utils.convertToMultiLine(newFeat)
4955 7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	229
7323847fa7df Importer: Add HWS lines stub. Needs some example data to finish Andre Heinecke <aheinecke@intevation.de> parents: 4935 diff changeset	230

Mercurial > dive4elements > river

annotate backend/contrib/shpimporter/hws.py @ 9803:a440ebd5c23b 3.2.x tip