Mercurial > dive4elements > river
view flys-backend/contrib/run_geo.sh @ 5779:ebec12def170
Datacage: Add a pool of builders to make it multi threadable.
XML DOM is not thread safe. Therefore the old implementation only allowed one thread
to use the builder at a time. As the complexity of the configuration
has increased over time this has become a bottleneck of the whole application
because it took quiet some time to build a result. Furthermore the builder code path
is visited very frequent. So many concurrent requests were piled up
resulting in long waits for the users.
To mitigate this problem a round robin pool of builders is used now.
Each of the pooled builders has an independent copy of the XML template
and can be run in parallel.
The number of builders is determined by the system property
'flys.datacage.pool.size'. It defaults to 4.
| author | Sascha L. Teichmann <teichmann@intevation.de> |
|---|---|
| date | Sun, 21 Apr 2013 12:48:09 +0200 |
| parents | 673f68bb19a4 |
| children |
line wrap: on
line source
#!/bin/sh # Required RIVER_PATH="/vol1/projects/Geospatial/flys-3.0/testdaten/Gewaesser/Saar" RIVER_NAME="Saar" # Set this to your target database for Oracle HOST=localhost USER=flys28 PASS=flys28 # Alternatively you can provide a direct connection string: # OGR_CONNECTION="PG:dbname=flys host=localhost port=5432 user=flys password=flys" # Optional VERBOSE=1 SKIP_AXIS=0 SKIP_KMS=0 SKIP_CROSSSECTIONS=0 SKIP_FIXPOINTS=0 SKIP_BUILDINGS=0 SKIP_FLOODPLAINS=0 SKIP_HYDR_BOUNDARIES=0 SKIP_HWS_LINES=0 SKIP_HWS_POINTS=0 SKIP_GAUGE_LOCATION=0 SKIP_CATCHMENTS=0 SKIP_UESG=0 SKIP_DGM=0 SKIP_JETTIES=0 SKIP_FLOODMARKS=0 # There should be no need to change anything below this line DIR=`dirname $0` DIR=`readlink -f "$DIR"` OPTIONAL_LIBS="${DIR}"/opt if [ -d "$OPTIONAL_LIBS" ]; then export PATH="$OPTIONAL_LIBS/bin:$PATH" export LD_LIBRARY_PATH="$OPTIONAL_LIBS/lib:$LD_LIBRARY_PATH" export LD_LIBRARY_PATH="$OPTIONAL_LIBS/lib64:$LD_LIBRARY_PATH" export PYTHONPATH="$OPTIONAL_LIBS/lib/python2.6/site-packages:$PYTHONPATH" export PYTHONPATH="$OPTIONAL_LIBS/lib64/python2.6/site-packages:$PYTHONPATH" export GDAL_DATA="$OPTIONAL_LIBS/share/gdal" fi exec python $DIR/shpimporter/shpimporter.py \ --directory $RIVER_PATH \ --river_name "$RIVER_NAME" \ --ogr_connection "$OGR_CONNECTION" \ --host $HOST \ --user $USER \ --password $PASS \ --verbose $VERBOSE \ --skip_axis $SKIP_AXIS \ --skip_kms $SKIP_KMS \ --skip_crosssections $SKIP_CROSSSECTIONS \ --skip_fixpoints $SKIP_FIXPOINTS \ --skip_buildings $SKIP_BUILDINGS \ --skip_floodplains $SKIP_FLOODPLAINS \ --skip_hydr_boundaries $SKIP_HYDR_BOUNDARIES \ --skip_gauge_locations $SKIP_GAUGE_LOCATION \ --skip_uesgs $SKIP_UESG \ --skip_hws_lines $SKIP_HWS_LINES \ --skip_hws_points $SKIP_HWS_POINTS \ --skip_dgm $SKIP_DGM \ --skip_jetties $SKIP_JETTIES \ --skip_floodmarks $SKIP_FLOODMARKS