![Page 1: Use of FME Server - Excellence Center for FME · NE GDO IInnffoollaanndd GGDDOO AApppplliiccaattiioonn SSeerrvveerr GGDDOO DDaattaabbaassee SSeerrvveerr Infoland Order Service Infoland](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7bb246d92fd3b5908f558/html5/thumbnails/1.jpg)
Use of FME ServerFully automated extraction of detailed map
data for deliveries to the Norwegian
commercial market
Knut Olav Sunde
Product Manager - Geodata
Online Content
![Page 2: Use of FME Server - Excellence Center for FME · NE GDO IInnffoollaanndd GGDDOO AApppplliiccaattiioonn SSeerrvveerr GGDDOO DDaattaabbaassee SSeerrvveerr Infoland Order Service Infoland](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7bb246d92fd3b5908f558/html5/thumbnails/2.jpg)
Content
• Introduction
– About Norwegian large scale mapping
– About Geodata Online
– About Infoland and the NE/Geodata co-operation
• Technical approach
– Architecture
– Services
– Lessons learned
![Page 3: Use of FME Server - Excellence Center for FME · NE GDO IInnffoollaanndd GGDDOO AApppplliiccaattiioonn SSeerrvveerr GGDDOO DDaattaabbaassee SSeerrvveerr Infoland Order Service Infoland](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7bb246d92fd3b5908f558/html5/thumbnails/3.jpg)
About Norwegian large scale
mapping
• FKB (Joint Map Database)– Detailed map data, various
mapping standards 1:500-1:5000 based on SOSI
– Covers about 70 % of Norway
– Originally approx. 13000 SOSI textfiles
• FKB is output from Geovekst– A nationwide mapping co-
operation between organisations
![Page 4: Use of FME Server - Excellence Center for FME · NE GDO IInnffoollaanndd GGDDOO AApppplliiccaattiioonn SSeerrvveerr GGDDOO DDaattaabbaassee SSeerrvveerr Infoland Order Service Infoland](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7bb246d92fd3b5908f558/html5/thumbnails/4.jpg)
About Geodata Online
• Geodata’s Online Services Initiative
• We provide a wide range of Geospatial Online and Hosting
Services
– Cached and Dynamic Map Services
– Search and Geoprocessing Services
– Data Download Services
– .... and more
• Served from a virtual enviroment in the Cloud (hosted by
Amazon Web Services)
• Based on the whole stack of public Norwegian Geospatial
data
– Stored by us as seamless ArcGIS GDB’s that are continously
updated from original SOSI files
![Page 5: Use of FME Server - Excellence Center for FME · NE GDO IInnffoollaanndd GGDDOO AApppplliiccaattiioonn SSeerrvveerr GGDDOO DDaattaabbaassee SSeerrvveerr Infoland Order Service Infoland](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7bb246d92fd3b5908f558/html5/thumbnails/5.jpg)
About the NE/Geodata co-operation
• NE - Norsk Eiendomsinformasjon– Distributes public and legal
land information towards the professional market in Norway
– Infoland is their Web-based marketplace
– Detailed map data is just one of the products
– Delivered by consumption of GDO Web Services
• Geodata– Detailed map data
deliveries as GDO Web Services to Infoland
– «Fresh» data from GDO’s seamless GDB
– Clips AOI defined by customer
– Delivers UTM and NTM coordinate systems
– Delivers SOSI, DXF, Shape (and PDF) formats
![Page 6: Use of FME Server - Excellence Center for FME · NE GDO IInnffoollaanndd GGDDOO AApppplliiccaattiioonn SSeerrvveerr GGDDOO DDaattaabbaassee SSeerrvveerr Infoland Order Service Infoland](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7bb246d92fd3b5908f558/html5/thumbnails/6.jpg)
About the Infoland Marketplace
• Product selection
• For detailed map data– AOI drawing/selection
– Theme, CS and format options selection
– Price Calculation
• Ordering
• Billing
• Product Download
![Page 7: Use of FME Server - Excellence Center for FME · NE GDO IInnffoollaanndd GGDDOO AApppplliiccaattiioonn SSeerrvveerr GGDDOO DDaattaabbaassee SSeerrvveerr Infoland Order Service Infoland](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7bb246d92fd3b5908f558/html5/thumbnails/7.jpg)
Order and Delivery Process
NE GDO
InfolandInfoland GDO Application ServerGDO Application Server GDO Database ServerGDO Database Server
Infoland Order Service
Infoland Integration
Service
SOAP
FME ServerData Download
ServicesREST
ZIP-file
ArcGIS GDB
HTTPInfoland Delivery
StoreFTP
Monitoring
Delivery
UpdatesOrder
• Typical time consumption for handling an order: 1-5 minutes
![Page 8: Use of FME Server - Excellence Center for FME · NE GDO IInnffoollaanndd GGDDOO AApppplliiccaattiioonn SSeerrvveerr GGDDOO DDaattaabbaassee SSeerrvveerr Infoland Order Service Infoland](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7bb246d92fd3b5908f558/html5/thumbnails/8.jpg)
Technology
• Currently
– FME Server 2010
– FME Desktop 2010 ESRI Edition
– ArcGIS ArcInfo 10.0
– ArcGIS ArcSDE 10.0 over SQL Server
– GeoSOSI Professional (SOSI Plugin for FME)
• Moving to
– FME Server 2012
– FME Desktop 2012 ESRI Edition
– ArcGIS ArcInfo 10.1
– ArcGIS File Geodatabase
– GeoSOSI Professional (SOSI Plugin for FME)
![Page 9: Use of FME Server - Excellence Center for FME · NE GDO IInnffoollaanndd GGDDOO AApppplliiccaattiioonn SSeerrvveerr GGDDOO DDaattaabbaassee SSeerrvveerr Infoland Order Service Infoland](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7bb246d92fd3b5908f558/html5/thumbnails/9.jpg)
FME Server Services Used
• Utility
– GetLayerAvailability.fmw
– ClipperTest.fmw
– UTMZoneFinder.fmw
– NTMZoneFinder.fmw
• Data Download
– FKBDownloadSOSI_NE.fmw
– FKBDownloadDXF_NE.fmw
– FKBDownloadShape_NE.fmw
![Page 10: Use of FME Server - Excellence Center for FME · NE GDO IInnffoollaanndd GGDDOO AApppplliiccaattiioonn SSeerrvveerr GGDDOO DDaattaabbaassee SSeerrvveerr Infoland Order Service Infoland](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7bb246d92fd3b5908f558/html5/thumbnails/10.jpg)
ClipperTest
• Checks geometry against rules (max area)
• Returns the area of the AOI
• Returns result in an XML
![Page 11: Use of FME Server - Excellence Center for FME · NE GDO IInnffoollaanndd GGDDOO AApppplliiccaattiioonn SSeerrvveerr GGDDOO DDaattaabbaassee SSeerrvveerr Infoland Order Service Infoland](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7bb246d92fd3b5908f558/html5/thumbnails/11.jpg)
UTMZoneFinder
• Calculates local UTM Zone from an overlay between
municipality polygons and Clipper Coords Center of Gravity
• Returns result (EPSG code) in an XML
![Page 12: Use of FME Server - Excellence Center for FME · NE GDO IInnffoollaanndd GGDDOO AApppplliiccaattiioonn SSeerrvveerr GGDDOO DDaattaabbaassee SSeerrvveerr Infoland Order Service Infoland](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7bb246d92fd3b5908f558/html5/thumbnails/12.jpg)
NTMZoneFinder
• Calculates local NTM Zone by testing Clipper Coords
Center of Gravity against Zone values
• Returns result (EPSG code) in an XML
![Page 13: Use of FME Server - Excellence Center for FME · NE GDO IInnffoollaanndd GGDDOO AApppplliiccaattiioonn SSeerrvveerr GGDDOO DDaattaabbaassee SSeerrvveerr Infoland Order Service Infoland](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7bb246d92fd3b5908f558/html5/thumbnails/13.jpg)
FKBDownloadSOSI
• Extracts desired themes for the AOI as a set of SOSI-files
(according to the FKB Standard) in the desired Coordinate
System
• Returns result as a ZIP-file
![Page 14: Use of FME Server - Excellence Center for FME · NE GDO IInnffoollaanndd GGDDOO AApppplliiccaattiioonn SSeerrvveerr GGDDOO DDaattaabbaassee SSeerrvveerr Infoland Order Service Infoland](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7bb246d92fd3b5908f558/html5/thumbnails/14.jpg)
FKBDownloadDXF
• Extracts desired themes for the AOI as one DXF-file
(layered according to the FKB Standard) in the desired
Coordinate System
• Returns result as a ZIP-file
![Page 15: Use of FME Server - Excellence Center for FME · NE GDO IInnffoollaanndd GGDDOO AApppplliiccaattiioonn SSeerrvveerr GGDDOO DDaattaabbaassee SSeerrvveerr Infoland Order Service Infoland](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7bb246d92fd3b5908f558/html5/thumbnails/15.jpg)
FKBDownloadShape
• Extracts desired themes for the AOI as a set of Shape-files
(according to the FKB Standard) in the desired Coordinate
System
• Returns result as a ZIP-file
![Page 16: Use of FME Server - Excellence Center for FME · NE GDO IInnffoollaanndd GGDDOO AApppplliiccaattiioonn SSeerrvveerr GGDDOO DDaattaabbaassee SSeerrvveerr Infoland Order Service Infoland](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7bb246d92fd3b5908f558/html5/thumbnails/16.jpg)
Complete sample REST URL (SOSI)
http://ip-
0AE701CA/fmedatadownload/Infoland/FKBDownloadSOSI_NE.fmw?ORDER_ID=2&WHERECLAUSE=OMRADEID%3D1601&SEARCHENVELOPECOORDSYS
=EPSG%3A25833&CLIPPERCOORDSYS=EPSG%3A25833&opt_servicemode=sync&MAXX=276297&CLIPPERCOORDS=276114+7041453+276114+704162
8+276297+7041628+276297+7041453+276114+7041453&MAXY=7041628&FEATURE_TYPES=GIS.FKB_EIENDOMLINJE+GIS.FKB_VANNFLATE+GIS.F
KB_TEKST1000LINJE+GIS.FKB_KULTURMINNEKFAPUNKT+GIS.FKB_VEGLINJE+GIS.FKB_PBLTILTAKPUNKT+GIS.FKB_TEKST1000PUNKT+GIS.FKB_L
EDNINGVAPUNKT+GIS.FKB_VANNLINJE+GIS.FKB_TEKST5000LINJE+GIS.FKB_EIENDOMFLATE+GIS.FKB_BYGNINGLINJE+GIS.FKB_LUFTHAVNPUNKT
+GIS.FKB_NATURINFOLINJE+GIS.FKB_AREALBRUKPUNKT+GIS.FKB_KULTURMINNEKFALINJE+GIS.FKB_BYGNANLEGGLINJE+GIS.FKB_LUFTHAVNLIN
JE+GIS.FKB_VEGPUNKT+GIS.FKB_BYGNANLEGGFLATE+GIS.FKB_BANELINJE+GIS.FKB_KULTURMINNEKFFFLATE+GIS.FKB_FASTMERKETREKANTPUNK
T+GIS.FKB_AREALBRUKLINJE+GIS.FKB_HOYDEKURVER5MPUNKT+GIS.FKB_KULTURMINNEKSIPUNKT+GIS.FKB_LEDNINGELTELEPUNKT+GIS.FKB_HOY
DEKURVER5MLINJE+GIS.FKB_KULTURMINNEKFFPUNKT+GIS.FKB_PBLTILTAKLINJE+GIS.FKB_FASTMERKELANDSNETTPUNKT+GIS.FKB_BYGNINGPUNK
T+GIS.FKB_VEGFLATE+GIS.FKB_AREALBRUKFLATE+GIS.FKB_LUFTHAVNFLATE+GIS.FKB_VERNLINJE+GIS.FKB_AR5PUNKT+GIS.FKB_EIENDOMPUNK
T+GIS.FKB_TEKST5000PUNKT+GIS.FKB_BYGNANLEGGPUNKT+GIS.FKB_KULTURMINNEKBFPUNKT+GIS.FKB_HOYDEKURVERLINJE+GIS.FKB_KULTURMI
NNEKFAFLATE+GIS.FKB_KULTURMINNEKSIFLATE+GIS.FKB_AR5FLATE+GIS.FKB_PBLTILTAKFLATE+GIS.FKB_KULTURMINNEKOFFLATE+GIS.FKB_FA
STMERKENIVFMPUNKT+GIS.FKB_VERNPUNKT+GIS.FKB_ADRESSEPUNKT+GIS.FKB_LEDNINGELTELELINJE+GIS.FKB_NATURINFOFLATE+GIS.FKB_KUL
TURMINNEKOFLINJE+GIS.FKB_TEKST1000TEKST+GIS.FKB_AR5LINJE+GIS.FKB_VBASELINJE+GIS.FKB_KULTURMINNEKFFLINJE+GIS.FKB_BYGNIN
GFLATE+GIS.FKB_HOYDEKURVERPUNKT+GIS.FKB_NATURINFOPUNKT+GIS.FKB_KULTURMINNEKSILINJE+GIS.FKB_VBASEPUNKT+GIS.FKB_VERNFLAT
E+GIS.FKB_VANNPUNKT+GIS.FKB_TEKST5000TEKST&DESTCOORDSYS=%22ESRIWKT%7CNorsk_Transversal_Mercator_sone_5%7CPROJCS%5B%22N
orsk_Transversal_Mercator_sone_5%22%2CGEOGCS%5B%22GCS_ETRS_1989%22%2CDATUM%5B%22D_ETRS_1989%22%2CSPHEROID%5B%22GRS_198
0%22%2C6378137.0%2C298.257222101%5D%5D%2CPRIMEM%5B%22Greenwich%22%2C0.0%5D%2CUNIT%5B%22Degree%22%2C0.0174532925199433%
5D%5D%2CPROJECTION%5B%22Transverse_Mercator%22%5D%2CPARAMETER%5B%22False_Easting%22%2C100000.0%5D%2CPARAMETER%5B%22Fal
se_Northing%22%2C1000000.0%5D%2CPARAMETER%5B%22Central_Meridian%22%2C5.5%5D%2CPARAMETER%5B%22Scale_Factor%22%2C1.0%5D%
2CPARAMETER%5B%22Latitude_Of_Origin%22%2C58.0%5D%2CUNIT%5B%22Meter%22%2C1.0%5D%5D%22&MINY=7041453&MINX=276114
• Parameters: OrderID, ClipperCoordSys (EPSG),
ClipperCoords, SearchEnvelope, FeatureTypes,
WhereClause, DestCoordSys (ESRI WKT)
![Page 17: Use of FME Server - Excellence Center for FME · NE GDO IInnffoollaanndd GGDDOO AApppplliiccaattiioonn SSeerrvveerr GGDDOO DDaattaabbaassee SSeerrvveerr Infoland Order Service Infoland](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7bb246d92fd3b5908f558/html5/thumbnails/17.jpg)
Monitoring jobs in SharePoint
![Page 18: Use of FME Server - Excellence Center for FME · NE GDO IInnffoollaanndd GGDDOO AApppplliiccaattiioonn SSeerrvveerr GGDDOO DDaattaabbaassee SSeerrvveerr Infoland Order Service Infoland](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7bb246d92fd3b5908f558/html5/thumbnails/18.jpg)
We also deliver also PDF’s produced
with ArcGIS Server GP Services
• Used for Real Estate sales prospects
![Page 19: Use of FME Server - Excellence Center for FME · NE GDO IInnffoollaanndd GGDDOO AApppplliiccaattiioonn SSeerrvveerr GGDDOO DDaattaabbaassee SSeerrvveerr Infoland Order Service Infoland](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7bb246d92fd3b5908f558/html5/thumbnails/19.jpg)
A couple of lessons learned
• Different formats has diffent limitations – must be
handled differently.
Generic Writer not usable, too few parameters available
Separate services needed to support each supported
format
• Different users have different expectations to
different formats and same format is handled
differently in different GIS- and CAD packages
Special translations has to be done on the fly in the
services to support all the combinations
• SAFE SW licensing is not Cloud friendly (!)
![Page 20: Use of FME Server - Excellence Center for FME · NE GDO IInnffoollaanndd GGDDOO AApppplliiccaattiioonn SSeerrvveerr GGDDOO DDaattaabbaassee SSeerrvveerr Infoland Order Service Infoland](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7bb246d92fd3b5908f558/html5/thumbnails/20.jpg)
Sample 1: Arches and Ellipses
• Autodesk Clients cannot handle centre points for arches and ellipses in 2D (as they are in the original data), while other CAD clients can
• Solution Filter Arches and Ellipses out and
set Z for the Centre Point to 0
![Page 21: Use of FME Server - Excellence Center for FME · NE GDO IInnffoollaanndd GGDDOO AApppplliiccaattiioonn SSeerrvveerr GGDDOO DDaattaabbaassee SSeerrvveerr Infoland Order Service Infoland](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7bb246d92fd3b5908f558/html5/thumbnails/21.jpg)
Sample 2: Combination of 2D and 3D
vertices
• Original data contain features with a combination og 2D and 3D vertices (fully allowed in SOSI) CAD users do not like to see this
(vertical spikes in 3D)
• Solution Force all features with an
elevation attribute into 3D and force all other features with a combination og 2D and 3D vertices into 2D
![Page 22: Use of FME Server - Excellence Center for FME · NE GDO IInnffoollaanndd GGDDOO AApppplliiccaattiioonn SSeerrvveerr GGDDOO DDaattaabbaassee SSeerrvveerr Infoland Order Service Infoland](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7bb246d92fd3b5908f558/html5/thumbnails/22.jpg)
Sample 3: Text in Shape
• Shape format does not support text (annotations)
• Solution: Create point and line features from horizontal and curved annotations to be used for labeling
![Page 23: Use of FME Server - Excellence Center for FME · NE GDO IInnffoollaanndd GGDDOO AApppplliiccaattiioonn SSeerrvveerr GGDDOO DDaattaabbaassee SSeerrvveerr Infoland Order Service Infoland](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7bb246d92fd3b5908f558/html5/thumbnails/23.jpg)
FME Server licensing
• Not Cloud friendly!
• Licenses are bound to Mac address
– When an AWS instance is stopped and started (ex.
nighttime) the IP address and hostname changes
– When a new AWS instance is created from an image of
an old one and replaces it (normal scaling procedure)
the hostname and the IP and Mac addresses changes
– ...
• Limits abilities to get the advantages and savings
using a Cloud environment
![Page 24: Use of FME Server - Excellence Center for FME · NE GDO IInnffoollaanndd GGDDOO AApppplliiccaattiioonn SSeerrvveerr GGDDOO DDaattaabbaassee SSeerrvveerr Infoland Order Service Infoland](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7bb246d92fd3b5908f558/html5/thumbnails/24.jpg)
Finally, on the customer side:
• Detailed map data for any AOI ordered and loaded into any GIS or CAD client in just a few minutes!
![Page 25: Use of FME Server - Excellence Center for FME · NE GDO IInnffoollaanndd GGDDOO AApppplliiccaattiioonn SSeerrvveerr GGDDOO DDaattaabbaassee SSeerrvveerr Infoland Order Service Infoland](https://reader033.vdocuments.site/reader033/viewer/2022042213/5eb7bb246d92fd3b5908f558/html5/thumbnails/25.jpg)
Thanks for your attention!
Any questions?