Skip to main content

Data

Using readers and writers to extract and load data.

  • 7,300 Posts
  • 26,828 Replies
7300 Posts
R
robyn_studts
 Data
D
dheeraj
 Data
wil
Contributor
wilContributor
 Data
boubcher
Contributor
boubcherContributor
 Data
B
bhebert
 Data
S
syllan
 Data
M
mikek
 Data
How can you get the ElasticSearch writer index mapping properties as "type : nested"?

According to the Elastic documentation: "The 'nested' type is a specialised version of the 'object' datatype that allows arrays of objects to be indexed and queried independently of each other." Nested objects allow you to filter on multiple fields within the same objects in arrays.Is it possible to get the ElasticSearch writer to write the properties as "type : nested", as shown here:PUT /my_index{  "mappings": {    "blogpost": {      "properties": {        "comments": {          "type": "nested",           "properties": {            "name":    { "type": "string"  },            "comment": { "type": "string"  },            "age":     { "type": "short"   },            "stars":   { "type": "short"   },            "date":    { "type": "date"    }          }        }      }    }  }}

501
jakemolnar
boubcher
Contributor
boubcherContributor
 Data
C
carolineivarsso
 Data
CityGML from shapefile

 Hello,I have a shapefile that consists of roof, walls and ground in a buildings model. Each surface has it's own ID ('UUID_BYGGN') assigned to it together with building part ('MSLINK2'). I have a workspace where I read in all the features and sort the surface based on attribute ('IGDS_LEV_N') which tells if it's a roof, wall or ground. After this I assign the attributes 'gml_id' and 'gml_parent_id' to each surface but something is wrong in the workspace. I get error message: CityGML Writer: Found a cycle. The ids of the elements which created this path were `GML_01861c27-7df2-4021-bd4b-300c3b496991,GML_01861c27-7df2-4021-bd4b-300c3b496991_1,GML_01861c27-7df2-4021-bd4b-300c3b496991'. CityGML Writer: While determining the CityGML element heirarchy (based on the gml_id and gml_parent_id attributes) a cycle was detected. Cyclic features can't be serialized into a CityGML Document. A fatal error has occurred. Check the logfile above f

933
daveatsafe
Safer
S
sraapril
 Data
B
beamoao
 Data
helmoet
helmoet
 Data
How does FME detect that GPSBabel is installed?

Hi, We are trying to distribute FME Workbench through Microsoft Virtualization and for that we would like to know how FME detects that GPSBabel is installed. In our current setup GPS-like readers and writers and their feature types are correctly placed in the workspace, however, running the workspace  fails, telling: FME API version of module 'NULL' matches current internal version (3.8 20160224)Creating reader for format: TomTom POITrying to find a DYNAMIC plugin for reader named `TOMTOM_POI'Loaded module 'TOMTOM_POI' from file 'E:\App-V_5\D52C8804-9F50-4D7B-A695-142DCEFE7A5E\87B5596E-AF57-4FA1-B219-EA631F902A79\Root\VFS\ProgramFilesX64\FME\plugins/GDAL.dll'FME API version of module 'TOMTOM_POI' matches current internal version (3.8 20160224)TOMTOM_POI reader: Opening file 'Z:\Temp\Webfleet\gulocPlStr16.ov2'TOMTOM_POI reader: Could not create process gpsbabel -i tomtom -f Z:\Temp\Webfleet\gulocPlStr16.ov2 -o gpx,gpxver=1.1 -F C:\Users\ex19111\AppData\Local\Temp\13\16688_0TOMTOM_POI re

1487
helmoet
R
rick
 Data
K
klika68
 Data
X
xhaxhilili
 Data
S
savas_es_gis
 Data
ingalla
Contributor
ingallaContributor
 Data
M
marten_m
 Data
Smallworld translator 4.3 export changes from baseline

Hi,I use the smallworld 4.3 translator to read data from a Smallworld database in FME 2016.1 32bitIn the SWORLDSWAF reader i enter an alternative that I am interested in (Alternative: |design_top|xxxxx|) and set export changes from baseline = Yes and Baseline Alternative= | to read changes from the top. I then expect to only get the changes made in this alternative in the database.When i run the query early in the morning (close in time to a nightly system restart) I get the expected result with changes from the alternative of interest. However during the day I get more and more data that has nothing to do with the alternative. I seems like there is a session created at my first connection attempt whitch is then used as top and all changes in or outside the alternative of interest is considered a change. Powergrid is the software we use for network design and in there I can refresh the session I work in by clicking a button. This function is what I need to access via FME somehow.I have

612
M
O
okmano
 Data
bk
Contributor
bkContributor
 Data
AS/400 DB2 ODBC Error

I have a support case in on this - C131989 - but figured I’d ask here as well. I have an existing workspace that’s been running fine every night for months. All it does is access several tables in an AS/400 DB2 database (via an ODBC connection) and export these to a SQL Server database. This is about as simple as an FME workspace can be i.e. one reader to one writer for several tables, no transformers. I now need to add a new table. When I try to import the feature type from the reader, I get the list of tables, select the one I want, and then get the following error:Opening ODBC 3.x ReaderODBC 3.x Reader: Dataset = GTCOUNTY.HTEDTA. Username = citywork. Password = ************Connecting to database...ODBC 3.x Reader: The DBMS name fetched by ODBC driver is 'DB2/400 SQL'ODBC 3.x Reader: The DBMS version fetched by ODBC driver is '07.01.0015'ODBC 3.x Reader: Database version is '7.1.15'ODBC 3.x Reader: Current schema is 'citywork'ODBC 3.x Reader: Now read

1000
bk
Contributor
takashi
Celebrity
takashi
 Data
dfresh
dfresh
 Data
S
sui_huang
 Data
How to rollback the changes made by SQLExecutor transformer if any of the Initiator fails?

Hi! I am writing an FME script to insert records into target table. Before inserting a record, I want to delete the record has the same ID in database, if it exists. I made an FME workspace as screenshot to do run a DELETE T-SQL command for each feature, such that all deletions are performed before any insertion.the translation will terminate if any of the deletion fails.However, I considered the following hypothetical scenarios (in practice I never seen any of them happened, but still possible).The 100th feature fails in the SQLExecutor, such that the translation ends with 99 records deleted from database.All feature passes SQLExecutor, but the first feature failed in the writer, such that the translation ends with all deletions done, but not insertion.Considering the importance of data integrity. Is it possible for me to change the workspace, such that:If any feature fails in SQLExecutor transformer, then rollback all the changes made by the same SQLExecutor?If any feature fails in w

22312
S
S
schatt15
 Data
A
a7
 Data
Show more activity

Badge Winners

  • FME Certified Professional
    kevvhas earned the badge FME Certified Professional
  • Teacher (Grey)
    chad.ramos_tdemhas earned the badge Teacher (Grey)
  • Student (Grey)
    chad.ramos_tdemhas earned the badge Student (Grey)
  • FME Form Advanced Training
    dustinhas earned the badge FME Form Advanced Training
  • Welcome Back
    bkhas earned the badge Welcome Back
Show all badges

Community Stats

32,763
Posts
124,242
Replies
41,288
Members
Terms & ConditionsAccessibility statement
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.