Data

Recently I put different tables into a PostGIS database. One of these tables contains 23M unique records and does not contain spatial data. I would like to read them into a FME workbench. Do you have some suggestions how I could improve my reading process?Is it possible for example to preselect already a set of columns I need while reading my table using 'SQL to Run before Read'?’ If so do you have a example SQL querry?   Is there a performance difference between  'SQL to Run before Read'?’ and the WHERE clause option in the Constraints menu? 

Hi,I'm using two SentinelDownloaders in my workspace: one to download data from a specific year and another to download data from the previous year. At the end, my workspace shows a "FAILED" message in the API after completing the first SentinelDownloader. I understand there is a conflict because it's the same transformer being used for different dates in the same execution.How can I run this workspace without problems?Thank´s

Hi! I have a workspace with a runtime of effectively 28 hours (this workspace controls slave workspaces, that get 50 million rows of external data). The runtime is only this long for the initial running of the workspace, However it is possible to get severe peaks in runtime due to hystorical data recalculations. I finish the workspace with a SQL executor that merges the retrieved data with already existing data and does some other cleanup. At this point this transformer fails though, forcing me to run the queries manually. I have not saved the log due to my brilliance :). the error given is paraphrased: there is no connection with the oracle server. I think the issue is that a connection is established previously with the oracle server, than put on hold for about 28 hours, than necessary again, with an elapsed acces key. Is there a way to circumvent this? I have not tried, due to time commitment, to untick persistent connection

i”m unable to create the web connection despite all the documentation.  

Hello,When using Featurewriter with a template excel file, i encounter en error when trying to open the written excel file which indicates a problem with the Named range "Named range from /xl/workbook.xml part".This happens only since updating to 2024.1.2.0, if I use the same workspace with 2022 version it’s fine.Has this happened to someone else ? is there a workaround ?I’ve tried a lot of things but couldn’t find the issue so for now we run this workspace with 2022.Thanks for your help.

Hi there,I have placed few VIEWS on Oracle Database changing TABLE column names. ie: ID as PLANT_ITEM_IDWhen I connect the VIEW via FME 2023.2.1.0 all column names are showing as what is recorded on Oracle Tables. It is ignoring column names I have set up on VIEWs. How do I get around this issue?I don’t want to use “attribute manager” to change the names. I have already done that on my VIEWs.Is there a way I can see the Column names on VIEWS through FME?thanksRegards,Pushpa  

Hi,I need to extract pixel with value 3 ,8 and 9. Have some transformer that filter the pixel value? Thank´s

I could use some help in understanding how donuts are stored in OSM XML. Or more specifically, why FME Data Inspector is not constructing the donut from the XML. Here is the simple shapefile test data I’ve created.In FME, I’m writing out the OSM using the normal writer:When I read that OSM back into Data Inspector, it doesn’t recognize the shape as a multipolygon. The geometry type is fme_no_geom:The XML code is below. I’m seeing the relation present, so I’m not sure what else is required.<?xml version=

Hello,There have been some previous posts about converting OSM data in FME, but I’m hoping to breath some new life into the conversation. I have an Overpass Turbo query here meant to query ski area boundaries, lifts, and runs within Colorado. The query works just fine in Overpass Turbo, and I’m able to read the raw XML data into FME with the HTTP Caller no problem. The issue I’m running into is visualizing the data beyond that. I’m aware of the example workflow that is similar to my process, but I don’t understand how the XSLT Processor and XML Fragmenter transformers work. If I use those transformers in my workflow, all the coordinate information seems to disappear when the data is fragmented.Does anyone know how to prope

Hi All,I’m creating an archiving workbench for our Esri Enterprise SDE databases. I’m trying to automate checking for an existing version of a raster in either our shared or archived databases and then assigning a version suffix according to if the data already exists in one of the databases. I have the majority of the workbench sorted but struggling to automate renaming the raster to include the version suffix when writing to archive.In my example below I’ve identified that there are two existing versions of the test data “gen_aaa_aaa_test_ras” so I’ve created a name field “archhiveddataname”, which contains the the name I want to give the raster when I write it to Archived “gen_aaa_aaa_test_ras_2”. I can access this information from the schema port but not from the generic. If I include the information from the schema port I get an error saying that I’m trying to write non-raster geometry and the workbench fails. I’m using FME 2023.1.2.0 (20231110 - Bui

Hey guys, i really struggle to write my geometry to the RunwayTimeSlice Element of the AIXM 5 writer of FME. After the GeometryExtractor i got a string looking like this:  <gml:Surface srsName="EPSG:31467" srsDimension="2"><gml:patches><gml:PolygonPatch><gml:exterior><gml:LinearRing><gml:posList>5544321.76358795 3466140.39319303 5544321.79681692 3466111.70099084 5544321.79831432 3466110.40802792 5544321.8330376 3466080.42553198 5544021.7716845 3466080.40979097 5543896.905 3466084.247 5542896.762 3466080.481 5540345.41046032 3466080.53414733 5540345.41261875 3466140.53829729 5542896.8 3466140.46 5543901.789 3466140.512 5544021.76302164 3466140.39707783 5544321.76358795 3466140.39319303</gml:posList></gml:LinearRing></gml:exterior></gml:PolygonPatch></gml:patches></gml:Surface> which should be the right format for the gml geometry. But when i try to write it in the surfaceProperties Att

We published a feature layer in ArcGIS Online and when we try to read the features in FME Form 2024.1 (20240628 - Build 24612 - WIN64), we get this error. ArcGIS Online Feature Service Reader: Encountered an unexpected error. The error code from the server was '400' and the message was: 'Cannot perform query. Invalid query parameters.'. Details: '24214: Circular arc segments with Z values must have equal Z value for all 3 points., Unable to perform query. Please check your parameters.'Python Exception <ArcGISServerError>: FMEException: 928221: ArcGIS Online Feature Service Reader: Encountered an unexpected error. The error code from the server was '400' and the message was: 'Cannot perform query. Invalid query parameters.'. Details: '24214: Circular arc segments with Z values must have equal Z value for all 3 points., Unable to perform query. Please check your parameters.'We have published two more feature layers and it all work

Hi,I’m using the Feature Reader to read Sentinel images.I would like to filter only the files (in a folder) that contain "B08" as part of the filename. There can be many files with "B08" in some part of the name.How can I do that? Thank´s  

Hi can FME deal with BPF files (point cloud data storage), or is it planning on supporting this..

[Software FME Workbench 2021.2.3]Hi,Trying to generate an Esri Shapefile Polygon output of areas with data merged from multiple datasets to the Area dataset.The addition of Location Names (at least one per area) seems to be throwing up an issue.After doing the steps below the Transformer Views and Shapefile Symbology changes and goes a bit weird, and I’m not exactly sure how to sort it.Below polygon symbology is one area, but there are probably 30% of 1000 Polygons that have similar symbology issues.Any help would be greatly appreciated - Many thanks.Step One:Feature MergerRequestor: Area DatasetSupplier: Location Name DatasetMerge on AreaIDGenerate List:List Name: _listAdd to List: Selected AttributesSelected Attributes: Location_Name 

I'm trying to overwrite a date/time field with two columns from an excel file. I'd like to use attribute manager to concatenate the two columns into (Date) MM/dd/yyyy and (Time) HH:mm:ss AM/PM however I'm getting null values. The datetimeconverter led to an error saying my format wasn't FME standard. Any help is appreciated, thank you.

Hello,  Im searching for a solution to give records a group value based on multiple values statements. Data needs to be grouped on a Vehicle in time asc.So far this is not the problem.The grouping also needs to Start with a value Status = "Start”and all the other records after Start.The grouping needs to be closed after Status End comes as a record.It looks like a range or a ranking. If someone has some idea thanks. Kind regards, Nick 

Hello!I am importing data from Aerodrome data (gdb) to AMDB. Aerodrome has reflectors on the edges of taxyway. What should these reflectors be stored as in the AMDB?Maybe AerodromeSurfaceLighting or some kind of Marking or AerodromeSign or something else? The Reflectors 

Hi, Ive noted that CouchDB has been deprecated. Of course, this is the exact thing I need right now :( Is there any alternative way to access this database using the latest (2024) version of FME? 

I’m using the ESRI ArcGIS Online Feature Service Writer to update a layer in AGOL.  I have it configured as per the screenshot below.After it runs, the layer in AGOL is visible when zoomed all the way out!So, I then republish the layer in ArcGIS Pro and it fixes the layer so that it now disappears when zoomed out (I could also do this directly in AGOL).I then change the FME writer to ‘Use Existing’ (and not ‘Truncate Existing’) and re-run the translation.This time it works without affecting the AGOL layer visibility.So I change the FME writer back to ‘Truncate Existing’ (and not ‘Use Existing’) and re-run the translation.It breaks the AGOL layer visibility again!I plan to use something like this to update many layers, and I cannot have them all visible when zoomed out.  It would be a complete mess.Am I doing something wrong? How can I update the data (including deleting features) without affecting the AGOL layer’s visibility?

Hello,Is it possible to write new fields in ArcGIS Portal Feature Service with a writer ?I’m getting that message : ArcGIS Portal Feature Service Writer: Attribute 'NAME' on feature type 'Roads' does not match any field on the corresponding layer/table. The attribute will be ignored I can’t believe I have to create those fields with ArcGIS Pro, publish the layer and than run my workbench. Update:OK I just found out that I need my fields to be in lowercase to make it work.But for some reasons some field type are not working.Is there any existing list of all the constraints we need to follow for the fields in Portal? That would save me time! Thanks!

I have a script that pulls numerous datasets together, formats them into a consistent set of attributes and then writes them to .TAB files.I’m having difficulty with date field (STARTD) in the final output because although appearing to be correct in the .TAB files, ArcPy is not able to detect the dates in the .TAB files and instead shows the data as odd characters. Please see the image below for more information. Has anyone seen this before or aware of how to fix the issue? I’m not sure if there is a setting in my FME script that may need to be amended. 

Hello,i need to process excel files, currently by means of FME Form 2023.1, perspectively using FME Flow. These files, however, can differ in columns available. See attachments. The files are processed individually, only one file at a time.If i run the process with file “tk_template_v0.0.xlsx” I want the featurereader to display only the columns, containing in this file. If I run “tk_template_v0.1.xlsx”, which has got 3 more columns, i want these columns to be available in the process as well.I would like to run the script with these files without clicking on the “Feature Types to Read” button any time I process a new file! The sheet name always have the name “Tabelle1”.Unfortunately  I do not find a set of parameter that results in the desired output.The existing posts have not yet enlighten me! Any ideas?    

We have a reader plugin (c++) that should be able to set aggregated/ multiple geometry to an IFMEFeature.For example:We have only several IFMEGeometry objects. These IFMEGeometry objects should be set to an IFMEFeature. So that we have finally an IFMEFeature that consists of several different geometry objects/ parts.                                                         IFMEFeatureIFMEGeometry_Part_1    IFMEGeometry_Part_2    ….      IFMEGeometry_Part_nfme_type = fme_areafme_geometry = fme_aggregatefme_feature_type = DepthArea How can we solve this? 

Hi,I have thousand of Excel files I need to read but all of them have different starting attributes line. Sometimes line 15 or 16 or 17.(not me who developed that method of working….)The attributes are all the same for all the files.Any idea how I could have the Excel Reader to detect the starting line?Thanks !