Data

I’m doing a routing analysis and I have a road network that I need to create new nodes along where I have points for addresses. I used the AnchoredSnapper transformer to ensure that the points align with the line data. The point data (addresses) is a separate dataset from the line data (network). Does anyone know how to create new nodes along an existing line using point data?

I'm trying to load OpenStreetMap using FME. This works great with small datasets in 2012, however as soon as I start playing with large datasets (millions of features) I hit the problem that the FME OSM reader acts as a grouper - it reads the entire dataset in before it actually trys to translate everything.  Does this have to happen? Is there a way to disable it or is this a limitation of the XML reader? It's massively slowing down everything because even with 32GB of RAM, FME is still filling it up and then writing to temp disk space (despite the original dataset only being about 7GB uncompressed).  Using 2012 SP4 64bit. 2013 13206 is 5.5 times slower on the small dataset, so not using that despite changes in #13082 to make "it better with large datasets" - not sure what that means.

Hi everyone, I have several Esri personal Geodatabases with similar schema but also some tiny differences.That is, they are required to have identical schema but in fact some don't due to various reasons. Some feature types and attributes are unexpected, while some required ones are missing. Now I want to choose a standard one from them as a template and merge them all to get a standard destination mdb. How can I achieve that?

Within the User Parameters I have added the option to Select a File.More specific the user has the option to select a Geodatabase (Items to Select).When the user has selected the Geodatabase, I like to have the user also select the database of his/her own choice within that Geodatabase. Is there a way to configure that?  

 Hi,I am just in the process of migration testing from FME Flow/Form 2023.1 to 2024.1. It seems all of our GeoDB dynamic writer fails the following error:Esri Geodatabase Writer: Feature Type Definition 'd_y_n' was requested, but not defined. Please visit https://www.safe.com/support All existing runs perfect on 2023.1 Flow and Form - not sure why it fails. Tried all possible scenarios, still fails. I have changed it to a normal writer - then it worked fine.GeoDatabase - SQL Server 2017, SDE Version 10.9.1 (pro 2.9 created)Pro Version 3.3.1 installed on PC / ServerRudy

Hi,  I am a total novice with FME - will be going on some training soon, however I am trying to get familiar with the software prior to that.  I have what I think is a very simple task but can't seem to figure it out.  All I want to do is create an excel file with all of the feature classes contained in my geodatabase.  My geodatabase (version 10.1 in ArcGIS) contains feature datasets - although I do not these listed in my excel output.  Sorry for asking such a basic question - I am new to the knowledge areas/and community

Hello,I was wondering if FME can read in  data from Oracle SQL Views?If yes, great. How?

Hi there!I want to create polygons from an attribute that contains a string of coordinates and other information. My problem is that I don't know how to only extract the coordinates from the string and then create the polygons by their ID attribute.  The string in the coordinates attribute looks like this:“{"type":"Feature","properties":{},"geometry":{"type":"Polygon","coordinates":[[[13.707920553133594,60.03475791657763],[13.708950521395312,60.03304306231432],[13.705474378512012,60.03160680337132],[13.702513219759567,60.02997753853561],[13.702255727694139,60.030577803349054],[13.703929426119434,60.03184261136259],[13.706161024019824,60.032571461785544],[13.707920553133594,60.03475791657763]]]}}” ID attribute 1 to 10 Regards,  Ricardo :) 

I have a DXF file that consists of multiple geometries and attributes. I want to convert this DXF file to a file geodatabase with multiple layers based on each geometry type in the DXF. The different layers also need to retain the same attributes as the DXF files. I attached the file as a zip to this post.I tried loading the DXF file in FME using the Autodesk Autocad DWG/DXF reader and splitting the geometries using a GeometryFilter. That worked fine. However, the attributes disappear when I read the DXF file in FME. Do you have any suggestions on how to retain the attributes of a DXF file when reading it in FME and converting it to a GDB? The data was gathered with a Leica gs18T in case that helps.

Context: Feature Type with a WHERE clausePurpose: To only read records relating to a user defined Iwi (Maori Tribe).When the WHERE Clause is, for example: "IWI"='Whakatōhea', the transaction is successful and returns the expected records. However, when the WHERE Clause is set with a User Parameter "IWI"='$(IWI)'and the User Parameter is set with the value Whakatōhea, the transaction is successful but no records are found.This behavior is only affecting records with macronated vowels, which is common in Maori language.  Users need to be able to input their Iwi of interest for this workbench.Can anyone suggest where the WHERE clause setup might fail?Many thanks  

Hi,Suddenly, the feature count in FME Desktop disappeared, even with the "Enable Feature Counting" option ON.The log shows: Cannot connect to feature count server "65051."Why does this happen?The problem occurs with all formats.Thanks.

Hello,I am writing to ESRI geodatabase that uses MS SQL. Every time I get "Unable to convert value taken from Z_ORIGIN keyword to a float data type". So far i have:Used a 2dforcer,changed the "z scale and z origin" to 0 or 0.00000under table creation parameters set "Contains Z Values" to No (also set to yes, and blank on other trys)Recreated the writersSet the writer geometry to table, not a point file.Nothing has worked. I am under the assumption that the writer is passing a "Null" value to the writer which in turn says that "null" cant be a float value.Finally I have looked at the other posts on this and nothing has helped. Any suggestions? Just to update, I used a vertex creator to make new geometry, and still didn't work, but i can insert all of this into a file geodatabase and then import that to my enterprise database. If anyone has any help please post it, this issue doesn't have a good answer on the forms yet.

Hi All, i’m having an issue writing to an AutoCAD DWG file, with a template file. I want to preserve the Model Space, but not the Paper space as i’m editing some attributes within the drawing title block in FME which I want to write back out in the paper space.Even though I am setting preserve paper space in the writer to No, the original blocks from the template file, including the original attribute values, are being written as well as a copy of the block with the new attribute values I have updated in FME. As a result I have 2 overlapping blocks, 1 with the new values I want to keep and 1 with the original values I am trying to replace. I just want a single block with my new values.In the attached, you can see the output from the writer, with the same block duplicated with the new value I have updated and the old value in the template (highlighted in yellow).Any thoughts/ideas/assistance with this would be greatly appreciated, whether this is possible or not possible. I have done si

Recently I put different tables into a PostGIS database. One of these tables contains 23M unique records and does not contain spatial data. I would like to read them into a FME workbench. Do you have some suggestions how I could improve my reading process?Is it possible for example to preselect already a set of columns I need while reading my table using 'SQL to Run before Read'?’ If so do you have a example SQL querry?   Is there a performance difference between  'SQL to Run before Read'?’ and the WHERE clause option in the Constraints menu? 

Hi,I'm using two SentinelDownloaders in my workspace: one to download data from a specific year and another to download data from the previous year. At the end, my workspace shows a "FAILED" message in the API after completing the first SentinelDownloader. I understand there is a conflict because it's the same transformer being used for different dates in the same execution.How can I run this workspace without problems?Thank´s

Hi! I have a workspace with a runtime of effectively 28 hours (this workspace controls slave workspaces, that get 50 million rows of external data). The runtime is only this long for the initial running of the workspace, However it is possible to get severe peaks in runtime due to hystorical data recalculations. I finish the workspace with a SQL executor that merges the retrieved data with already existing data and does some other cleanup. At this point this transformer fails though, forcing me to run the queries manually. I have not saved the log due to my brilliance :). the error given is paraphrased: there is no connection with the oracle server. I think the issue is that a connection is established previously with the oracle server, than put on hold for about 28 hours, than necessary again, with an elapsed acces key. Is there a way to circumvent this? I have not tried, due to time commitment, to untick persistent connection, should that work?

i”m unable to create the web connection despite all the documentation.  

Hello,When using Featurewriter with a template excel file, i encounter en error when trying to open the written excel file which indicates a problem with the Named range "Named range from /xl/workbook.xml part".This happens only since updating to 2024.1.2.0, if I use the same workspace with 2022 version it’s fine.Has this happened to someone else ? is there a workaround ?I’ve tried a lot of things but couldn’t find the issue so for now we run this workspace with 2022.Thanks for your help.

Hi there,I have placed few VIEWS on Oracle Database changing TABLE column names. ie: ID as PLANT_ITEM_IDWhen I connect the VIEW via FME 2023.2.1.0 all column names are showing as what is recorded on Oracle Tables. It is ignoring column names I have set up on VIEWs. How do I get around this issue?I don’t want to use “attribute manager” to change the names. I have already done that on my VIEWs.Is there a way I can see the Column names on VIEWS through FME?thanksRegards,Pushpa  

Hi,I need to extract pixel with value 3 ,8 and 9. Have some transformer that filter the pixel value? Thank´s

I could use some help in understanding how donuts are stored in OSM XML. Or more specifically, why FME Data Inspector is not constructing the donut from the XML. Here is the simple shapefile test data I’ve created.In FME, I’m writing out the OSM using the normal writer:When I read that OSM back into Data Inspector, it doesn’t recognize the shape as a multipolygon. The geometry type is fme_no_geom:The XML code is below. I’m seeing the relation present, so I’m not sure what else is required.<?xml version="1.0" encoding="UTF-8"?><osm version="0.6"> <node lat="34.6596384" lon="-87.0320968" id="-7"/> <node lat="34.5631538" lon="-86.8849822" id="-10"/> <node lat="34.7427899" lon="-86.9769288" id="-8"/> <node lat="34.4741373" lon="-86.9217608" id="-4"/> <node lat="34.6293808" lon="-86.7401662" id="-2"/> <node lat="34.5063457" lon="-87.0619795" id="-5"/> <node lat="34.5536885" lon="-86.9194622" id="-16"/> <node lat="34.5669396" lon="-87.

Hello,There have been some previous posts about converting OSM data in FME, but I’m hoping to breath some new life into the conversation. I have an Overpass Turbo query here meant to query ski area boundaries, lifts, and runs within Colorado. The query works just fine in Overpass Turbo, and I’m able to read the raw XML data into FME with the HTTP Caller no problem. The issue I’m running into is visualizing the data beyond that. I’m aware of the example workflow that is similar to my process, but I don’t understand how the XSLT Processor and XML Fragmenter transformers work. If I use those transformers in my workflow, all the coordinate information seems to disappear when the data is fragmented.Does anyone know how to properly display the XML data in FME? I might need a geometry filter to split out points, lines, and polygons, but I don’t think that’s what is holding me back currently. Any help would be greatly appreciated!

Hi All,I’m creating an archiving workbench for our Esri Enterprise SDE databases. I’m trying to automate checking for an existing version of a raster in either our shared or archived databases and then assigning a version suffix according to if the data already exists in one of the databases. I have the majority of the workbench sorted but struggling to automate renaming the raster to include the version suffix when writing to archive.In my example below I’ve identified that there are two existing versions of the test data “gen_aaa_aaa_test_ras” so I’ve created a name field “archhiveddataname”, which contains the the name I want to give the raster when I write it to Archived “gen_aaa_aaa_test_ras_2”. I can access this information from the schema port but not from the generic. If I include the information from the schema port I get an error saying that I’m trying to write non-raster geometry and the workbench fails. I’m using FME 2023.1.2.0 (20231110 - Build 23641 - WIN64) Thanks in adv

I am trying to see if I can update a feature layer in our ESRI Portal from a FGDB. We know we can insert, update, and delete features and have success on those fronts. However, we will like to also have dynamic schema available as we may change the data in our FGDB by removing/adding fields. I have tried several times to get a dynamic writer working to account for a schema change but without luck. I have tried to delete data in the feature layer to then insert but that had errors. Does anyone have advice or has done this? The FGDB is a testing stage as eventually we would want to update directly from SDE. 

Hey guys, i really struggle to write my geometry to the RunwayTimeSlice Element of the AIXM 5 writer of FME. After the GeometryExtractor i got a string looking like this:  <gml:Surface srsName="EPSG:31467" srsDimension="2"><gml:patches><gml:PolygonPatch><gml:exterior><gml:LinearRing><gml:posList>5544321.76358795 3466140.39319303 5544321.79681692 3466111.70099084 5544321.79831432 3466110.40802792 5544321.8330376 3466080.42553198 5544021.7716845 3466080.40979097 5543896.905 3466084.247 5542896.762 3466080.481 5540345.41046032 3466080.53414733 5540345.41261875 3466140.53829729 5542896.8 3466140.46 5543901.789 3466140.512 5544021.76302164 3466140.39707783 5544321.76358795 3466140.39319303</gml:posList></gml:LinearRing></gml:exterior></gml:PolygonPatch></gml:patches></gml:Surface> which should be the right format for the gml geometry. But when i try to write it in the surfaceProperties Attribute of the writer nothing ha