FME Form

Hi all, I've got some confusing to clear, and hope to find an answer here. I have 2, completely the same datasets, uploaded to ArcGIS Online. Now, i want to update them. To test it, i took 2 completely identical layers, read them from AGOL and now, it shows differences. Can someone explain me what the problem is? If i only check on attributes, then there is nothing wrong, but if i also check on geometry, there is somewhere a change, and the Changedetector gives updates as output, but it should be unchanged. All the data is 2D, there is no 3D. In the update detection key attributes, i selected all the attributes, but left GlobalID and OBJECTID out of it. same for check attributes. Even more confusing, if i do the same process in a new workbench, with the same sources etc, i get different results. Sometimes it igeve met 900 updated, and somethimes 1322 Thanks in advance!

Hi I am doing migration testing from 2023.1.2 and 2024.0.3. It seems to completely fails on 2024.1. I have tested it on 2023.1.2 and 2024.0.3, worked perfect - no issues. It fails on FME Flow and FME Form on the server - but works OK on my local PC on the server - oldeb 2019, clr 2019, are installed, as with .net 4.7, 4.8 and It is just a simple sql server spatial reader - and a bit of reprojection - it fails on reading the reading the data Cheers Rudy

So, our organisation has a maintenance management system for our roads, which now for some reason, no longer works with geometry which has duplicate nodes within the same polyline. I’ve been able to narrow this down to two cases where our road polylines layer violates this rule: Some roads have duplicate consecutive nodes due to mapping mistakes, which I’ve fixed with GeometryValidator. Some roads (such as roundabouts and parking area outlines) have the same start and end node. This is where I’m getting stuck. The potential solution that I’m looking for is something that can determine the polylines with the same start and end point with a small tolerance (0.1m would do the trick) as I could only get GeometryValidator to work as expected with this tolerance, then offset the end node by a small figure (perhaps 0.5m) back toward the penultimate node. This way, the polyline still keeps enough of the line to be usable, but will work with the management system. But, I’m happy to note any oth

Hi, I’m wondering if it’s possible to create a list of layers included in an online application like Geoportal Map. I tried using the HTTP Caller, but I’m only getting general information about the webpage and no details about its content. Do you have any suggestions for extracting this data?

I am trying to read an ALKIS data file coming as XML file. I have two files, the first one come with version 6.0 and FME opens this file without any problem (xmlns="http://www.adv-online.de/namespaces/adv/gid/6.0"). However, when i try to read the version 7.1 (xmlns="http://www.adv-online.de/namespaces/adv/gid/7.1") I got an error as following: XML Parser error: 'Error at file: 'K:\…….. line: 1 column: 1 message: invalid document structure' An error occurred while attempting to parse the XML Schema document 'file:///K:/Geodaten/Projekte/ALKIS/2411_ALKIS_NAS/NAS-Operationen.xsd' The XML Module halted on error, see the logfile for details A fatal error has occurred. Check the logfile above for details Failed to specify the feature index as constraints on the reader Failed to obtain any schemas from reader 'NAS' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more information do you have

I am trying to use the duckdb summarize command https://duckdb.org/docs/archive/0.9/guides/meta/summarize in an in memory duckdb using the sqlexecutor: SUMMARIZE SELECT * FROM read_parquet('/Users/x/Downloads/Address.parquet'); This doesn’t return any results/attributes but ‘runs’ successfully in FME. In DBeaver it runs no issues. Any idea is there is a trick to get this working? Many ThanksQ!

Hello, I’m having problems trying to write into a Azure Storage Table using the Azure Storage Table writer. It works for all text fields read from CSV but not possible both from Parquet file or Oracle connection where I include also floating or integer fields. The error is always the following Microsoft Windows Azure Table Writer: Failed 'INSERT' for rows in table 'xxxxxx'. Server response: 'HTTP Error Status Code #400: 0:One of the request inputs is not valid.' Suggestions? Thanks in advance, Roberto

This week I looked at this question on the community. "I have a 100 ft line that curves and then turns back into a straight line. How can I use FME to only gather the straight line after the curve only. I basically want to cut out the curve and only grab the line after the curve." This isn't too difficult, but what's interesting is the contrast with last week's question . Last week (click the link to check it out) I took a linear feature like this, created a list of its vertices, and processed those numbers directly. This week I could do the same, but instead I'm going with a spatial approach. In short, I'm going to divide the line into two-part segments, calculate each segment's angle (bearing or azimuth), and test how much each segment differs from the previous one. Preparing the Data The first step is to prepare our data by chopping it into two-point lines. The alternative is to just extract the coordinates and work on them (as I did last week) but this time it's just that bit easie

Hi, I’m trying to calculate the volume of various areas of beach using point cloud data. I want to calculate it above a horizontal plane at a level input as a user parameter and I have individually references mif/mid polygons demarking the areas. I have been using the method at the below link as a starting point, but the problem is the beach is sloping, not flat, meaning using the z.median value gives an incorrect result. https://support.safe.com/hc/en-us/articles/25407483031053-Volume-Measurements-with-the-VolumeCalculator Any suggestions for a solution would be gratefully recieved!

Hi all, I’m working with a Feature Service containing approximately 1,000,000 sensors stored in a spatiotemporal big data store. I need to update 10,000 of these sensors based on their unique string ID, like sensors-0x21222. Currently, I'm using the FeatureWriter for the 'Esri ArcGIS Portal Feature Service' with the 'Use Global IDs' option enabled and 'Upsert' set as the 'Feature Operation' in the Feature Type. However, 'Upsert' requires a global ID. This approach feels very constrained, as it requires importing all 1 million records, merging them, and finding the global ID for each update. Is there a way to update a Feature Service using a primary key or unique field (such as upserting with a where clause) rather than relying on global IDs? This current method doesn’t seem ETL-friendly, as it requires importing parts of the dataset just to make updates. Thanks in advance for any guidance! Edit: Maybe I don't understand it. But for every featureservice/layer/featuretype I need to add,

I have a harddrive full of data I need to turn into a good database, essentially. I'm starting with converting any shapefiles into feature classes. I know how to convert one shapefile into a feature class, but I'm struggling with multiples that live in multiple areas/folders. I've got two workspaces setup so far. One is a read/write on ALL information in the hardrive. It writes a CSV so I can see what data exists. You can see the PATH in the photo below to see the data this reads. The second is where my reader is set to read all .shp using the following to work through all "\\**\\*.shp" however this obviously does not read the underlying datasets that work together with a ShP to create it (.dbf .prj etc) The write is a Feature dataset and the second is just a GDB set to fanout. None seem to really do the job. Some export just a table, some just two feature classes. I'm not sure if there is more I need to do within the workspace to process Shapefiles. I can't seem to find much documenta

I created a 2D spatial point dataset in a PostGIS database.Today I tried to load them into FME, that works perfect. I get the right locations including the according attributes. I only get this warning: Dimension metadata is ambiguous for spatial column 'geom'. Reporting 3D when 2D+measures might be present Did I forget to set some specific settings while creating this dataset? There should be no 3D data present, I only saved 2D data :)

Hello Forum, I have a polygon dataset of railway land, but it contain holes where items such as buildings, tracks and signal boxes would be. I need to fill in these holes to form a continuous polygon. The image below shows a sample of the data. I’d want to fill in holes like those marked in red. But I do not need to close spaces such as those marked in gold. I’ve seen…. … but I don’t think that’s suitable for the task. I’ve also looked at Dissolver, but I’m not sure if that's the right way to go. Any ideas, please. Thanks, Stuart

I want to be able to use the feature reader transformer for scene layer packages (to combine multiple files) but the format doesn't seem to be supported at the moment. Are there any plans to include this format in the future? I have come across this request but it doesn't seem to have gained much traction: https://community.safe.com/s/idea/0874Q000000Tku4QAC/detail

I'm having a hard time determining which version of OGCGEOPACKAGE that FME produces ? It's not in the writer doc, so I'm asking here. And subsequently, what version of SQLite is produced? (newest is 3.39.4 from Sep 29 this year) As far as I can gather, the versions has been fixed since 2020.0? Is this true? In the "gpkg_extensions" table I found a reference to "spec120", which may (or may not) indicate, that the Geopackage version is 1.2.0, a fairly old version (newest is 1.3.1). And the real question is what extensions are the SQLite database born with? Clearly not "foreign _keys". Can one update some template database if one needs a newer version/more extensions? Cheers.

HI i'm sure there is a very simple answer to the question. I have a polygon with many small holes in it that i want to remove. i'm running a DonutHoleExtractor followed by a tester to select holes <2m squared. i want to merge only these small holes to my main dataset (so only the larger "real" holes are left) i've tried running a Dissolver however this takes ages to run. can anyone think of another tool that would just merge these small holes into the larger polygons they touch?

Hello all, I have an Oracle Spatial table that contains some records with a Point geometry and some records with a Polygon geometry. Considering the large number of records, I would like to take advantage of the ability of the Oracle Spatial Reader to perform a SELECT within the Oracle database and return only records with a Point geometry (This is preferable to Reading all records and then using a GeometryFilter for performance reasons) How to I write the SELECT statement? I assume it has something to do with SDO_GEOMETRY, but I just cannot get the syntax correct

I’m using the ArcGIS Portal writer to publish point data to a portal. The dataset publishes successfully in FME and all of the points appear on the map, but the attributes don’t show up in the table. Removing specific fields doesn’t seem to help. Has anyone seen anything like this before?

Hi everyone, I am brand new to FME and created my first workbench. In a nut shell it does this: Brings in 6 different enterprise geodatabase feature classes using 6 ESRI Geodatabase (ArcSDE Geodb) readers Each reader is connected to a tester to only select ‘active’ values in a status field Because I selected ‘resolve domains’ in the reader, an additional field for every field that had a domain was created. It was suffixed with “_resolved”, so I used 6 bulk attribute renamer transformers to rename the fields without the ‘_resolved” I then did 6 attribute removers and removed any fields I did not need when it came to exporting (note, many of the fields between each feature class were the same, but there were some differences) Finally, I used 6 different feature writers to export each feature class into a single geodatabase As you can see, I repeated the process 6 different times for every reader/feature class that I had. I was thinking to myself while doing this, ‘this cannot be the righ

Hi, I would like to create a workspace that reads all tables that start with the same prefix. I then want to save the result per table as a shape file. If a table is modified by a add or remove an attribute, the workspace should pick this up automatically. Is that possible? My first thought was to work with a dynamic reader, but then I get stuck that it will retrieve all tables, including in other schemas within the database. The second approach is, I create a query that generates select statements and puts these statements in a text file. I then read the text file with a textline reader and install an SQLExecuter. That's all going well.What I run into is that the SQLExceuter cannot automatically expose all attributes.

Hi, I need to find into a network of GPS lines the location where 2 line overlaps or where a single line overlap The problem is that of course the lines aren’t exact the same (the lines derived form GPS points so I don’t have a duplicate geometry) and only a portion of this lines overlaps see picture attacherd If you need the sample of shape dataset let me know thx Francesco

Hello Everyone, I have two datasets, which I essentially want to stack on one another. One datasets has data on rivers, streams, and brooks, while the other has information on ponds, lakes, and reservoirs. They all have the same attributes, so I just want to add the pond, lakes, and reservoir data as new rows in the river, streams, and brooks dataset. Can someone please help me figure this out?

Hello everyone, I encountered a similar issue as the one described in the following post: https://knowledge.safe.com/questions/95574/problem-with-postgis-reader-in-fme-2019-infinity-v.html Basically I had an invalid date in my PostgreSQL table (no idea how it got there). It had a value of 201910-11-10 which of course is not valid whatsoever. FME 2020 ( Build 20238 - WIN64) throws an error when you try to read this table using a Reader, a FeatureReader or an SQLExecutor/creator. I was able to bypass this by adding a where clause upon reading (e.g. mydatefield < '2021-01-01'). I'm not looking for a solution for my problem here. I just wanted to add this to the forum so that people who encounter a similar issue know how to solve it. The FME software currently throws an error which is not really useful for debugging purposes (POSTGRES reader::bad_expected_access).

Hi, I’m using XSD Driven XML Writer with XSD’s specified in schemaLocation. When I use absolute paths it works fine. When I try to use relative paths to the schemas I receive a error message. http://www.company.de/example file://${FME_MF_DIR}schemas/app-schema/somename/5.1/somefile.xsd Ends up in an error: XML Parser error: 'Error at file: '' line: 0 column: 0 message: unable to open primary document entity 'C:\Windows\System32/file://${FME_MF_DIR}schemas/app-schema/somename/5.1/somefile.xsd''An error occurred while attempting to parse the XML Schema document 'file://${FME_MF_DIR}schemas/app-schema/somename/5.1/somefile.xsd' No idea why System32 is there since my FME_MF_DIR should be c:\projects\myproject

Dear FME Community, I have a FME Form and also ArcGIS Pro license. I am new to IFC format and also new to FME Workbench. I want to view and work with the IFC Files in ArcGIS Pro and later publish it as a WebScene in ArcGIS Online. I do not have Data Interoperability Extension License for ArcGIS Pro. To achieve this i need to clarify below questions : Using FME 2023.2 and ArcGIS Pro 3.4.0 How to convert IFC files to ESRI Geodatabase using Workbench ? Should i change the Coordinate system (Gauß-Krüger) of IFC files in order to view and work with the files in ESRI Geodatabase (ETRS89.UTM-32N) ? Which coordinate system should the output files have in order to work in ArcGIS Pro ? Please find the screenshots for more information. IFC Files with Coord.System Writer Format with Coord.System A detailed solution with working steps would be helpful. Thank you.