A space to discuss FME Form
Recently active
I am new to using FME and am currently facing an issue. Here's the situation: I want to use a FeatureWriter to create a new file of type Esri Geodatabase (File Geodatabase), and I want to include the value domains of certain attributes when creating the Geodatabase. Thank you!
Hi FME Community!Does anyone know how to create a web service in FME form to connect to ArcGIS Portal?i see this article (https://support.safe.com/hc/en-us/articles/25407635174285-Web-Connections-and-FME#h_01J0S3JP9A7W1TX5B2GG56ZX8S) but could not figure how to properly fill all the parameters to get it working. my goal is to create a token based web connection to authenticate requests to endpoints stored in ArcGIS portal.Thanks in advance!
We have two different buffer results from the same road network and I’m doing some work on identifying what is differentThese are large multipart polygons and I wanted to chop them up to give common parts (overlay > 1) and individual parts. In the picture I want to separate the red hatched bit and the solid blue bits from the combined data. Running the area on area overlayer with no grouping but creating a list of parts results in…Where the orange hatching has created a fill in on the closed triangle and the roundabout. This is not what I was expecting but I cannot find a setting on the transformer to avoid this.Help!!!! ThanksRob
Hello FME Community,I am trying to convert annotations from a CAD (.DWG) file to a GIS (.GDB) file in the form of points, in such a way that each line of annotation text is a separate point with an attribute of this text. Everything seems to work fine in my workbench, however, after attaching to GIS programming and loading the resulting points, it turns out that in many cases additional points have been created in each line of text, which prevents me from using them correctly.Has anyone encountered something like this and would be able to help.I attach screenshots of sample annotations in AutoCAD and after conversion in GIS software.FME version: FME(R) 2023.2.1.0 (20240104 - Build 23774 - WIN64)
I’m fairly new to FME and I’m not sure this is possible. I’m attempting to add a MS Word doc. to multiple zip folders (from a fanout) that contain shapefiles. It’s basically a data dictionary that needs to accompany the shapefiles. Is this possible?
Does anyone have a sample Workbench (WB) for creating a replica using the ArcGIS REST API?
Hi, I cannot convert Epoch time 1717500804837 to 20241210. I have change the format using @Evaluate(@Value(_created)/1000)and run DateTimeConverter but it failed Null, empty, or missing datetime was found. Enable the passthrough parameter to disable this What am I doing wrong?
After spending all morning trying to set up a Data Stream example in FME I think I’ve got it. It’s a basic geofencing setup:I have a GPX file of one of my bike commutes and use a WebSocketConnector in a sending workspace to send one location per second to a websocket.In a second, listening, workspace, that I’m running as a Stream, I’m using a WebSocketConnector to listen to that websocket and compare the locations coming out of that with a polygon. If it falls inside the polygon I then use a HTTPCaller to send me a message via Whatsapp.This is working fine:However, some of the documentation / tutorials I found, such as Websockets and FME Server, seem to imply that this should be possible with Automations too (and mention several other websocket transformers that have been deprecated). Has anybody tried that? Is this even a scenario where that would be useful? At one message per second, if I use the Websocket Received trigger and then the lisening workspace I end up with one new job bei
UPDATE 06/01/25: It does indeed appear that once created, the index is automatically rebuilt on writing to the GDB with truncate existing.Steps to recreate:Add SQL statement to create attribute index after writeCREATE INDEX <name_INDEX> ON <table_name> (<attribute_name>)Run the writer either to create new GDB or update existing GDB Remove SQL statement Continue to run writer as normal going forwards-----------------------------Hi all,This is driving me crazy trying to figure out. I have a GDB writer that builds an attribute index after write.CREATE INDEX <name_INDEX> ON <table_name> (<attribute_name>)Unbeknownst to me, each time I updated the data, an additional index was being created instead of overwritten which led to a bloated GDB and blown out write times. Note: The GDB table handling is set to truncate before write.I first went to using the below statement, but I was unsuccessful. ALTER INDEX <name_INDEX> ON <table_name> REBUILDThe
Hello, unfortunately I have repeatedly problem with exporting to Excel in Workspace. I checked log, there is following message: 2016-11-24 10:05:57| 67.6| 0.2|ERROR |Excel Writer: Failed to save changes to the spreadsheet 'D:\\XXX\\XXX\\XXX\\new.xlsx'. Check that you have write permission to the file, it has no password protection and is not opened by another application. Error message is 'Permission denied.'It looks, that there is error on Excel side, right? I just want to create new Excel file...
I have 501 polygons of various shapes and sizes. I want to split it up in clusters of roughly 20 polygons each. But I wan the clusters to be located together. I have tried the spatialsorter, which gives good results. But not quite what I’m looking for. Is this possible? Any help would be greatly appreciated. ThanksB
Morning,I have access to the bucket and can read files. However, when I attempt to download a file I receive the following error:My admin insists I have the correct credentials, and I can download this file using WinSCP. Are there are settings I might be missing on the connector?
Hi all, i've got a strage error. I have about 30 ArcGIS Online readers that i want to read, update and write back to ArcGIS Online. Now, the update part with the Changedetector workes fine. (Dont look at the mess ;). The problem:When i run the workspace, it gets all the 41K features that are in there. The other ones are skipped because it is not found. This works as it should work. After that it tries to search in groups accessible to the user, and then it says "error running translation”. Does anyone know how to fix this? I have attached the log file and the workspace. Thanks in advance!
Hi all, I've got some confusing to clear, and hope to find an answer here. I have 2, completely the same datasets, uploaded to ArcGIS Online. Now, i want to update them. To test it, i took 2 completely identical layers, read them from AGOL and now, it shows differences. Can someone explain me what the problem is? If i only check on attributes, then there is nothing wrong, but if i also check on geometry, there is somewhere a change, and the Changedetector gives updates as output, but it should be unchanged. All the data is 2D, there is no 3D. In the update detection key attributes, i selected all the attributes, but left GlobalID and OBJECTID out of it. same for check attributes. Even more confusing, if i do the same process in a new workbench, with the same sources etc, i get different results. Sometimes it igeve met 900 updated, and somethimes 1322Thanks in advance!
Hi I am doing migration testing from 2023.1.2 and 2024.0.3. It seems to completely fails on 2024.1.I have tested it on 2023.1.2 and 2024.0.3, worked perfect - no issues.It fails on FME Flow and FME Form on the server - but works OK on my local PCon the server - oldeb 2019, clr 2019, are installed, as with .net 4.7, 4.8 andIt is just a simple sql server spatial reader - and a bit of reprojection - it fails on reading the reading the dataCheersRudy
So, our organisation has a maintenance management system for our roads, which now for some reason, no longer works with geometry which has duplicate nodes within the same polyline. I’ve been able to narrow this down to two cases where our road polylines layer violates this rule:Some roads have duplicate consecutive nodes due to mapping mistakes, which I’ve fixed with GeometryValidator. Some roads (such as roundabouts and parking area outlines) have the same start and end node. This is where I’m getting stuck.The potential solution that I’m looking for is something that can determine the polylines with the same start and end point with a small tolerance (0.1m would do the trick) as I could only get GeometryValidator to work as expected with this tolerance, then offset the end node by a small figure (perhaps 0.5m) back toward the penultimate node. This way, the polyline still keeps enough of the line to be usable, but will work with the management system. But, I’m happy to note any other
Hi,I’m wondering if it’s possible to create a list of layers included in an online application like Geoportal Map. I tried using the HTTP Caller, but I’m only getting general information about the webpage and no details about its content.Do you have any suggestions for extracting this data?
I am trying to read an ALKIS data file coming as XML file. I have two files, the first one come with version 6.0 and FME opens this file without any problem (xmlns="http://www.adv-online.de/namespaces/adv/gid/6.0"). However, when i try to read the version 7.1 (xmlns="http://www.adv-online.de/namespaces/adv/gid/7.1") I got an error as following:XML Parser error: 'Error at file: 'K:\……..line: 1 column: 1 message: invalid document structure'An error occurred while attempting to parse the XML Schema document 'file:///K:/Geodaten/Projekte/ALKIS/2411_ALKIS_NAS/NAS-Operationen.xsd'The XML Module halted on error, see the logfile for detailsA fatal error has occurred. Check the logfile above for detailsFailed to specify the feature index as constraints on the readerFailed to obtain any schemas from reader 'NAS' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more information do you have any so
I am trying to use the duckdb summarize commandhttps://duckdb.org/docs/archive/0.9/guides/meta/summarizein an in memory duckdb using the sqlexecutor:SUMMARIZE SELECT * FROM read_parquet('/Users/x/Downloads/Address.parquet');This doesn’t return any results/attributes but ‘runs’ successfully in FME. In DBeaver it runs no issues.Any idea is there is a trick to get this working?Many ThanksQ!
Hello,I’m having problems trying to write into a Azure Storage Table using the Azure Storage Table writer.It works for all text fields read from CSV but not possible both from Parquet file or Oracle connection where I include also floating or integer fields. The error is always the followingMicrosoft Windows Azure Table Writer: Failed 'INSERT' for rows in table 'xxxxxx'. Server response: 'HTTP Error Status Code #400: 0:One of the request inputs is not valid.'Suggestions?Thanks in advance,Roberto
This week I looked at this question on the community. "I have a 100 ft line that curves and then turns back into a straight line. How can I use FME to only gather the straight line after the curve only. I basically want to cut out the curve and only grab the line after the curve." This isn't too difficult, but what's interesting is the contrast with last week's question. Last week (click the link to check it out) I took a linear feature like this, created a list of its vertices, and processed those numbers directly. This week I could do the same, but instead I'm going with a spatial approach. In short, I'm going to divide the line into two-part segments, calculate each segment's angle (bearing or azimuth), and test how much each segment differs from the previous one. Preparing the DataThe first step is to prepare our data by chopping it into two-point lines. The alternative is to just extract the coordinates and work on them (as I did last week) but this time it's just that bit easier
Hi, I’m trying to calculate the volume of various areas of beach using point cloud data. I want to calculate it above a horizontal plane at a level input as a user parameter and I have individually references mif/mid polygons demarking the areas.I have been using the method at the below link as a starting point, but the problem is the beach is sloping, not flat, meaning using the z.median value gives an incorrect result.https://support.safe.com/hc/en-us/articles/25407483031053-Volume-Measurements-with-the-VolumeCalculatorAny suggestions for a solution would be gratefully recieved!
Hi all,I’m working with a Feature Service containing approximately 1,000,000 sensors stored in a spatiotemporal big data store. I need to update 10,000 of these sensors based on their unique string ID, like sensors-0x21222.Currently, I'm using the FeatureWriter for the 'Esri ArcGIS Portal Feature Service' with the 'Use Global IDs' option enabled and 'Upsert' set as the 'Feature Operation' in the Feature Type. However, 'Upsert' requires a global ID.This approach feels very constrained, as it requires importing all 1 million records, merging them, and finding the global ID for each update.Is there a way to update a Feature Service using a primary key or unique field (such as upserting with a where clause) rather than relying on global IDs? This current method doesn’t seem ETL-friendly, as it requires importing parts of the dataset just to make updates.Thanks in advance for any guidance! Edit:Maybe I don't understand it. But for every featureservice/layer/featuretype I need to add, to fi
I have a harddrive full of data I need to turn into a good database, essentially.I'm starting with converting any shapefiles into feature classes. I know how to convert one shapefile into a feature class, but I'm struggling with multiples that live in multiple areas/folders.I've got two workspaces setup so far.One is a read/write on ALL information in the hardrive. It writes a CSV so I can see what data exists. You can see the PATH in the photo below to see the data this reads.The second is where my reader is set to read all .shp using the following to work through all "\\**\\*.shp" however this obviously does not read the underlying datasets that work together with a ShP to create it (.dbf .prj etc)The write is a Feature dataset and the second is just a GDB set to fanout. None seem to really do the job. Some export just a table, some just two feature classes.I'm not sure if there is more I need to do within the workspace to process Shapefiles. I can't see
I created a 2D spatial point dataset in a PostGIS database.Today I tried to load them into FME, that works perfect. I get the right locations including the according attributes.I only get this warning:Dimension metadata is ambiguous for spatial column 'geom'. Reporting 3D when 2D+measures might be presentDid I forget to set some specific settings while creating this dataset? There should be no 3D data present, I only saved 2D data :)