FME Form

This week I looked at this question on the community. "I have a 100 ft line that curves and then turns back into a straight line. How can I use FME to only gather the straight line after the curve only. I basically want to cut out the curve and only grab the line after the curve." This isn't too difficult, but what's interesting is the contrast with last week's question . Last week (click the link to check it out) I took a linear feature like this, created a list of its vertices, and processed those numbers directly. This week I could do the same, but instead I'm going with a spatial approach. In short, I'm going to divide the line into two-part segments, calculate each segment's angle (bearing or azimuth), and test how much each segment differs from the previous one. Preparing the Data The first step is to prepare our data by chopping it into two-point lines. The alternative is to just extract the coordinates and work on them (as I did last week) but this time it's just that bit easie

Hi, I’m trying to calculate the volume of various areas of beach using point cloud data. I want to calculate it above a horizontal plane at a level input as a user parameter and I have individually references mif/mid polygons demarking the areas. I have been using the method at the below link as a starting point, but the problem is the beach is sloping, not flat, meaning using the z.median value gives an incorrect result. https://support.safe.com/hc/en-us/articles/25407483031053-Volume-Measurements-with-the-VolumeCalculator Any suggestions for a solution would be gratefully recieved!

Hi all, I’m working with a Feature Service containing approximately 1,000,000 sensors stored in a spatiotemporal big data store. I need to update 10,000 of these sensors based on their unique string ID, like sensors-0x21222. Currently, I'm using the FeatureWriter for the 'Esri ArcGIS Portal Feature Service' with the 'Use Global IDs' option enabled and 'Upsert' set as the 'Feature Operation' in the Feature Type. However, 'Upsert' requires a global ID. This approach feels very constrained, as it requires importing all 1 million records, merging them, and finding the global ID for each update. Is there a way to update a Feature Service using a primary key or unique field (such as upserting with a where clause) rather than relying on global IDs? This current method doesn’t seem ETL-friendly, as it requires importing parts of the dataset just to make updates. Thanks in advance for any guidance! Edit: Maybe I don't understand it. But for every featureservice/layer/featuretype I need to add,

I have a harddrive full of data I need to turn into a good database, essentially. I'm starting with converting any shapefiles into feature classes. I know how to convert one shapefile into a feature class, but I'm struggling with multiples that live in multiple areas/folders. I've got two workspaces setup so far. One is a read/write on ALL information in the hardrive. It writes a CSV so I can see what data exists. You can see the PATH in the photo below to see the data this reads. The second is where my reader is set to read all .shp using the following to work through all "\\**\\*.shp" however this obviously does not read the underlying datasets that work together with a ShP to create it (.dbf .prj etc) The write is a Feature dataset and the second is just a GDB set to fanout. None seem to really do the job. Some export just a table, some just two feature classes. I'm not sure if there is more I need to do within the workspace to process Shapefiles. I can't seem to find much documenta

I created a 2D spatial point dataset in a PostGIS database.Today I tried to load them into FME, that works perfect. I get the right locations including the according attributes. I only get this warning: Dimension metadata is ambiguous for spatial column 'geom'. Reporting 3D when 2D+measures might be present Did I forget to set some specific settings while creating this dataset? There should be no 3D data present, I only saved 2D data :)

Hello Forum, I have a polygon dataset of railway land, but it contain holes where items such as buildings, tracks and signal boxes would be. I need to fill in these holes to form a continuous polygon. The image below shows a sample of the data. I’d want to fill in holes like those marked in red. But I do not need to close spaces such as those marked in gold. I’ve seen…. … but I don’t think that’s suitable for the task. I’ve also looked at Dissolver, but I’m not sure if that's the right way to go. Any ideas, please. Thanks, Stuart

I want to be able to use the feature reader transformer for scene layer packages (to combine multiple files) but the format doesn't seem to be supported at the moment. Are there any plans to include this format in the future? I have come across this request but it doesn't seem to have gained much traction: https://community.safe.com/s/idea/0874Q000000Tku4QAC/detail

I'm having a hard time determining which version of OGCGEOPACKAGE that FME produces ? It's not in the writer doc, so I'm asking here. And subsequently, what version of SQLite is produced? (newest is 3.39.4 from Sep 29 this year) As far as I can gather, the versions has been fixed since 2020.0? Is this true? In the "gpkg_extensions" table I found a reference to "spec120", which may (or may not) indicate, that the Geopackage version is 1.2.0, a fairly old version (newest is 1.3.1). And the real question is what extensions are the SQLite database born with? Clearly not "foreign _keys". Can one update some template database if one needs a newer version/more extensions? Cheers.

HI i'm sure there is a very simple answer to the question. I have a polygon with many small holes in it that i want to remove. i'm running a DonutHoleExtractor followed by a tester to select holes <2m squared. i want to merge only these small holes to my main dataset (so only the larger "real" holes are left) i've tried running a Dissolver however this takes ages to run. can anyone think of another tool that would just merge these small holes into the larger polygons they touch?

Hello all, I have an Oracle Spatial table that contains some records with a Point geometry and some records with a Polygon geometry. Considering the large number of records, I would like to take advantage of the ability of the Oracle Spatial Reader to perform a SELECT within the Oracle database and return only records with a Point geometry (This is preferable to Reading all records and then using a GeometryFilter for performance reasons) How to I write the SELECT statement? I assume it has something to do with SDO_GEOMETRY, but I just cannot get the syntax correct

I’m using the ArcGIS Portal writer to publish point data to a portal. The dataset publishes successfully in FME and all of the points appear on the map, but the attributes don’t show up in the table. Removing specific fields doesn’t seem to help. Has anyone seen anything like this before?

Hi, I've been trying too use autocad_xref_path and autocad_xref_name to insert file (another dwg) into REALDWG writer feature type. It should be basic. But it's not working. No warnings, no errors. Did anyone succesfully managed to do that? Can you explain me what am I doing wrong Regards, Želimir

Hi everyone, I am brand new to FME and created my first workbench. In a nut shell it does this: Brings in 6 different enterprise geodatabase feature classes using 6 ESRI Geodatabase (ArcSDE Geodb) readers Each reader is connected to a tester to only select ‘active’ values in a status field Because I selected ‘resolve domains’ in the reader, an additional field for every field that had a domain was created. It was suffixed with “_resolved”, so I used 6 bulk attribute renamer transformers to rename the fields without the ‘_resolved” I then did 6 attribute removers and removed any fields I did not need when it came to exporting (note, many of the fields between each feature class were the same, but there were some differences) Finally, I used 6 different feature writers to export each feature class into a single geodatabase As you can see, I repeated the process 6 different times for every reader/feature class that I had. I was thinking to myself while doing this, ‘this cannot be the righ

Hi, I would like to create a workspace that reads all tables that start with the same prefix. I then want to save the result per table as a shape file. If a table is modified by a add or remove an attribute, the workspace should pick this up automatically. Is that possible? My first thought was to work with a dynamic reader, but then I get stuck that it will retrieve all tables, including in other schemas within the database. The second approach is, I create a query that generates select statements and puts these statements in a text file. I then read the text file with a textline reader and install an SQLExecuter. That's all going well.What I run into is that the SQLExceuter cannot automatically expose all attributes.

Hi, I need to find into a network of GPS lines the location where 2 line overlaps or where a single line overlap The problem is that of course the lines aren’t exact the same (the lines derived form GPS points so I don’t have a duplicate geometry) and only a portion of this lines overlaps see picture attacherd If you need the sample of shape dataset let me know thx Francesco

Hello Everyone, I have two datasets, which I essentially want to stack on one another. One datasets has data on rivers, streams, and brooks, while the other has information on ponds, lakes, and reservoirs. They all have the same attributes, so I just want to add the pond, lakes, and reservoir data as new rows in the river, streams, and brooks dataset. Can someone please help me figure this out?

Hello everyone, I encountered a similar issue as the one described in the following post: https://knowledge.safe.com/questions/95574/problem-with-postgis-reader-in-fme-2019-infinity-v.html Basically I had an invalid date in my PostgreSQL table (no idea how it got there). It had a value of 201910-11-10 which of course is not valid whatsoever. FME 2020 ( Build 20238 - WIN64) throws an error when you try to read this table using a Reader, a FeatureReader or an SQLExecutor/creator. I was able to bypass this by adding a where clause upon reading (e.g. mydatefield < '2021-01-01'). I'm not looking for a solution for my problem here. I just wanted to add this to the forum so that people who encounter a similar issue know how to solve it. The FME software currently throws an error which is not really useful for debugging purposes (POSTGRES reader::bad_expected_access).

Hi, I’m using XSD Driven XML Writer with XSD’s specified in schemaLocation. When I use absolute paths it works fine. When I try to use relative paths to the schemas I receive a error message. http://www.company.de/example file://${FME_MF_DIR}schemas/app-schema/somename/5.1/somefile.xsd Ends up in an error: XML Parser error: 'Error at file: '' line: 0 column: 0 message: unable to open primary document entity 'C:\Windows\System32/file://${FME_MF_DIR}schemas/app-schema/somename/5.1/somefile.xsd''An error occurred while attempting to parse the XML Schema document 'file://${FME_MF_DIR}schemas/app-schema/somename/5.1/somefile.xsd' No idea why System32 is there since my FME_MF_DIR should be c:\projects\myproject

Dear FME Community, I have a FME Form and also ArcGIS Pro license. I am new to IFC format and also new to FME Workbench. I want to view and work with the IFC Files in ArcGIS Pro and later publish it as a WebScene in ArcGIS Online. I do not have Data Interoperability Extension License for ArcGIS Pro. To achieve this i need to clarify below questions : Using FME 2023.2 and ArcGIS Pro 3.4.0 How to convert IFC files to ESRI Geodatabase using Workbench ? Should i change the Coordinate system (Gauß-Krüger) of IFC files in order to view and work with the files in ESRI Geodatabase (ETRS89.UTM-32N) ? Which coordinate system should the output files have in order to work in ArcGIS Pro ? Please find the screenshots for more information. IFC Files with Coord.System Writer Format with Coord.System A detailed solution with working steps would be helpful. Thank you.

Hi, I created a simple StringSearcher in FME Form and want to use the resulting “All matches” list in consecutive transformers. I can access / log the results properly in FME Form. However, when I publish the workbench to FME Flow, the list isn’t exposed and cannot be accessed. Can You reproduce the behavior? RegardsStefan FME 2024.0.1.0 (20240328 - Build 24202 - win64)FME Flow 2024.0 (Build 24187 - win64)

Hi! I have been using the HTTPCaller Specify Upload Body to upload files to Saleforce. It has been working smoothly with only one problem, which is the size limit that can be uploaded via this method. Saleforce advises that I need to use Mutipart method instead. If I’m using Python, below is the data that I will be sending with Multipart method (basically I just wanted to upload this file called test.PNG): [('entity_content', b'\n------boundaryString\nContent-Disposition: form-data; name="entity_content";\nContent-Type: application/json\n\n{\n "ContentDocumentId" : "",\n "ReasonForChange" : "test upload",\n "PathOnClient" : "test.PNG"\n}\n\n------boundaryString\nContent-Type: application/octet-stream\nContent-Disposition: form-data; name="VersionData"; filename="test.PNG"\n\n'), ('VersionData', ('test.PNG', <_io.BufferedReader name='<file_path>test.PNG'>, 'application/octet-stream')), ('', b'\n------boundaryString--\n')] However I’m not sure how to populate those data into the FME HTTP

Using the same polygon the Generalizer (Douglas, tolerance=0) returns different results depending on the orientation of the polygon. Any explanation?

I have many parquet files stored in an s3 bucket; when I use the s3 connector to download the parquet file, I am able to read it successfully, but passing the s3 uri (“s3://”) raises an error: PARQUET reader: PARQUET reader: Failed to open file 's3:\my-bucket-s3-test\fme-test\test.parquet' for reading. Please ensure that the file exists and you have sufficient privileges to read itFailed to obtain any schemas from reader 'PARQUET' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more information When I try to pass the url: PARQUET reader: PARQUET reader: Failed to open file 'HTTPS:\s3.us-west-2.amazonaws.com\my-bucket-s3-test\fme-test\test.parquet' for reading. Please ensure that the file exists and you have sufficient privileges to read it When I use the feature reader, regardless of whether or not I specify a web connection, it converts forward slashes to back slashes. How do I work

I'm trying to use the WHERE Clause in a FeatureReader. I'm reading in an Oracle SDE featureclass and want to only select those records that match an attribute in a csv file I've loaded. I'm assuming that I have everything setup correctly where the attributes from the csv file are FME Feature Attributes. It seems when I add the @Value(col0) to my WHERE Clause, it breaks. How can I check to make sure it is setup correctly?

Hi, I have downloaded, installed and uninstalled all versions of FME Form from 2024.0 up to latest 2024.2 and still having issues reading and or creating a new reader from Microsoft SQL Server. Every time I create a new and or update reader transformer, the reader disappears. Same when I create a new reader, it never show up. I have another machine that runs (2023.1.1.1 (20231011 - Build 23636 - WIN64) and it runs fine. I want to update my version as this old version is unable to read from Amazon RDS. Has anyone experienced this or experiencing this? Update * after further investigations. I have found the below. There seems to be incompatibility with the versions and I could not find a version that can read both version of MSQL. Microsoft SQL Versions FME Form 2023 (x64) FME Form 2024 (x64) Microsoft SQL Server 2017 - 14.0.3480.1 (x64) TRUE FALSE Microsoft SQL Server 2019 - 15.0.4410.1 (x64) FALSE TRUE