Transformers

I have a job that downloads 7 text files from an FTP directory, and for the last 3 days, 6/7 files have downloaded but 1 always fails (the same one each time) with the error: Number of redirects hit maximum amountI am aware of the post below, but as no similar setting exists on the FTP caller, I’m lost. I can upload fine, and manually downloading the files by logging into the FTP site, or using a WinSCP script also works. The file that failed today was empty (0MB), but so are some of the other files it downloads, and yesterdays file had records and still failed. Empty files are not uncommon for this job, and it has never presented an issue before. This has started occurring since upgrading to 2025.1.3 from 2022, and occurs on both FME Flow and Form. This error has so far not appeared in any other workspaces that use FTP callers, even for multiple file downloads at once. I’m leaning toward this being an issue with the file, rather than the FTP, but I cannot see a problem with the file t

Hi  I have spent far too many hours trying to make the change detector dynamically pick up changes. The scenario is: I have 10 datasets that need to be compared between the original and updated databases. Each dataset has only a few fields that need to be checked for changes. These fields are different for each dataset. I have a CSV which is acting as a 'config' file and contains a list of the field names to check for each datasetI have 2 workbenches; the first workbench gets all of the information from the config file, then passes through the information via user-parameters to the Change Detection workbench via workspace runner. Even though I have created a user parameter for the "Match Selected Attributes" config in the ChangeDetector, I can't pass through this information via the workspace runner. It ONLY works if I run the Change Detection workbench individually, and this isn't linked to the config file, so it's not dynamic at all.  I got so frustrated

Hi, sometimes the XML Driven XML Writer decides that I have not set the Application Schema when I click on FeaturePaths edit button. As you can see it is set and the XSD file behind works well in a different workspace. But for some reason I get the error you can see in the attachment and I don’t know why. Starting a workspace from scratch works again with the same settings. Thank you for advice.

Hi everyone,I’m working with DWG files in FME — reading them, attaching XREFs, and then writing back to DWG.I’m trying to attach an XREF to a specific layer (something other than Layer 0), but so far I haven’t had any success. I’ve tried setting both the fme_feature_type and autocad_layer attributes, but the XREF still ends up on Layer 0.It also seems that when using the DWG reader, FME always interprets XREFs as being on Layer 0, even when they’re on a different layer in the source DWG.Has anyone found a way to preserve or specify the layer assignment for XREFs when reading/writing DWG files in FME?Thanks in advance!

Looking at the new Define Read Criteria By: Custom Query option in the FeatureReader in 2025.1I feel like there should be a warning against using Define Read Criteria with Esri Geodatabase format as it uses sql and bypasses specific SDE functionality. 

We have a polygon shapefile in which features overlap because the data is self-reported. During our analysis, we noticed that when a feature is 100% overlapped by another, it is not considered in the clip process with another dataset. However, we want all features—even those that are fully overlapped—to be taken into account when performing the clip. What configuration or procedure should we use to ensure this behavior?

Hi FMEers, I’m trying to create a basic map using the HtmlReportGenerator. I’ve added 2 polygon hosted feature layers from our ArcGIS Enterprise Portal, that are comma separated in that URL field. They are shared with groups that I am a member of so I have access to view them.When I send it through to an html writer, the output map is blank. I wasn’t sure if that was because it is offline so I also published to FME Flow but it’s still blank:  I also tried with a layer shared to public from our portal with the same results.Is there something I’m missing from the docs?

Hi guys,how can i handle to read in Excel sheets (with other column names from time to time) and have the possibility to choose from a schema (xls) the right attribute names for the workflow…..Parameters on the reader?I’ve tried the Attributemanager and import a excel file...but the names from the excel sheet are only added to the default output attribute names a dropdown list on the Output Attribute name would be great……..any help to handle it or a link to another articleGreetz and thanksFranco

I have the following table, very simple:DATE_START ID 19921101 0502010000013950 19950209 0502010000013950 20031231 0502010000013950 20040115 0502010000013950 20040120 0502010000013950 20110704 0502010000013950 20200211 0502010000013950 20251005 0502010000013950  I want to make te following result: DATE_START DATE_END ID 19921101 19950209 0502010000013950 19950209 20031231 0502010000013950 20031231 20040115 0502010000013950 20040115 20040120 0502010000013950 20040120 20110704 0502010000013950 20110704 20200211 0502010000013950 20200211 20251005 0502010000013950 20251005 null 0502010000013950  Date_end is next value of date_start to create a cycles like this. This what i did:    I get to following result:U see the problem is with the last date_end, he is using for that feature the first date_start. I dont now how. Anyone a solution?

This issue seems to appear again in FME 2025.1! 

I'm trying to update (or rather replace) rows with new features and write them to geopackage. The problem is geopackage primary key is "id" that is generated when writing geopackages and I'm reading features from postgres where that same id doesn't exists and another id (let's call it ChangeID) is used as a primary key. ChangeID does exist in the geopackages and postgres table but geopackages primary key must be "id".  Unfortunately I have no control over why the id's is implemented like this. Also I know i could read those geopackages in to fme to get the "id"s but the problem is the dataset is hundreds of geopackages resulting in 100 millions of rows so the whole workflow is designed no to do that because that would result to weeks of runtime. I have a workflow to get rows that need to be replaced but fail to write them into geopackages because i can't use ChangeID to replace the rows because of different primary key. I know there

I'm having a set of polygons and for every polygon a raster with height values. I'm combining them in the TIN generator to create TIN's for every polygon. Now I see a big difference in behaviour of the TIN generator, depending on the amount of polygons I'm sending to it. For example: when I use one single polygon as input, as a result I get a TIN with 234 triangles.If I use 459 polygons as input and proces them individually by using Group processing, the result of the same polygon is a TIN with 3602 triangles. Can anyone explain why this is happening and how to prevent it?

Hi,I am using the AutoCAD Reader to extract external references from DWG files. When I get to the same file in the directory in results in an “Error running translation” error. However, if I run the Reader against the individual file, it works fine. I have removed the file from the directory and it then errors later on a different file. I believe this could be a memory issue? How can I resolve?I am only running the Reader and no other Transformers.Any help would be appreciated.Thanks.

I have used a PythonCaller to flatten a xml dataset and have many handfulls of attributes that need to be exposed. Cutting and pasting into the AttributeExposer does not feel appealing. Surely there must be an easier way to do this? After all the features already have these attributes, only they are set to be Unexposed. It should be just a hide-unhide setting that is needed? 

We upgraded FME from 2022.2.2 to 2024.0.2.2 one week ago, and I found out today the SQLExecutor gives an error for the SQL Server T-SQL Merger statement.  The SQLExecutor is set up as follows:----------------------------------------------------------------------------------------------------------FME_SQL_DELIMITER ;use VENDOR_GLOBAL_SPGI;MERGE INTO SPGI_INT.BLOCKS_VALID_INT AS tUSING (select distinct GA_ID,BLOCK_NAME,ONS_OFFSHORE from SPGI_INT.BLOCKS_VALID) AS sON t.GA_ID = s.GA_ID and t.BLOCK_NAME = s.BLOCK_NAMEWHEN MATCHED THEN    UPDATE SET t.ONS_OFFSHORE = S.ONS_OFFSHORE;--------------------------------------------------------------------------------------------------------It gives this error:Microsoft SQL Server Non-Spatial Reader: Query failed, possibly due to a malformed statement.  Query Text `MERGE INTO SPGI_INT.BLOCKS_VALID_INT AS tUSING (select distinct GA_ID,BLOCK_NAME,ONS_OFFSHORE from SPGI_INT.BLOCKS_VALID) AS sON t.GA_ID = s.GA_ID and t.BLOCK_NAME = s.BLOCK_NAMEWHEN MATC

Hi All,We have deployed FME Flow 2024.2.2 with ArcGIS 3.4 and wanted to run a few tests to ensure that Flow works correctly with the arcpy library. Below is the installation setup on the same virtual machine:FME Flow 2024.2.2 ArcGIS 3.4I have created a very simple Workbench in FME Form that invokes arcpy, and it works fine with the following Python compatibilities:Esri ArcGIS Python 3.9+ Esri ArcGIS Python 3.11I uploaded the same Workbench into FME Flow 2024.2.2 and encountered the following error after running the tool:Any idea? I have tried with 3.9 and 3.11 already,Thanks in advanced :)

Hello,Created a nice workbench with FMe. However, there are also many individual points in the data, which are poorly visible.Which transformer can you use to replace a point in the data with a symbol (e.g., a circle with a specific diameter)?This improves clarity and better visualization in the final result.

Hi I am uploading data to S3 using the S3 connector. However, empty folders are not being uploaded, even though I have selected “Contents only” as No. I need to upload some projects that contain empty folders and subfolders as well.!--startfragment>  Many thanksNasir

I’m running FME 2024 soon to be 2025.My workflow is reading tables from SQL Server and writing them to Snowflake.Can someone please advise if it is possible to have the workflow automatically handle new columns being created on the source table?I don’t want to have to publish a new version of a workflow just because a source table has a new column added to it.Thanks in advance.

Hi,I have 3 raster’s that I wish to merge into one. Two of the 3 are of the exact same extent, cell size and CRS. The third has a larger extent (but overlapping the first two) and a smaller cell size. The issue I am having is that once I have resampled and clipped the 3rd raster to the extent of the other two they are mis-aligned, and I can’t figure out how to fix it. I need them to be exactly aligned so I can merge them. So far this is my method:Read in all 3 raster’s and ensure their CRS is the same (Using ... Resample the 3rd raster to the cell spacing of the other two (5000 x 5000) Raster 1Raster 2Resampled Raster 3Clip the 3rd raster to the extent of the other two:I use RasterExtentsCoercer for one of the first two raster’s (as they have identical extents). Set extents type to ‘Data Extents’. As I want the data extent clipping not the outer extent rectangle. Then using clipper with the output of RasterExtentsCoercer as ‘Clipper’ and resampled 3rd raster as the ‘Candidate’. It is t

I'm running into a small issue in the canvas. When I start typing "AS" in the transformer search bar, I expect AttributeSplitter to pop up, but it doesn't show in the suggestions. 

 Hello, I use FME Forms 2024 and I have a very basic workbench just to test the emailer transformer and the configuration of our email system.The Emailer is the following version When I run I have this error and it fails: <class 'socket.gaierror'>: [Errno 11001] getaddrinfo failed Any Idea ?Is it a probleme of mail smtp mail server accessibility. What is the configuration to adapt ?RegardsFred ​​   

Do you know the best way to convert a Raster.gdb (with 31 records and no Length or Area fields) to Vector .gdb (would have probably around 5 million records)  in FME ? The only unique field is OBJECTIDI used RasterToPolygonCoercer but it is not bringing any of the attributes from the Raster dataset to the vector dataset- everything is blank Also I want the new vector data to be smoothed if possible.

Hi!I’m using FME Workbench 2022.I’m trying to insert some data in a table in PostgreSQL. The table has a composite key, like this: (id, feed_id, env_id). The table, obviously, has the constraint: CONSTRAINT agency_pkey PRIMARY KEY (id, feed_id, env_id).In FME, I’m reading from a GTFS file, doing some transformations, and then, trying to write into the DB with a FeatureWriter using PostgreSQL as Format. I have all the configurations right. I checked it so many times, and before posting this question, I talked to some experienced mates.The problem I have is, in runtime, the FeatureWriter is not adding the attribute called “id” to the insert, so the database is sending the error “null value in column id violates not null constraint”. It happens with and without bulk mode.Now I’ll provide some images for visual context and information.Flux:Data in logger:FeatureWriter Parameters:FeatureWriter User Attributes:I added the Debug to the log to see what is happening in the FeatureWriter. This i

I'm trying to reproject a DWG file from AGD 1966 ISG 56 (EPSG:102077) to GDA2020 Zone 56 (EPSG:7856). I'm using the original DWG as a template to preserve layers, colours, line styles, etc.I've set up a workbench to handle the reprojection and all the data looks good and in the correct location when viewed at the final step in the inspector:However, when I open the output DWG, most of the data is correctly reprojected (matching what I see in the Inspector) but some features remain in the original coordinate system, thus showing up in Antarctica:Zoomed in at the portion in Antarctica:I've tried several troubleshooting steps:A simple read/write workbench Writing to DXF instead of DWG Using the RealDWG reader/writer Using default DWG reader settings (no customisation)I saw this question is similar to mine, but I didn’t have any luck writing to dxf instead:None of these things have fixed the issue. It seems to mostly affect text features, although some text is reprojected correctly, so I'm