Transformers

EDIT - I have solved my own issue here! We had some network changes, and I needed the SAS from the top level of the storage account rather than the specific container. Problem solved. I’ve successfully connected to the Azure BLOb using 2025.1 Form using the AzureBlobStorage Connector:I can connect to the “Hosted” folder inside the container “shared-data”. I am connecting using SAS. However, I need to use Flow 2024.2 and so I need to open this same workbench in Form 2024.2…. and this is where the fun starts!The transformer is slightly different, when I try to configure the Container I don’t seem to have the option to add the “Shared-data”. I am a complete novice at connecting to Azure, so please do not worry about over-explaining anything, I need all the help I can get! Many thanks in advance for any words of wisdom.RegardsStu

A caseA column code contains both unique and identical values ​​(e.g., A, A, B, C, C, C, D, E, E).A second column names contains different names.I want to group a column, but the names associated with it need to be merged.How can I easily solve this in FME? Thanks in advanced!

I have a column containing values ​​(contains 1 or more sorted names) that are both unique and duplicate. Now I want to assign a unique number to each value. This means that the values ​​that are the same should also have the same unique number. How can I handle this within FME? Thanks in advance!

I am trying to connect to a SFTP using the FTP caller. I have followed the instructions in https://support.safe.com/hc/en-us/articles/25407554321805-Using-a-Private-SSH-key-with-FTPCaller-to-Authenticate-an-SFTP-Connection-for-FME-Form-and-FME-Flow-on-Windows-Systems and I can connect to the server using other methods (winscp, filezilla) so the new key is working. In the log (with debug enabled) I get the following:SystemCaller: Executing 'start "" "C:\Program Files\PuTTY\pageant.exe" --encrypted C:\PPK\PrivateKey.ppk'FTPCaller (FTPFactory): Using the 'SChannel' TLS library for HTTPS/FTPS connectionsFTPCaller (FTPFactory): FTP info:   Trying ??.??.??.??:22...FTPCaller (FTPFactory): FTP info: Connected to ??.??.??.?? (??.??.??.??) port 22FTPCaller (FTPFactory): FTP info: Failure establishing ssh session: -5, Unable to exchange encryption keysFTPCaller (FTPFactory): FTP info: closing connection #0FTPCaller (FTPFactory): FTP/FTPS/SFTP transfer error: Failed initializationSystemCaller_2: E

Hi All, I have the following set up where / separate's attributes - where Value X and Y can exists multiple times within a month linked to the Item ID.Place / SubPlace / itemID / Year / Month / YYYYMMDD / ValueX / ValueY /  SUMXPlace / SUMXSubplace / SUMYPlace / SUMYSubplace /What i would like to do is after i have the sum per month per place and subplace, is to see the sum again of these sums on a quarterly basis - ie. Jan-Mar = Q1, April-June = Q2.So the final table would be something along the lines of this - to still allow filtering per place/subplace/quarterPlace / SubPlace / Quater / QSUMXPlace / QSUMXSubplace / QSUMYPlace / QSUMYSubplace /Any ideas or help would be greatly appreciated!/Emma  

Hi, I’m working on a script which copies data from an Esri arcsde geodatabase to a postgis database. I need to know if the table in the arcsde geodatabase is versioned before I run the rest of the script, and I have a pythoncaller which runs something like this (simplified here):layername = "schema.layerName"connectionFile = "path_to_connection_file"arcpy.env.workspace = connectionFiledesc = arcpy.Describe(layername)isVer = desc.isversionedfeature.setAttribute("versioned",isVer) self.pyoutput(feature)Now, I don’t want to type in the path to the connection file manually, but rather obtain it by some function which can collect the data from the list of database connections I entered in the settings. Is this possible? I’ve looked into the FME Web Services API reference for such a function without any luck. Best regards,Jacques 👷🏼 

One of the greatest new features of the IFC4x3 schema is that we can write 2D lines to IFC, which was not supported in IFC2x3.Why does the new IFC writer support only 3D surfaces and solids and not 2D line geometries? 

It seems that in the iOS18 update Apple made changes to the HEIC file container that means the FME Feature Reader using HEIF (High Efficiency Image File Format) now fails to read the HEIC files.We are currently using FME 2022.2.Is there a later update that will support iOS18 images? Is there an alternative way to read in these images successfully? 

I'm trying to setup the children and parents list attribute for export to CityJSON. Therefore I thought to use the listbuilder, but I get a different result than it should be. This example is how it should be: And this one is my result. It looks like there is an extra layer in it.How can I solve this?

Hi Everyone!I’m currently working on a workflow using a dwg file (water system) to convert it into a geodatabase. I was wondering if anyone has any tips on the transformers and workflow I could use to successfully do this? Right now I have my dwg reader as individual types, leading into an attribute filter, and geometry filter (3 different ones- 1 for water, drainage, and sanitary). These 3 end up writing into the geodatabase. I would like to have feature datasets separating water, drainage, and sanitary written in the geodatabase. I understand this is a big undertaking, but any tips (or perhaps links to guides) would be extremely appreciated! Thank you!

I have a job that downloads 7 text files from an FTP directory, and for the last 3 days, 6/7 files have downloaded but 1 always fails (the same one each time) with the error: Number of redirects hit maximum amountI am aware of the post below, but as no similar setting exists on the FTP caller, I’m lost. I can upload fine, and manually downloading the files by logging into the FTP site, or using a WinSCP script also works. The file that failed today was empty (0MB), but so are some of the other files it downloads, and yesterdays file had records and still failed. Empty files are not uncommon for this job, and it has never presented an issue before. This has started occurring since upgrading to 2025.1.3 from 2022, and occurs on both FME Flow and Form. This error has so far not appeared in any other workspaces that use FTP callers, even for multiple file downloads at once. I’m leaning toward this being an issue with the file, rather than the FTP, but I cannot see a problem with the file t

Hi  I have spent far too many hours trying to make the change detector dynamically pick up changes. The scenario is: I have 10 datasets that need to be compared between the original and updated databases. Each dataset has only a few fields that need to be checked for changes. These fields are different for each dataset. I have a CSV which is acting as a 'config' file and contains a list of the field names to check for each datasetI have 2 workbenches; the first workbench gets all of the information from the config file, then passes through the information via user-parameters to the Change Detection workbench via workspace runner. Even though I have created a user parameter for the "Match Selected Attributes" config in the ChangeDetector, I can't pass through this information via the workspace runner. It ONLY works if I run the Change Detection workbench individually, and this isn't linked to the config file, so it's not dynamic at all.  I got so frustrated

Hi, sometimes the XML Driven XML Writer decides that I have not set the Application Schema when I click on FeaturePaths edit button. As you can see it is set and the XSD file behind works well in a different workspace. But for some reason I get the error you can see in the attachment and I don’t know why. Starting a workspace from scratch works again with the same settings. Thank you for advice.

Hi everyone,I’m working with DWG files in FME — reading them, attaching XREFs, and then writing back to DWG.I’m trying to attach an XREF to a specific layer (something other than Layer 0), but so far I haven’t had any success. I’ve tried setting both the fme_feature_type and autocad_layer attributes, but the XREF still ends up on Layer 0.It also seems that when using the DWG reader, FME always interprets XREFs as being on Layer 0, even when they’re on a different layer in the source DWG.Has anyone found a way to preserve or specify the layer assignment for XREFs when reading/writing DWG files in FME?Thanks in advance!

We have a polygon shapefile in which features overlap because the data is self-reported. During our analysis, we noticed that when a feature is 100% overlapped by another, it is not considered in the clip process with another dataset. However, we want all features—even those that are fully overlapped—to be taken into account when performing the clip. What configuration or procedure should we use to ensure this behavior?

Hi FMEers, I’m trying to create a basic map using the HtmlReportGenerator. I’ve added 2 polygon hosted feature layers from our ArcGIS Enterprise Portal, that are comma separated in that URL field. They are shared with groups that I am a member of so I have access to view them.When I send it through to an html writer, the output map is blank. I wasn’t sure if that was because it is offline so I also published to FME Flow but it’s still blank:  I also tried with a layer shared to public from our portal with the same results.Is there something I’m missing from the docs?

Hi guys,how can i handle to read in Excel sheets (with other column names from time to time) and have the possibility to choose from a schema (xls) the right attribute names for the workflow…..Parameters on the reader?I’ve tried the Attributemanager and import a excel file...but the names from the excel sheet are only added to the default output attribute names a dropdown list on the Output Attribute name would be great……..any help to handle it or a link to another articleGreetz and thanksFranco

I have the following table, very simple:DATE_START ID 19921101 0502010000013950 19950209 0502010000013950 20031231 0502010000013950 20040115 0502010000013950 20040120 0502010000013950 20110704 0502010000013950 20200211 0502010000013950 20251005 0502010000013950  I want to make te following result: DATE_START DATE_END ID 19921101 19950209 0502010000013950 19950209 20031231 0502010000013950 20031231 20040115 0502010000013950 20040115 20040120 0502010000013950 20040120 20110704 0502010000013950 20110704 20200211 0502010000013950 20200211 20251005 0502010000013950 20251005 null 0502010000013950  Date_end is next value of date_start to create a cycles like this. This what i did:    I get to following result:U see the problem is with the last date_end, he is using for that feature the first date_start. I dont now how. Anyone a solution?

This issue seems to appear again in FME 2025.1! 

I'm trying to update (or rather replace) rows with new features and write them to geopackage. The problem is geopackage primary key is "id" that is generated when writing geopackages and I'm reading features from postgres where that same id doesn't exists and another id (let's call it ChangeID) is used as a primary key. ChangeID does exist in the geopackages and postgres table but geopackages primary key must be "id".  Unfortunately I have no control over why the id's is implemented like this. Also I know i could read those geopackages in to fme to get the "id"s but the problem is the dataset is hundreds of geopackages resulting in 100 millions of rows so the whole workflow is designed no to do that because that would result to weeks of runtime. I have a workflow to get rows that need to be replaced but fail to write them into geopackages because i can't use ChangeID to replace the rows because of different primary key. I know there

I'm having a set of polygons and for every polygon a raster with height values. I'm combining them in the TIN generator to create TIN's for every polygon. Now I see a big difference in behaviour of the TIN generator, depending on the amount of polygons I'm sending to it. For example: when I use one single polygon as input, as a result I get a TIN with 234 triangles.If I use 459 polygons as input and proces them individually by using Group processing, the result of the same polygon is a TIN with 3602 triangles. Can anyone explain why this is happening and how to prevent it?

Hi,I am using the AutoCAD Reader to extract external references from DWG files. When I get to the same file in the directory in results in an “Error running translation” error. However, if I run the Reader against the individual file, it works fine. I have removed the file from the directory and it then errors later on a different file. I believe this could be a memory issue? How can I resolve?I am only running the Reader and no other Transformers.Any help would be appreciated.Thanks.

I have used a PythonCaller to flatten a xml dataset and have many handfulls of attributes that need to be exposed. Cutting and pasting into the AttributeExposer does not feel appealing. Surely there must be an easier way to do this? After all the features already have these attributes, only they are set to be Unexposed. It should be just a hide-unhide setting that is needed? 

We upgraded FME from 2022.2.2 to 2024.0.2.2 one week ago, and I found out today the SQLExecutor gives an error for the SQL Server T-SQL Merger statement.  The SQLExecutor is set up as follows:----------------------------------------------------------------------------------------------------------FME_SQL_DELIMITER ;use VENDOR_GLOBAL_SPGI;MERGE INTO SPGI_INT.BLOCKS_VALID_INT AS tUSING (select distinct GA_ID,BLOCK_NAME,ONS_OFFSHORE from SPGI_INT.BLOCKS_VALID) AS sON t.GA_ID = s.GA_ID and t.BLOCK_NAME = s.BLOCK_NAMEWHEN MATCHED THEN    UPDATE SET t.ONS_OFFSHORE = S.ONS_OFFSHORE;--------------------------------------------------------------------------------------------------------It gives this error:Microsoft SQL Server Non-Spatial Reader: Query failed, possibly due to a malformed statement.  Query Text `MERGE INTO SPGI_INT.BLOCKS_VALID_INT AS tUSING (select distinct GA_ID,BLOCK_NAME,ONS_OFFSHORE from SPGI_INT.BLOCKS_VALID) AS sON t.GA_ID = s.GA_ID and t.BLOCK_NAME = s.BLOCK_NAMEWHEN MATC

Hi All,We have deployed FME Flow 2024.2.2 with ArcGIS 3.4 and wanted to run a few tests to ensure that Flow works correctly with the arcpy library. Below is the installation setup on the same virtual machine:FME Flow 2024.2.2 ArcGIS 3.4I have created a very simple Workbench in FME Form that invokes arcpy, and it works fine with the following Python compatibilities:Esri ArcGIS Python 3.9+ Esri ArcGIS Python 3.11I uploaded the same Workbench into FME Flow 2024.2.2 and encountered the following error after running the tool:Any idea? I have tried with 3.9 and 3.11 already,Thanks in advanced :)