Using transformers to modify data.
Recently active
I have a workspace created in 2023.2 that reads an Excel workbook from a SharePoint library. It is working perfectly.I have upgraded to 2024.1 and the reader no longer works as expected. If I use the 2024 Data Inspector I can connect to the workbook and see the data. The FeatureReader obtains the schema and the number of records in each sheet and gives a “Translation was SUCCESSFUL” in the log. The issue happens after that - I get some sort of (possibly) Python related error. Log file of messages after the successful log entry is attached.I have tried changing the Python version but it didn’t make any difference. Has anyone had the same issue or any ideas what I could try to get it working again.
In ArcGIS Pro, I have a published a map service as a feature layer service to our ArcGIS Portal. I have published it as the owner and Admin with enable editing permissions etc. The layer source comes from an SDE with SELECT, INSERT, UPDATE, DELETE privileges.In FME Desktop 2025.1, I have a FeatureWriter using the new Esri ArcGIS Feature Service format. I have it successfully connected to our Portal via OAuth (safe.esri-agol) and with the the writer settings for Feature Operation set to Insert and feature type handling set to Truncate Existing. See image below.When I run the workbench, after a period of time, it outputs back an error: ArcGISFeatureServiceWriter: Feature Service 'Sample Layer(7ea7230cca1f4aeb9316ed1735cca5c2)' does not support feature operation 'INSERT'. Its owner may have disabled inserting or editing features. Writes may fail if the current user is not the owner or administrator.This process used to work at some point when it was using the old format Esri ArcGIS Portal
We have a PythonCaller which uses the psycopg2 import statement and then uses the pgsql server parameters to connect to a pgsql server and create database ((eg: https://wiki.postgresql.org/wiki/Using_psycopg2_with_PostgreSQL). This works fine in FME Desktop 2021.1 and FME Server 2021.1Currently we are migrating to FME Flow 2025.1 and this caller fails when run in Flow (server) and local desktop in Form, both in 2025.1. The location of the psycopg2 package is in \Documents\FME\Plugins\Python folder in the local desktop. With same setting, it works in 2021.1, but not in 2025.1Have I missed anything?The specifc error is: No module named psycopg2._psycopg
Hello,I am looking for additional insights on File CopyIs it possible to copy folder structure without copying files inside ? How do I set the writer ? What is the filecopy_type parameter ? and what are it’s possible values ? The parameter exists on the writer but I can’t find any information.Thank you
I have an emailer in a routine which has html content and it has been working fine for years. I have just updated the emailer package and it is now emailing all the html code to the recipient rather than rendering the email using the code. I noticed in the change log that this version has “Improve detection of HTML content in message body. (FMEENGINE-86584)” but it looks like it has less detection of HTML. has anyone else come across this issue and how to resolve it. There doesn't appear to be any guidance on how to manage this change in the package / transformer.
Hi All,I’m not able to transpose rows to column and complete a count in the end of the workflow, I have followed the technical article but couldn’t make it to work:https://support.safe.com/hc/en-us/articles/25407761369741-Transpose-a-Table-Using-FMEAlso below an screenshot of the requested output which a excel pivot table: Attached a sample of the raw table that needs to be transposed (or pivoted!)Can I achieve this with the AttributePivoter?Thanks
Hi, How can we set the set the limit for max features to write in the feature writer? I have set the limit of 10,000 in max features to read in the feature reader; will that automatically imply to write 10,000 to the feature writer
Bonjour,Je souhaite calculer une statistique zonale afin d’obtenir la moyenne des valeurs de pixels d’un raster, sur une couche polygone (vecteur), comme on a l’habitude de le faire dans un logiciel SIG (voir capture ci-dessous).Merci pour votre aide.
Hi.I built a workspace in 2024.1, that fetches a number of files from a customer Sharepoint site. It works (in 2024.1) without problems.I just installed 2024.2, and ran the workspace (with no changes).Now it issues an error with a SyntaxWarning from the package “safe.microsoft-sharepoint”:C:\Users\xxx\AppData\Roaming\Safe Software\FME\Packages\24783-win64\python\safe.microsoft-sharepoint\stringcase.py:247: SyntaxWarning: invalid escape sequence '\W' return re.sub("\W+", "", string)Is this something that I should worry about ?SharepointOnlineConnector is not listed as an upgradable transformer in 2024.2Cheers.
SOLVED - I found the error Hello!I've been working on a script that has 56 columns (client needs all the fields of information), and now I need to write it using an Esri File Geodatabase writer. I have double- and triplechecked whether there is an invalid character (since gdbs are quite strict with field names) or a duplicate of one of the fields, but I cannot find it. Is there a tool in FME that let's you identify a duplicate of a whole column in the attribute table? Or a duplicate field name? Or does anyone know if there is another common solution to this error?This is the error code:ERROR |An error occurred while attempting to create the feature class 'Test'. The error number from ArcObjects is: '-2147220649'. The error message from ArcObjects is: {Cannot create a table with a duplicate column. [Test]} I am using FME form 2024.1.Thank you in advance!
Hello!Is there a way to change the displayed date in a datetime userparameter as DD-MM-YYYY?The chooser interface is helpful to check if it is the right date, but it can still be quite confusing, especially in Flow, when not every user knows about the picker and just enters the date. Is there an option I am missing or is a text-field instead my only alternative? Many thanks in advance!
Hello FME’ers,I am currently comparing FME and PostgreSQL/PostGIS when transforming some line geometry. In each scenario I need to round the coordinates to 3 decimal places. This has thrown up a anomaly when rounding coordinates ending .4999. For example, the coordinate 104269.57149999999 will be rounded to 104269.571 by ST_ReducePrecision but 104269.572 by the FME CoordinateRounder. I believe this is due to different rounding techniques like round-to-even or half-round-up. Can anyone explain this behaviour? Is there any “right” answer?Thank you,David
I’m stringing together a bunch of HTTPCallers, each of which has several query string parameters. From what I can see, you are only able to see two parameters at a time in an HTTPCaller transformer (see screenshot). Is there a way to enlarge/expand the dialog box so I can see all or most of them at once? Should be easy; I feel like I’m missing something. It would be so much easier, helpful, and efficient so see all query string parameters at a glance. (FME Desktop 2023.2.0.0, Build 20231201).
Hello,I want to report a bug related to adding attachments to a feature in an ArcGIS Enterprise Feature Service using the ArcGISAttachmentConnector in the latest version.I receive the following error:(C:\Users\x\AppData\Roaming\Safe Software\FME\Packages\25606-win64\python\safe.esri-agol\fmepy_esri_agol\attachments\handler.py:104) add_attachment return AttachmentResult.from_dict(response.get("addAttachmentResult", {})) ^^^^^^^^^^^^910523 Python Exception <AttributeError>: 'generator' object has no attribute 'get'The problem is that the ArcGIS REST API addAttachment endpoint returns text/html instead of json. This appears to happen specifically for Enterprise Feature Services, as described here. As a result, the result cannot be decoded. However, the attachment is actually uploaded successfully.Bug fix:Change the line 43 fromfiles = {"attachment": (filename, file_obj, mime_type))}tofiles = {"attachment": (filename, file_obj, mime_type), "f"
I have a workflow where I am creating a raster using SurfaceModeler. As documented, this transformer may output some NaN values when using PLANAR interpolation. I indeed have a few cells that come out with a NaN value. I am not certain what transformer can change my NaN values to NoData values (or any other values)? I read through this article: http://blog.safe.com/2013/11/fmeevangelist119/ and thought the NullAttributeMapper would be the answer, but it does not seem so.
Upgraded from FME Desktop 2022.2 to FME Desktop 2025.1 (Build 25609)In FME 2022.2, I had a FeatureReader reading to a FeatureService URL with no issues. Perfectly was able to read it and extract its spatial content and attributes. Upgraded to FME Desktop 2025.1 and it no longer works. Could this be like an internal firewall blocking access to this or is it the way FME 2025 handles SSL certificates? If so, how can I remedy this?Any insight is much appreciated.SAMPLE WorkbenchI have the latest package installed Error message: ArcGIS Feature Service Reader: Could not connect to server. Check that you are connected to the internet and that no firewall is blocking outbound connections. The error was 'HTTPSConnectionPool(host='services.arcgis.com', port=443): Max retries exceeded with url: /mMUesHYPkXjaFGfS/arcgis/rest/services/ROLL_ENTRY/FeatureServer?f=json (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA c
Morning All, Has anyone else identified an issue with all SQL transformers when specifying the connection via either deployment parameter or database connection? When run on Form it operates correctly but when run via Flow (either scheduled or manually submitted) the following error is returned: Error occurred while opening database reader with server type `MSSQL_ADO', server name `XXXXX', user name `', database name = `' : `Encryption Error: AES Decrypt finalization failed.' If the database connection is embedded into the transformers Flow is able to operate these transformers correctly, however this would then require each transformer to be reconfigured as we migrate between environments. Thanks in advance, Paul.
Hey everyone, I hope I am just missing a very obvious point here. I am trying to compare two SQL input data sourcesOne with these columnsAnd the other with these columns The customer and account number combination is going to be my primary key. I need to extract the email addresses of customers based on that combination. I have tried the feature merger which seemed to be the obvious solution, but I am not getting any matches?Any idea where I am going wrong?
I have found that the feature reader will not accept point data as the initiator. I have since found that in Version 15 a change was made: -Spatial operations will reject initiator features with point geometries to match native reader behaviour.Does anyone know why this was changed and if there is a way to force it to accept points without having to create a very small buffer to it and then recreate the point after the feature reader.
Good afternoon, I am extremely new to FME so apologies in advance if my question comes across as exceedingly simple or unnecessary. Anyways, I am attempting to convert a set of line features that originated in AutoCAD into a GIS formatted polygon layer. To start, I cleaned the layer as best as I could and performed snapping within QGIS. I then have tried using AreaBuilder in combination with other transformers such as LineCloser to obtain a set of polygons, but the output so far has been less than ideal. I have also experimented with Snapper and some other transformers such as LineExtender but those have introduced new errors that then lead to no output from AreaBuilder. Below I have attached an image of my workspace currently, as well as an image of the current output I am receiving. I will also attach a sample of the dataset I am working from! My conclusions are that LineCloser is causing the issue which leads to these slivers and polygons outside of the scope of the data, however I
Hi,I’m trying to put an URL in a table using the new DocumentPDFStyler and I can’t make it work.One of my issue is that the URL breaks because it doesn’t fit in the table box, also it doesn’t show up as an url. I tested many things to make it work: Image Link, add the pdf_url attribute (doesn’t work because this is the documentpdf writer), put quotes around it.I’m trying to make this work without having to use the wkhtmltopdf 😅
Hello, Please see picture above, DateTimeNow is my value i am feeding into DateTime attribute, which matches the preview data format, but the output keeps getting rejected saying the errors above. I’m a bit stumped to as why this is not working. Any ideas?Thanks.
Hi All,I often encounter difficulties when attempting to select specific raster values using FME. I am currently working with a raster dataset that contains two bands, and I need to isolate the following values:Band 0 (GRAY8) = 3 Band 0 (GRAY8) = 4Could you please advise on the appropriate expression to use within the RasterExpressionEvaluator to achieve this selection?Thanks :)
Hello, I think my question has been asked before but I can't find anything on Google.Input Data : One table wothout geometry with : Id Id route measure One table with linestring geometry and : Id Id route (the same) geometry I want to position my point data with the measure field along the line and generate a new Point Geometry
The feature reader does not allow you to make a clip on the initiator geometry. I need to read a fairly large raster (13GB). Input I get some small zone geometries to analyze. The idea was to create a BBOX on the geometry and use the feature "Spatial filter: intersects or bbox intersects" to load only the part of the raster needed for the analysis. Even configuring intersects or bbox on the feature reader, in output there is always and anyway all the raster. This problem is great because it slows me down considerably the server side script. If you add a raster reader instead you can check the "Clip on search envelope" flag and it works. But without FeatureReader i can't give my search envelope by the initiator. Could this be a missing-feature?Does anyone have a workaround? I use the FME Desktop version 2019.1