Connecting FME to web services. Use of APIs. Mobile Apps.
Recently active
Hello,I currently have some workbenches which access APIs and hence have secrets within them, which is fine when this is secured on FME Flow. I also want to set up version control, and have all of my workbenches uploaded to remote repo, GitHub. TLDR: How can I secure my API secrets on GitHub?So far I’ve looked into:encrypting my workbenches https://support.safe.com/hc/en-us/articles/25407644298637-Password-Protection-for-FME-Workspaces this seems OK, but doesnt truly secure the api secrets, it does add a level of security but it could be better Storing my API keys as published parameters on FME Flow this may be hard to manage, especially when trying to run/debug/design any API workflows if a user/developer accidentally hits ‘save parameters’, then this method will likely be redundant can become messy and difficult to manage in general Would setting up the secret as a password parameter within the workbench encrypt it in the .fmw? Will a password protected workbench still work on F
Hello,I am using a Sharepoint List reader to expose all hidden fields and show all fields. This usually works for me but not for this specific list. This list is very large, has views and hidden fields. The errors:1) 2025-04-17 09:48:51| 1.8| 0.0|ERROR |Microsoft SharePoint List Reader: Client-side error: '401 Client Error: Unauthorized for url: <…..>' returned from SharePoint. Error message was: '' 2) 2025-04-17 09:48:51| 1.8| 0.0|ERROR |Python Exception <FMEException>: FMEException: 929309: Microsoft SharePoint List Reader: Client-side error: '401 Client Error: Unauthorized for url: <.….> returned from SharePoint. Error message was: '' The query (url) generated by FME (which I’ve removed from the errors above), is 2300 characters long. When I click this URL it takes me to a blank page with the message:I have found this:https://learn.microsoft.com/en-us/dotnet/api/system.web.configuration.httpruntimesection.maxquerystringlength?view=netframework-4.8.1which I b
Hi there,What I want:FME workspace using Python version 3.10 installing Python packages (namely mcap and rosbags) into 3.10 using PythonCaller in FME Form with Python 3.10My setup:FME 2025.2.2.0 (Build 25827) Windows 11 Enterprise, 64bit PATH pointing to C:\Program Files\FME2025\ FME Form: Workspace Parameters → Scripting → Python Compatibility: 3.10+ Utilities → FME Options → Translation → Preferred Python Interpreter: 3.10+ Paths and folders on Windows: C:\Users\<myname>\Documents\FME\Plugins\Python python313 fme.exe python --version in cmd results into 3.13Where I fail:I cannot install packages into Python 3.10 Referring to https://docs.safe.com/fme/html/FME-Form-Documentation/FME-Form/Workbench/Installing-Python-Packages.htm#ChangingtheDefaultInstallLocationAdvanced does not create a new folder python310 In FME Flow using PythonCaller and prompting for installed/used Python Version results into 3.13.11Did I miss any steps? How do I use Python 3.10 in FME properly?
Hi all, I had build a workspace in FME dekstop using httpcaller to get data from an api and its working. When i publish this on the server, then i get the following errors. HTTPCaller (HTTPFactory): [1]: HTTP transfer error: SSL connect errorHTTPCaller (HTTPFactory): [1]: Please ensure that your network connection is properly set upHTTPCaller (HTTPFactory): [1]: No proxy settings have been entered. If you require a proxy to access external URLs, please ensure the appropriate information has been enteredI have already check on the server and i can reach the api by web. Does anyone what the issue is?kind regards,
Hello. I’ve read an old closed thrad saying that there was an issue on virtual machines with FME 2023/2024.At our side we did not experience any issue on virtual machines with FME 2022-2024.But we just installed FME 2025.1.1 and get this issue “SetThreadDescription entry point not found in Qt6Core_fme.dll.Any idea? Stille the same issue?(It is on Windows 10 Pro)
Newer SDKs (v4/5/6) of the ECW image format supports a fourth alpha band. This seems to begin to occur for rasters from drones. It would be nice to include support for the new v4 (or even v5 and v6) of the ECW SDK in FME, as newer versions of ArcGIS Pro is able to open these files and support are arriving in AutoCAD Civil 3D as well, even though there still seems to be occasional issues with large four-channel ECW files in AutoCAD. The support for newer ECW SDKs in other GIS software, that FME often supports with data in many workflows calls for the inclusion of support for the newer ECW SDK version in FME too.Support for the newer versions would be desireable in both reading and writing.
Trying to create a new branch version, then update geometry on the existing features. I have the new geometry joined with Object ID from default, but running into issues on the safe.esri-agol writer.Where version was set to "Jan272026b":ArcGISFeatureServiceWriter: The ArcGIS REST API returned an error: HTTP Error Code: 400 : 'Unable to complete operation.' Message Code . Further details: '['Object is missing.']' Where version was set to include username "admin.Jan272026b" -- CASE matters. I went back and changed it to “ADMIN.Jan272026b” and now I’m back to getting the first error of Object is missing.:The ArcGIS REST API returned an error: HTTP Error Code: : 'Invalid version name. [The Version name contains invalid characters. (admin.Jan272026b)]' Message Code . Further details: '[]' However when I look at the versions, I see:versionName: ADMIN.Jan272026bversionGuid: {9466ACCA-2E0A-4D75-9789-CE40F1E941BA}
Is anybody familiar with setting up readers from SmartSheet in FME so that you can potentially make/send updates to the SmartSheet directly from FME?
Hi everyone,does anyone know if there is a way to write directly to an Excel file hosted on Microsoft One Drive, just as it possibile with a Google Sheet file?Thanks!
I already have a support case open for this, but I’m curious if anybody else is having credential issues with the AzureFileStorageConnector (Azure Storage package 4.2.1) in FME 2025?I’m getting the error message: AzureFileStorageConnector: Connection 'xxx Azure Storage' does not exist. Check connection parameter and connection definitions in FME options and try again.Creating a new web connection does not solve this issue.
Hi! I’m trying to read dwg files containing AEC objects and have found that the Civil 3D reader should be the one to use for this purpose. With this reader, I manage to read features but they are just a proxy of the correct objects that I’m trying to read.Is there an automated solution for this in FME (some parameter that I’m missing?) or do I have to save the model in a separate dwg file as described in this post (8 years ago) before I can read all objects correctly in FME?Thanks!
Hi Folks,For reading and writing ArcGIS Online feature services we are transitioning to the newer Esri ArcGIS Feature Service format in FME Flow 2024.2 from the soon to be deprecated Esri ArcGIS Online (AGOL) Feature Service (at least according to this article)My problem is that now the reader seems to read dates as Epoch time in milliseconds! Obviously this can be worked around but it is quite painful to fix up the many workspaces we have which used the older reader and read dates as YYYYMMDD etc. especially when writing back to AGOL where the dates have to be back in YYYYMMDD.Any thoughts?
As of today we get a message trying to login to Autodesk with the FME web connector.I think we use the settings provided by the Autodesk integration:Client ID: 9YJwNVyykGTllW87Y45yDUGLRvvOmVhMClient Secret: dont knowRedirect URI: https://127.0.0.1:443Auth Url: https://developer.api.autodesk.com/authentication/v2/authorize?response_type=code&scope=data:read data:writeRetrieve Token: https://developer.api.autodesk.com/authentication/v2/tokenRequest format: code=[CODE]&redirect_uri=[REDIRECT_URI]&grant_type=authorization_codeRefresh token: https://developer.api.autodesk.com/authentication/v2/tokenFormat: refresh_token=[REFRESH_TOKEN]&response_type=refresh_token&grant_type=refresh_token&scope= data:read data:write When using a custom app created in Autodesk Forge I am able to connect with these settings (only changing the client_id and client_secret. Also…Would there be any instructions about creating a server-to-server integration in Autodesk Construction Cloud?
We currently use the FME App but this requires our users to authenticate in FME Form and then upload this webconnection to FME Flow. And these users are logged out after a period of time.What are other company solutions for Flow connections to Autodesk? Didn't we look at the right documentation?
Hi folks,I had a question regarding creating an FME script that takes attributes from a system of record dataset into an existing record created in a feature class within an Enterprise Geodatabase.Workflow consists of the following:Two layers with the same information and attributes in different systems of record – one in an asset management system and feature class in an Enterprise Geodatabase.No integration exists between the two systems yet as there is a new replacement system being developed in a project, but in the intermediary, it has been decided that the business will be updating the asset in the asset management system, then updating the feature class attribute table in the Enterprise Geodatabase. Therefore, they will be maintaining two datasets in tandem until the pilot project for the replacement system is complete.The difference is that the layer in the asset management system only stores XY/Lat/Long values whereas the true layer in the feature class in the Enterprise Geoda
Hello FME CommunityI got issue when trying to connect to ArcGIS Portal from FME Form 2025.1. I get error “The web connection 'FME Account' could not be loaded”, but unlike in this discussion ()My workspace doesn’t finish normally and actualy is not able to read/write to the Portal Hosted feature layers. I use FeatureWriter and can see layers I want to read/write in the settings of the transformer.Is there any workaround for this? Or we should wait for 2025.2 like in above discussion suggested?I’ve upgraded from 2023.2 where everything works just fine.Thank you in advance.Regards.
Hi !I have an image in my documents folder and I need to add it into excel on a specific cell. I saw a training available, but it uses an image fetcher. image fetcher cant be used with a folder path.Looking for inspiration as I have hit several walls.Thoughts?Thanks, in advanced.
I would like to look into using the integrated version control of FME Flow:https://docs.safe.com/fme/html/FME-Flow/WebUI/Manage-Workspaces.htm#WorkingSo I asked for a repository within our git environment with rights so FME could access and write the workflows like mentioned here:https://docs.safe.com/fme/html/FME-Flow/WebUI/Version-Control.htmBut our current policy disallows integrations with a wide scope and would like to use the fine-grained scope settings within github probably like mentioned here:https://github.blog/security/application-security/introducing-fine-grained-personal-access-tokens-for-github/Does FME also support fine-grained scope and if it doesn't would this be implemented in the near future?
Hi, I have a list of 100+ WMS services our company is using in a plugin for QGIS. I’d like to publish these to our enterprise portal, and I thought the ArcGISOnlineConnector seemed like the right choice, due to it haven the setting:Action: UploadURL : WMS URL https://***.net/geoserver/dai/wms?service=WMS&request=GetCapabilities&version=1.3.0 URL Item Type: WMS ? My error is :ERROR |Message Type: fme::internal::_v0::py::ExceptionERROR |Python Exception <TypeError>: expected str, bytes or os.PathLike object, not NoneTypeERROR |Error encountered while calling method `input'FATAL |ArcGISOnlineConnector_CALLER (PythonFactory): PythonFactory failed to process feature What have I misunderstood ? Or is there a better option ? Thanks in advance.
Hello, I am attempting to copy an ArcGIS Server Feature Service from our Production portal to our Staging portal as a test migration using ArcGIS Data Interoperability (FME). The migration runs successfully, and the layer is created on the destination portal with all point features appearing correctly. However, every attribute field in the destination portal is empty for the layer.For this workflow, I used: Reader: Esri ArcGIS Server Feature Service Writer: Esri ArcGIS Portal Feature Service The strange part is that when I inspect the data immediately before the writer, all attribute values are present and correct in the Visual Preview. But once the writer publishes the layer to the portal, the attributes do not appear, only the geometry is transferred.Could you please help identify what might be causing the attribute values to be lost during the migration?
I have a workspace that is reading a table via the MS SQL JDBC reader and writing the output to an Esri File Geodatabase feature class. It works in FME Form. However, In FME Flow, it fails after the following message (not a warning or error) and shows 0 warnings/errors in the log:Writer `GEODATABASE_FILE_1' of type `GEODATABASE_FILE' using group definition keyword `GEODATABASE_FILE_1_DEFIf I read the same exact data in from a CSV file and write to the Esri File Geodatabase, it works in FME Flow. If I read from the MS SQL database and write to an Open API File Geodatabase, it also works. However, I need to use the Esri writer in production for updates due to some Esri-specific functionality. It seems that there is some sort of odd bug specifically when using the MS SQL JDBC reader and Esri File Geodatabase writer in FME Flow. Has anyone else run into this or have any suggestions?Notes: I’ve tried with the SQLCreator, SQLExecutor, and a reader. It still worked in Form but not Flow. We ha
I have a lot of multipage PDF documents that I need to each summarize. Does anyone have any tips/experience/recommendations with working with multipage pdfs in FME and an AI of choice?I’ve played around with Copilot a bit and have got prompts to return pretty good results, but it seems like FME doesn’t natively support Copilot, so I’ll have to probably switch AI solutions. Thanks in advance!
Hello everyone,I’m currently facing a challenge with writing an IoT data stream directly to an ArcGIS Online (AGOL) hosted feature service using FME. While I’ve successfully configured the stream to write to a local SQLite database, I’ve been unable to achieve the same with AGOL.I’ve attempted to use the Esri ArcGIS Feature Service Writer transformer, but unfortunately, it hasn’t worked as expected in stream mode. I’m wondering if there’s an alternative transformer or method that supports continuous writing to an AGOL feature service.Here’s a brief overview of my FME workspace setup:Input Source: Reading data from an MQTT broker in stream mode using the MQTTConnector. Data Processing: Filtering incoming messages into different groups based on sensor types. Output Goal: Writing the processed data to an AGOL hosted feature service. Runtime: The workspace is designed to run continuously to handle real-time data.Any guidance or suggestions on how to achieve this would be greatly appreciate
Hi All,I have written a workspace that downloads features (and attachments) from an AGOL Feature Service, and everything was working fine until about 2 weeks ago. Then it suddenly, and for no reason that I can see, stopped working. The error message is as below:2024-07-12 09:38:47| 5.7| 2.1|ERROR |ArcGIS Online Feature Service Reader: Could not connect to server. Check that you are connected to the internet and that no firewall is blocking outbound connections. The error was 'HTTPSConnectionPool(host='www.arcgis.com', port=443): Max retries exceeded with url: /sharing/rest/portals/self?f=json&token=3NKHt6i2urmWtqOuugvr9Xotftc2MEsOx2iLqu8k_LPVAUrx4ptneDwWq5gGHyWsx9gLJB14s-YhL9BcQ6A71ysFhsv00tTqKaTLWA9OxAioggyddpHKGcxUfwKFMnzU-m7-SshOGN98nlYOd2uB9-LSYOpHZbnxGUhNJ_3nnRQntaumsDD__7bZqpHVciIFHkLU-of9RGgQ17FdVaDRxF6HcXcbq9Sm4XmdkzD7LqM-h_2jGsOM8HOeFBSI6iINhlNJE65A50NL1eFOJ-gGgg.. (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x000000001D666D10>, 'C
I have a pretty simple problem but I cound not find any solution. I tried feature joiner and added counter so that I have a field in common for bot tables but still didnt work. Attribute manager does like “what I get” which is not really what I want. Any Idea ?