Integration

Hi FME Community, So I’ve created a basic FME Flow application using a script that simply lets you upload two excel files then generates a html report comparing the two. I’m wanting to improve this functionality where there's a dedicated library of files (.csv) from cloud drive (One Drive) as buttons or drop down selection menu. Requiring only to upload the comparison .csv file. Would I have to achieve this by writing a python or java script in a custom HTML in a HTML report generator?

Hello, I am new to handling JSON but am really struggling to understand it.  I have formatted json stored in a csv as an attribute.  I cannot seem to flatten or fragment it.  Latest attempt was to write to a json then read in and fragment.  The workspace screenshot attached ran successfully but hasn’t exposed the strings I have requested.

Some users in my organisation are getting the below error when using  using fme-form-2023.2.1-b23774-win-x64. They have already looked at editing the path in environment variables and that didn't work. Any suggestions on a solution? Python Exception <ImportError>: This package should not be accessible on Python 3. Either you are trying to run from the python-future src folder or your installation of python-future is corrupted.Failed to import `fmesite'Python Exception <ImportError>: This package should not be accessible on Python 3. Either you are trying to run from the python-future src folder or your installation of python-future is corrupted.Failed to import `fme'(PythonFactory): The Python Framework could not be started. PythonFactory could not initializeThe Python Framework could not be started. PythonFactory could not initialize

Just update eterra3.ancpi.roGeometryFetcher. Updated all transformers to 2024, created a workaround for Tiler not completing a Conditional Value for $Parameter Contains/Begins with, created a test suite, uploaded .fmx and .fmw to the Hub.This is the Test Suite Failure Log:2024-03-12 20:33:35| 0.0| 0.0|INFORM|Current FME version: FME 2023.2.2.0 (20240205 - Build 23781 - linux-x64)2024-03-12 20:33:35| 0.0| 0.0|INFORM|System Time: 20240312203336 UTC2024-03-12 20:33:35| 0.0| 0.0|WARN |Workspace was last saved in FME version: FME 2024.0.0.0 (20240304 - Build 24187 - WIN64)Can’t run 2024.0 workspace on 2023.2.2.Please fix this!By the way, in case safers missed it: Something is wrong with the Conditional Value in transformers that only have Arithmetic Editor (for transformers that have both Text and Arithmetic Editor it appears to works)

I am using Oracle DB. My sql commands are update commands. I believe it is directly sending to the oracle to execute rather than regular transformer which execute in batches. Please clarify. 

Hi All,Fairly new to FME, and brand spanking new to Rest APIs.i have an API integration that i worked out in Postman, but, i’m struggling to translate that to FME workbench for use in an FME Server Automation.In postman, i have to use a GET to generate an antiforgery token, then use a POST to log in, a second GET to update the antiforgery token and then a second POST to send the actual content i want to .. uh.. send.now, in Postman, my request looks like:GET {{DeskAlertsURL}}api/xsrf/getwith the following auto generated headers:Cookie:Host:User-Agent:Accept:Accept-Encoding:Connection:and the actual request headers look like (i {{shortened}} some of them for readability):GET https://URL/DeskAlerts11/api/xsrf/getRequest HeadersUser-Agent: PostmanRuntime/7.36.0Accept: */*Postman-Token: acbb9ca8-9dc2-44b1-888e-63468a39523fHost: deskalerts.ipf.msu.eduAccept-Encoding: gzip, deflate, brConnection: keep-aliveCookie: .AspNetCore.Antiforgery.awpUR7lE5Fk={{Shortened}}; XSRF-TOKEN={{X-XSRF-TOKEN B

Please feel free to take your best guess about the title of this post in the poll. Then, if you are curious about the answer, check my new transformer OpenAIOSMReader and the LinkedIn article.  

Hi Community, I am using some SQLExecutors in my workbench and the this is taking so much time to execute. Is there any way I can execute it faster. Is it because the statement going from fme to outside db and execute it in batches of 1000 and commits the edits making the whole delay?. Is it possible to execute the whole sql actions using a plsql script and bind it to fme?. I may also need to have logs or exception tables for plsql script. Is it possible through fme?

Hi! I'm trying to transfer the information from the layers and tables of one geodatabase (with domains and relationships) to another geodatabase with a different data model. I need the GlobalIDs from the reader  geodatabase to remain in the writer geodatabase. In some tables/layers, I manage to keep them by setting "translation type: none" and "preserve GlobalID: yes," but in others, it's necessary for the translation type to be edit session, and then the GlobalIDs are not preserved. Is there any way to maintain the GlobalIDs regardless of the translation type or in any other way?I have read several posts regarding this issue but I can't find a solution.thanks!     

Hi community,I would need your help to make my FME code smarter and more dynamic. I am retrieving data via API. The problem is that I can only retrieve 100 items per page. I have 6 pages so I duplicate 6 httpcaller to be able to recover all of my data.Wouldn't there be a more dynamic way to retrieve this data without having to duplicate the httpcaller, maybe by looping but I don't know if it's possible on FME.In the first call, I have the information about the number of pages.Thanks for your help

I keep finding more and more areas where AI can enhance or simplify FME workflows. Just another example - we can ask the OpenAI API to give us expressions for RasterExpressionEvaluator and with the latest beta of FME 2024.1 (sorry, not publicly available yet), we can take the expressions from attributes. We can, for example, color a DEM by elevation. Do you want to see what AI can write for us? This is one of three expressions needed for coloring of multiple elevation intervals of the DEM. Good luck finding errors 🤣:if(A[0] <= 110, if(A[0] <= 22, 0, if(A[0] <= 44, 29, if(A[0] <= 66, 58, if(A[0] <= 88, 87, 116)))), if(A[0] <= 332, if(A[0] <= 154, 144, if(A[0] <= 220, 173, if(A[0] <= 276, 202, if(A[0] <= 332, 231, 255)))), if(A[0] <= 554, if(A[0] <= 388, 238, if(A[0] <= 442, 209, if(A[0] <= 498, 180, if(A[0] <= 554, 151, 122)))), if(A[0] <= 776, if(A[0] <= 610, 255, if(A[0] <= 664, 226, if(A[0] <= 720, 197, if(A[0] <= 776, 168,

I'm migrating records from one Salesforce org to another org using FME Form. But during the translation, some of my records are passed and some are failed. Though some of the records are failed to migrate, it shows a successful translation message in translation log window. I know the number of records that are passed and failed. But the problem I'm dealing is occurring while sending email. I want to send the number of total records, passed records, failed records and along with the failed records it should also show the error that why those records failed to migrate. How can I show this information in email?

Hi allDoes anyone have experience in using Google Earth Engine (GEE) in FME Desktop (I work with FME 2023.2)? I would like to access some remote sensing data in FME, process it and combine it with other data.I found out that the transformer “PythonCaller” could be used to integrate some Python code in FME. GEE advice to use the package ee/geemap for formulating requests to the engine. Accessing the GEE via Jupyter Notebook does work, but I’d rather integrate the processing in FME.Thanks for any help/advices.

 I have a workflow that takes a file in input , does a conversion , then outputs the converted file.I published this workflow to fme flow . and i want to use it to in my simple node js project : simply : the user clicks on “Choose an input File” , and chooses the file he wants to convert ; and after clicking on “Convert and download result!” , his file should get uploaded to my fme server , the workflow gets applied on it , and the resulted file gets downloaded to the users computer.  And I don’t know how to apply the workflow on the file that the user chooses , because the filepath of the reader dataset is static , and can be changed only manually in the fme flow web interface ;​​  

Hi,I have to carry out a project to produce and publish an interactive web map to disseminate data on traffic osbstructions and works in progress in Montreal.However, the data used can be downloaded in CSV format from the City of Montreal's open data portal, but also accessible via the API provided by the City's open data team, the link is as follows:https://donnees.montreal.ca/dataset/info-travaux/resource/cc41b532-f12d-40fb-9f55-eb58c9a2b12bWhat is the complete workflow process to retrieve data from CKAN Web Service API using FME Form?Attached is my incomplete workbench of my workflow that I tested using HttpCaller Transformer to test connection.Please provide me with some possible solutions.Regards, 

Hi, I've been working with a web connection to Sharepoint Online, created with help from this article:How to Create a SharePoint Web Connection for FME Form [Single Tenant]For SharepointOnlineConnector. It works for a time, but after a day or two there is a problem with refreshing my access token. This was the error message today:Updating access token for 'Microsoft SharePoint Online'Request to update access token failed. HTTP Error: HTTP/1.1 400 Bad RequestPython Exception <FMEWSException>: Type: 3, Number: 1, Message: Failed to get authorization header.If I reauthenticate my web connection It works again for a time.Any ideas what the problem may be?

Hi FME-community,I want to use the HTTPCaller to upload two JSON-files in one multipart PUT request. Just using two HTTPCallers separately works fine with Headers defining content-type application/json and Upload Data to Specify Upload Body with the JSON-content in the Upload Body. However, in future it will be convenient to also add different file-types in one PUT. Therefore I have the following Multipart PUT request:As you can see in the example I leave the Content Type blank, because there's no option "multipart/mixed", but consequently it interprets the upload body as plain text resulting in a binary file uploaded. Without success I also tried to set Upload data to multipart/form data with two separate String Uploads which results in the following error: "This FME edition does not recognize the `' function. Please ensure that the current platform supports this function, the function name is spelled correctly, and that you have installed all required plug-ins&

Adding an ArcSDE Geodb reader, FME Workbench 2019.1 throws: "GEODATABASE_SDE reader: An unknown exception occurred" followed by "Workspace generation failed. Parameter file was C:\\Users\\marsale\\AppData\\Local\\Temp\\FME_1700594969892_10740." It worked a couple months ago and my oracle account is fine (i can see and select the tables in Oracle, the error occurs when its trying to create the workspace).

Is there a way to setup a trigger in FME to send an email anytime a new record is added to the Feature Layer. I have an AGOL hosted Public Facing Application where the residents can add points and fill out some information. I would like to get an email every time a new record is added by the user. 

I have a workspace that uploads zipped folder to a Dropbox folder. I have established the Dropbox web connection, token is also retrieved and authenticated. When I run - I get translation is successful with no errors. But I dont see the folder on my Dropbox account. What am I missing ? Any suggestion is highly appreciated. Thank you so much

Hi,  I am attempting to ingest Microsoft Project Online data into our on-prem MMSQL Warehouse. I have found that the only (?) way to get the api is via SharePoint: https://<xyz>.sharepoint.com/sites/ProjectWebAppTestSite/_api/ProjectData The URL Above lists endpoints for all the sub-components ie: https://<xyz>.sharepoint.com/sites/ProjectWebAppTestSite/_api/ProjectData/[en-US]/Projects I am after recommendations for "simple" one-to-one replication of this data structure in SQL via FME.  The SharpointOnline component allows access to the document as an HTML file which I would have to manually parse and furthermore the site (via FME) only lists 5 Items in a document library wheras the main api endpoint via the web browser lists > 20 endpoints for data objects.The OData connector doesnt seem to work as I believe the feeds are ATOM.The HTML connector fails to authenticate as we use MFA and even if it did, this would most likely be a nightmare to parse.The PowerBI

How should we use existing database connections inside of an FME Package?Will the python api have functions which will enable the use of these connections? I was working on something where I wanted to connect to a database and I realised that it’s not possible to use the existing database connection - this is probably a good thing but kind of killed my project. Then it got me wondering if this will/should ever be a possibility? seems like exposing that kind of access to third parties poses a pretty big security risk. You could pretty well hide some malicious code which just scrapes all the host, username and password data and post it to some server. I guess direct database access via a package might never be allowed - at least not until there is the same kind of security which Oauth offers for authentication. 

Is it possible to access GEE API from FME (and for example run a script using Sentinel data to extract vector data for edge of recently burnt area)Does anyone have experience in doing this?Thanks.

Hello everyone,Is it possible to connect to a cloud (PIX4Dcloud) where point clouds are stored, so we can download for exemple files automaticly with FME ? Thank you

I have the following scenario.We use FME Form to gather public data. The data gathered should be written into a MSSQL database. Since we mainly work with ArcGIS Pro, and other ESRI products our MSSQL  server has an SDE extension on it.As long as I work in Form I can easily use sde connection files to access the databases. However, publishing a workspace utilizing an sde connection will result in errors since we do not have an ArcGIS Pro running on the same machine as our FME Server.Until now I was using the reader and writer ‘ESRI ArcGIS Portal Feature Service’ but this isslow, and requires published feature services in the ArcGIS Enterprise portal.I got our IT to open the firewall for direct access of FME Server to the MSSQL server and installed the latest msoledb drivers after getting the following error:Microsoft SQL Server Spatial Reader: Failed to connect using Microsoft OLE DB Driver for SQL Server. Provider error '(-2147467259) Named Pipes Provider: Could not open a connection t