FME Flow

Is there a way of doing parallel processing on multiple CPU cores inside a PythonCaller? I don't want to use a custom transformer for that because I cannot easily group my features using the group processing option. I have already tried the concurrent.futures.ProcessPoolExecutor but it fails in FME. The code works fine outside of FME but in a PythonCaller it raises a PicklingError.

Hi, I have an issue with import numpy in Python Startup Script in FME Workspace in FME Flow: FME Flow 2023.0.1 uild 23332 - win64 I guess that numpy package is already installed in FME Flow (and Form).In FME Form there is no issue but when I publish workspace on FME Flow I get: Python Exception <ImportError>: IMPORTANT: PLEASE READ THIS FOR ADVICE ON HOW TO SOLVE THIS ISSUE!Importing the numpy C-extensions failed. This error can happen formany reasons, often due to issues with your setup or how NumPy wasinstalled.We have compiled some common reasons and troubleshooting tips at: https://numpy.org/devdocs/user/troubleshooting-importerror.html Please note and check the following: * The Python version is: Python3.11 from "C:\\Program Files\\FMEFlow\\Server\\fme\\FMEEngine.exe"* The NumPy version is: "1.24.2"and make sure that they are the versions you expect.Please carefully study the documentation linked above for further help.Original error was: DLL load failed

Hi everybody,Is it possible to fix the maximum file size in output ?I want to convert LAS data in DWG, but DWG in output is too large. Instead of one large file of 2 GB, I would like multiple files of 200 Mo (for example). Tnak you in advance 🙂   

Hello, I'm using FME to read IFC files and I would like to know if it is possible to get GeometryPropertyExtractor (to get traits) by calling the FME API into PythonCaller ? Thank in advance Best regards Bruno Hilaire

Installing ArcGIS Web adaptor IIS broke the Tomcat Web UI to FME server. Checked the Tomcat xml files to enable SSL 443 and SAML. All the config seems to be in place. "Unfortunately a backup or snapshot of the VM was not taken ahead of time." Anyone know how to get the UI back running? Pretty dumb mistake so there is not much dialog. But I have gone through setting up SSL with CA Cert and SAML.

How to enable anonymous access to FME Flow (2023) services? Guest account is enabled and given permissions on repository and services OK. Trying to call a service always prompts for credentials. Can login as Guest and it works so permissions are OK.

I have a (FME Form 2023.0) workbench that generates three Excel files, where running locally via FME Form gets me a zip with this structure:my_data_$(TODAY).zipfoo_$(TODAY).xlsxbar_$(TODAY).xlsxbaz_$(TODAY).xlsxAll three XLSX files are generated by three separate writers and have very distinct structures and different template files. When I publish the workbench to FME Flow and try running it with the DataDownload or Data Streaming services, however, I get a completely mangled zip file with this structure insteadOutput8719176120317945288.zipXLSXW_1foo_.xlsxXLSXW_2bar_.xlsxXLSXW_4baz_.xlsxIt seems like both services ignore whatever path the readers are configured to write to, and instead use a XLSXW_1_DATASET override that gets set by FME Flow, whose value seems to be $(FME_SERVER_DEST_DIR)/MULTI_WRITER_KEYWORD{0} with the file name appended at the end, without parameter expansion. Is there anything I can do to control the file structure inside that generated zip file, or perhape have a

For example I have automation MyAutomation that runs two workbenches, WB1, WB2. WB1 can run on engines 1 - 5(determined by the folder it is in on the FME Server), WB2 can run on engines 3-5. Can an issue arise where WKB1 is running on engine 2 and completes by calling WKB2, that cant run on Engine 2?

Hi, Following the documentation: https://docs.safe.com/fme/html/FME-Flow/AdminGuide/Starting-Stopping-FME-Flow-Manually.htm I tried to enable HTTPS for the server (FME Flow 2023.1 Build 23619 - win64). I can browse via HTTPS to my server without problem.When trying to run a job (Run Workspace / Samples / austinApartments.fmw / Data Download) I end up with an error 500. In the log (D:\\FMEFlow\\ProgramData\\resources\\logs\\tomcat\\NAME\\localhost***.log): SEVERE [https-jsse-nio-443-exec-8] org.apache.catalina.core.StandardWrapperValve.invoke Servlet.service() for servlet [JobRunnerForm] in context with path [/fmeserver] threw exception   javax.net.ssl.SSLException: Unexpected error: java.security.InvalidAlgorithmParameterException: the trustAnchors parameter must be non-empty Is it safe to attach the full log files ? Best regards, Endorria

For an automation running on FME Flow is there a method save the parameters used to send an email? Currently we have many email services set up and are switching email servers around. It would be nice to be able to update the credentials for one source opposed to having to edit the parameters in each automation individually.

FME Server Download site - only receiving 404 errors

How to Create an ArcGIS Online Web Connection (OAuth 2.0) (safe.com) I followed the document above. However, when trying to add the redirect url to the app in ArcGIS Online, it now requires a "url" parameter that is not mentioned in the documentation. I'm not sure what to put there.

Hello,I have a dataset with 1000 categories (A, B, ...) (please see the following sample). For each category I want to calculate 3 points moving averages. I developed the following workbench that using a Tester filter data for each category and then calculating the 3 points moving averages for one category (here port A). However, for each port of the Tester I should repeat all transformers again (transformer after the Tester), which is difficult for 1000 categories. I created a custom transformer but again I should import the custom transformer 1000 times. In the custom transformer I used a Counter which for each port should start counting from zero. But it is added up after that it is applied for each port. I set the Count Space of the Counter on local. But still didn't work. Can someone please let me know a better way to calculate this moving averages without those all repetitions of transformer. FYI, I am using FME 2022.

The municipality of Eindhoven intends to change the current way of 'authentication' to 'SAML' authentication.The current way of authenticating is based on 'Windows Active Directory'.Within Eindhoven we use the publishing of FME Desktop scripts to FME server via the so-called 'FMEServerJobSubmitter'.This is based on an Active Directory account.FME version 2022.2.1 On the Safe website we find several articles that authentication within an FME flow via SAML does not support a number of transformers.One of them is the 'FMEServerJobSubmitter'. Two possible 'workarounds' are mentioned.We do have some questions about this. Hopefully someone can comment on this. 1.    Use a System AccountFME Server can consist of both SAML and system user accounts. Consider creating a system user account whose credentials can be shared with those users who author workspaces in FME Desktop. This account can be used to create the web connection for FME Server trans

We have an 'Archived' repository on FME Flow. I was wondering if there was a way to create a workbench or an automation to, for example, delete a workspace after it has been sat in Archived for 30 days. Thanks

HelloI have checked the folder and file tree as well as the user rights, the proxy is disabled but nothing helps...Sincerely Error details :lun.-18-sept.-2023 12:23:20.749 PM  INFORM  fmeenginemgrnodeclient  402911 : Connecting to Job Queue localhost node host localhost port 6379.lun.-18-sept.-2023 12:23:21.253 PM  ERROR   fmeenginemgrnodeclient  402902 : Failed to connect to Job Queue. Please ensure Job Queue is started.lun.-18-sept.-2023 12:23:21.253 PM  ERROR   fmeenginemgrnodeclient  Failed to connect to any host resolved for DNS name.redis.clients.jedis.exceptions.JedisConnectionException: Failed to connect to any host resolved for DNS name.   at redis.clients.jedis.DefaultJedisSocketFactory.connectToFirstSuccessfulHost(DefaultJedisSocketFactory.java:63)   at redis.clients.jedis.DefaultJedisSocketFactory.createSocket(DefaultJedisSocketFactory.java:87)   at redis.clients.jedis.Connection.connect(Connection.java:180)   at redis.clients.jedis.Connection.initializeFromClientConfig(Con

Hi forum, I'm very new to FME Flow. I need to set up a schedule using cron expression for 07:00 Monday to Saturday, all year. I've entered... 0 7 * * 1-6 However FME Flow gives a message: "Invalid cron expression: 0 7 * * 1-6" I cant see what's wrong with it. Any thoughts? See attached image.Thanks,Stuart  

I am IT manager and have followed guide to register new app in azure with recommended Graph and SP permissions, also granted on behalf of the org but for some reason all users are still getting this needs admin approval and it is driving me bonkers, Please can someone assist me. We are using FME 2020.2, Single Tenant and the guide i have carefully followed is here How to Create a SharePoint Web Connection for FME Form [Single Tenant] (safe.com) As i am admin, the connector works fine for me with the new registered app ID and other specifics but just none else,

I managed a few users for my work and we have a few fixed licence codes under our EULA. Some of these have been reused and to test this process I activated two under my own install of 2022.2. I now have two codes listed under my install and I don't really need either, and there seems to be no way of removing them. I have followed other posts about location the directory where these are stored but there are no files located.  How are these managed? I can see they are re-usable but do they get automatically get removed from the previous machine? Should I uninstall before these get activated elsewhere? Many thanks for any help

Hi all.Running 2022.2.6 on Windows.My server is stacked with a 100 Gb C drive, and a 200 Gb E drive.I would like to move the location where FME server stores the job log files from C to E, and have therefore edited the file "C:\\Program Files\\FMEServer\\Server\\config\\logger\\engine\\messagelogger.properties", changing the location in LOG_FILE_PATH to a path on the E drive.But after restarting FME server, it still writes the job log files to the old default location on the C drive !!!Is the logger property even used ?Cheers.Lars

Excel Reader: Failed to open the dataset 'E:\\apps\\FMEServer\\resources\\system\\temp\\subscriptions\\efbc8d67696c47d6b70bc0aa87c67166.json'. Error message was 'It is not a xlsx file. Use the xlCreateBook() for a xls file.'

Hi all,Does anyone know how to fix his is error when execute ./fme python -m pip install sqlalchemy --target /Library/FME/2022.2/plugins : INFORM: Using Python interpreter from `/Library/FME/2022.2/fmepython310/lib/libpython3.10.dylib' with PYTHONHOME `/Library/FME/2022.2/fmepython310'INFORM: Python version 3.10 loaded successfullyCollecting sqlalchemy Using cached SQLAlchemy-2.0.20-cp310-cp310-macosx_10_9_x86_64.whl (2.0 MB)Collecting greenlet!=0.4.17 Using cached greenlet-2.0.2.tar.gz (164 kB) Preparing metadata (setup.py) ... doneCollecting typing-extensions>=4.2.0 Using cached typing_extensions-4.7.1-py3-none-any.whl (33 kB)Building wheels for collected packages: greenlet Building wheel for greenlet (setup.py) ... error error: subprocess-exited-with-error   × python setup.py bdist_wheel did not run successfully. │ exit code: 1 ╰─> [98 lines of output]   running bdist_wheel   running build   running build_py   creating build   ...   gcc -Wno-unused-result -Wsign-compar

I have the following problem: I have a csv file with multiple columns. I have a user parameter and i want to rename the columns according to this user parameter. Even though the "Text To Find" parameter of my BulkAttributeRenamer gets updated correctly the Renamer doesn't rename the correct column but renames the previously set column and deletes the values in the newly set column (see pictures). The BulkAttributeRenamer only renames the new column correctly if I:   - open the BulkAttributeRenamer properties   - replace "Text To Find" Parameter with something arbitrary    - close the BulkAttributeRenamer by clicking "Ok"   - open the BulkAttributeRenamer properties again   - set the "Text To Find" parameter back to my user parameter   - close the BulkAttributeRenamer by clicking "Ok"  I'm using FME Desktop 2020.2.3.0 on Windows 10Maybe someone can tell me if this is a bug or if I'm just overlooking something.  Many thanks i

Hello, I store attributes of my workspace in an json array (JSON_FILE_PARAM) using the FME Server Automations Writer (myWriter).{"automation.id":"c48fb4a8-5757-4207-867c-6d0de3947b5e","email.subject":"mySubject","email.received":"Wed Sep 13 09:37:26 CEST 2023","email.body":"e-mail:myEmail@provider.com"} Now, in my automation, I'd like to use the attributes as user keys:{route.myWriter.JSON_FILE_PARAM.email.body}I do have access to those attributes stored OUTSIDE the list but not INSIDE. I'm using FME Flow version 2020.

Hello,I am trying to execute an job in datastreaming via HttpCaller.The message I get back is "HTTP/1.1 401" although I have my login data filled in.I tried to use my usernmae and pw on the browser, it works fine.Just the transformer tells me its not ok.I tried the two possibilities mentioned here for users without a token : https://community.safe.com/s/article/401-unauthorized-error-when-making-fme-server-requDoesn't work either way.... Maybe someone stumbled accross a similar problem and has a solution ?