Skip to main content

General

A read-only category for lost FME Flow topics. We hope to move them shortly.

  • 608 Posts
  • 1,889 Replies
608 Posts
bayram
Contributor
bayramContributor
asked in General
XY Coordinate

hello everyone I want to produce a point from this data in text format and the XY values ​​I need are in a single stub. The FME dataset area is common for x and Y. I will bring these XY values ​​side by side and produce a point from the vertex creator, but I did not know how to do this.

3360
bayram
Contributor
sam_appleton
Contributor
sam_appletonContributor
asked in General
Querying log folders - writing all logs to one folder

Hi, I'm trying to ingest log files into Azure monitor so I can send out organisation wide notifications but i've run into an issue. When I look into the machine that flow is installed on, I can see that it is storing logs in folders in batches of 1000 and it will create new folder each time it hits a multiple of 1000. I can process files into Azure, but this doesn't seem to work with a wildcard in the /current/ folder - it needs a folder that already exists. Is there a way to write these logs all to the same folder? The file pattern/query i'm using: C:\\ProgramData......logs\\engine\\current\\jobs\\*\\job_*.txt Many thanks, Sam

313
david_r
Evangelist
bhk
Contributor
bhkContributor
asked in General
How to Connect & Access into $(Database Connections) SDE files on Flow

What Parameter should we use to connect to .sde(s) file uploaded to File & Connections-> Database Connections, on Flow? $(FME_MF_DIR)part_etl_server.sde Using above parameter we are able to connect the part_etl_server.sde which we attached into script publishing from Form but we need to connect into what we already have on server? Thanks

1090
j.botterill
Influencer
scarter
Contributor
scarterContributor
asked in General
In Apps, change the word OK in the OK button to RUN

Hello Forum, In FME Flow's App builder I would like the word in the OK button to be 'Run' instead of 'OK'. This is because OK, is often thought of as also meaning close (yes, I know the users could just close the browser tab). But of course, in the case of FME Flow Apps OK most definitely means 'run it'. So, it would be better if the word OK was replaced by Run. I've looked in Flow Apps>Manage Workspace Apps>(click the App in question)>Customise, but there doesn't seem to be an option to change the wording of the OK button. Any ideas? Thanks, Stuart

270
scarter
Contributor
deanr
Contributor
deanrContributor
asked in General
What do I do when the Backup_Configuration schedule is missing from my express installation?

I performed the express install of FME Flow 2023. Then I restored a backup from FME Server 2021. I do not see the backup schedule promised at https://docs.safe.com/fme/html/FME-Flow/AdminGuide/Perform_Scheduled_Backup.htm. Did my restore over write it? How can I automate a backup of FME Flow?

340
j.botterill
Influencer
dewrightco
Contributor
dewrightcoContributor
asked in General
Install/Upgrade to Latest flow fails to start - The driver could not establish a secure connection to SQL Server by using Secure Sockets Layer (SSL) encryption

When doing a start of the services after the DB has been initialized; I get this... com.microsoft.sqlserver.jdbc.SQLServerException: The driver could not establish a secure connection to SQL Server by using Secure Sockets Layer (SSL) encryption. Error: "PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target". Have verified the Server/Port pair are correct, as well as verified the port accessibility from the Flow Server to the DB.

23433
michelle_n
Contributor
tdun
Contributor
tdunContributor
asked in General
Is there a way to remove 'optional' text for non-required parameters in a Flow app?

Hi all, Is there a way to remove the word '(optional)' when generating a Flow App? I find unnecessary text too noisy for the user...they don't need to see the text (optional) on the app. Be good if there was an option to turn this prompt off?? thanks, Tim

320
virtualcitymatt
Celebrity
ewie
Contributor
ewieContributor
asked in General
Data upload in Flow App not working (stacktrace attached)

A user created a Flow App with a data upload but the upload is not working (no response from server). The stacktrace below shows that the backend cannot connect to some HTTPS endpoint. How can I find out what endpoint it is trying to connect to? Some config variable? This is a distributed FME Flow 2023.1.1.1 installation on Ubuntu 22.04. Stacktrace from /opt/fmeflow/resources/logs/tomcat/oxdedc001svdb02/catalina.2023-11-15.log: 15-Nov-2023 17:12:26.716 SEVERE [http-nio-127.0.0.1-8081-exec-9] COM.safe.web.servlet.HttpRESTModel.handleException GET:/dataupload/Korridor_B_Test/shapefile2postgis.fmw java.net.ConnectException: Connection timed out at java.base/sun.nio.ch.Net.connect0(Native Method) at java.base/sun.nio.ch.Net.connect(Unknown Source) at java.base/sun.nio.ch.Net.connect(Unknown Source) at java.base/sun.nio.ch.NioSocketImpl.connect(Unknown Source) at java.base/java.net.SocksSocketImpl.connect(Unknown Source) at java.base/java.net.Socket.connect(Unknown Source) at java.base/sun.

534
ewie
Contributor
scarter
Contributor
scarterContributor
asked in General
Flow auto-reading changes made to workspaces in Form

Hi Group, Imagine I create a workspace in Form which is then published to Flow. I'd then run this via Flow, and it runs fine. But if I then make a change in the original workspace in Form (even a tiny change like change the destination of a writer, or add a new transformer somewhere), do I then have to republish the workspace from Form to Flow? Or does Flow automatically pick up on changes made to the workspace in Form? Thanks, Stuart

140
scarter
Contributor
virtualcitymatt
Celebrity
virtualcitymattCelebrity
asked in General
Anyone know why the spike remover isn't working in this example?

I have a 3D dataset of lines several lines contain large spikes - like the one in the screen shot and attached template. I tried using the SpikeRemover but it doesn't seem to work - Does the Spike remover just not work on spike in the Z direction - the documentation doesn't really help identify why it doens't work? Failing that is there another way to remove points like the (z points which are about 100 meters off from the expected position). I started going down the line of extracting coordinates and trying to identify them that way but it seems like there must be a better way

470
virtualcitymatt
Celebrity
worjak
Contributor
worjakContributor
asked in General
PostGIS Writer gives massive numbers of warnings

Hi, We have recently upgraded our FME Server 2021.* to FME Flow 2023.1.1.1 Build 23636. Many of our workspaces work fine but some have started to take much more time. 1h30m copying 619855 features from SQL server to PostGIS in FME Flow with 15828934!!! warnings vs. 4m in FME Form with 530 warnings. The warnings are of this type (both Flow 2023 and Form 2023 - none in FME 2021): 2023-11-14 14:01:50| 186.1| 0.0|WARN |POSTGIS Writer: Renamed user attribute 'DW_TimeStamp' to 'dw_timestamp' based on format constraints for invalid characters, length, and case Is this behaviour due to the fact that our workspaces in FME flow 2023 still are in version 2021? Regards Jakob

280
hkingsbury
Celebrity
vxn43
Supporter
vxn43Supporter
asked in General
Schedule Manager - Total Runs auto-refresh?

In Manage Schedules, there is a column named "Total Runs"; this tells you how many times a Schedule has been run; is there a FME Flow Setting to have a particular Schedule "auto-refresh" the Total Runs at a specific interval? Currently, to view the total runs a user needs to refresh the page or step out of and back into Manage Schedules.

200
david_r
Evangelist
geomancer
Evangelist
geomancerEvangelist
asked in General
Fixed - Web Application Interface not starting - port 8005 in use?

FIXED We have encountered a strange problem on FME Server 2020.0.2: all of a sudden the Web Application Interface has stopped working. This happened right after I terminated a job that had run all weekend. In the logging of FME Server we can see all jobs are still run as usual, so it is just a problem with the Web Application Interface. This appears to be a Tomcat problem. The server runs Apache Tomcat 9.0.24. So we checked the latest catalina.<date>.log file. It contains the following error messages: 06-Nov-2023 09:28:32.913 SEVERE [main] org.apache.catalina.core.StandardServer.await Failed to create server shutdown socket on address [localhost] and port [8005] (base port [8005] and offset [0])java.net.BindException: Address already in use: JVM_Bindat java.net.DualStackPlainSocketImpl.bind0(Native Method)at java.net.DualStackPlainSocketImpl.socketBind(DualStackPlainSocketImpl.java:106)at java.net.AbstractPlainSocketImpl.bind(AbstractPlainSocketImpl.java:387)at java.net.PlainSocketImpl

11370
geomancer
Evangelist
rudacsmap
Contributor
rudacsmapContributor
asked in General
FME Flow and KeyCloak

Hello, we would like to authenticate FME Flow users via „KeyCloak“ application. Our idea is that FME Flow would somehow be connected to the KeyCloak application. The moment a user wants to log in to FME Flow, he would be redirected to KeyCloak, authenticated. KeyCloak passes the information back to the FME Flow application, and user will be logged in. Do you have any experience with FME Flow-KeyCloak collaboration? Keycloak supports protocols OpenID Connect, OAuth 2.0 and SAML 2.0.

2330
rudacsmap
Contributor
bhk
Contributor
bhkContributor
asked in General
FME Server New User with Basic fmeuser Role seeing Admin Folders

I have added a new team member into FME Server, with fmeuser role. Basically this user only care read and Run workspaces under Parks repository so in FME Server under Repositories slide-down I set this configuration but when I checked the user in the Server end point I am seeing this: As you can see two Samples and Tools repositories also listed there! When I check back in Server side, looks like there are some circled-checks on read and run options for these two! Now can you guys pleas let ne know how I can force this user to ONLY have access into Parks repository using the fmeuser role.

200
damiobasa
Safer
ronan
Participant
ronanParticipant
asked in General
FME Server 2022.2 - problem updating upload files

Hello, We have updated FME Server from 2020 to 2022.2. Then there is something wrong with the upload files : We publish into FMEServer a workbench containing a "File/URL" User parameter Then we RUN the workspace 2 times : The file we upload has the same name, but the content of these 2 files is different --> FME Server doesn't update the file located here : FME Server\\SystemShare\\resources\\system\\temp\\upload\\ if we don't purge the folder (In case we change the file name, it works well.) We have not encountered this problem with FME 2020.2 Can anyone help? Thank you Ronan

720
ronan
Participant
csrickard
Participant
csrickardParticipant
asked in General
Repeating process in Snapper part of workflow

I'm trying to prep a road network for use in the ShortestPathFinder. I found a flow on FME's documentation that looks like it does what I need (it uses a road network to prep for routing). The first three steps appear to have run fine, but I think the Snapper step keeps repeating. The following line has reached 100% completion 3 times but every time it does, it starts over doing the same thing: "Intersection operation processing one line against many others... 99.34% done Intersection operation processing one line against many others... 99.87% done Intersection operation processing one line against many others... 100% done Intersection operation processing one line against many others... 0.52% done Intersection operation processing one line against many others... 1.05% done Intersection operation processing one line against many others... 1.58% done" Below is a screenshot of the flow I'm running. Am I correct that one step just keeps repeating? If so, how do I correct it?

60
csrickard
Participant
arnovananrooij
Contributor
arnovananrooijContributor
asked in General
Read zip files wich a user can upload

Hi, I would like to create a fme server app where a user can upload multiple ZIP files. For each zipfile I would like to call a FeatureReader for one file within the zip file. How can I accomplish that? I tried the directory and file path names reader but this gives an error in FME server saying it expects a folder and not a file. Thank you

2820
koenterralytics
Contributor
vlroyrenn
Supporter
vlroyrennSupporter
asked in General
Controlling zip file hierarchy with Data Download/Data Streaming with multiple writers

I have a (FME Form 2023.0) workbench that generates three Excel files, where running locally via FME Form gets me a zip with this structure: my_data_$(TODAY).zip foo_$(TODAY).xlsx bar_$(TODAY).xlsx baz_$(TODAY).xlsx All three XLSX files are generated by three separate writers and have very distinct structures and different template files. When I publish the workbench to FME Flow and try running it with the DataDownload or Data Streaming services, however, I get a completely mangled zip file with this structure instead Output8719176120317945288.zip XLSXW_1 foo_.xlsx XLSXW_2 bar_.xlsx XLSXW_4 baz_.xlsx It seems like both services ignore whatever path the readers are configured to write to, and instead use a XLSXW_1_DATASET override that gets set by FME Flow, whose value seems to be $(FME_SERVER_DEST_DIR)/MULTI_WRITER_KEYWORD{0} with the file name appended at the end, without parameter expansion. Is there anything I can do to control the file structure inside that generated zip file, or p

370
vlroyrenn
Supporter
E
endorria
asked in General
Enable HTTPS using ADDS Certificate: the trustAnchors parameter must be non-empty

Hi, Following the documentation: https://docs.safe.com/fme/html/FME-Flow/AdminGuide/Starting-Stopping-FME-Flow-Manually.htm I tried to enable HTTPS for the server (FME Flow 2023.1 Build 23619 - win64). I can browse via HTTPS to my server without problem. When trying to run a job (Run Workspace / Samples / austinApartments.fmw / Data Download) I end up with an error 500. In the log (D:\\FMEFlow\\ProgramData\\resources\\logs\\tomcat\\NAME\\localhost***.log): SEVERE [https-jsse-nio-443-exec-8] org.apache.catalina.core.StandardWrapperValve.invoke Servlet.service() for servlet [JobRunnerForm] in context with path [/fmeserver] threw exception javax.net.ssl.SSLException: Unexpected error: java.security.InvalidAlgorithmParameterException: the trustAnchors parameter must be non-empty Is it safe to attach the full log files ? Best regards, Endorria

780
E
jvdkleijn_ehv
Contributor
jvdkleijn_ehvContributor
asked in General
FME server and SAML

The municipality of Eindhoven intends to change the current way of 'authentication' to 'SAML' authentication. The current way of authenticating is based on 'Windows Active Directory'. Within Eindhoven we use the publishing of FME Desktop scripts to FME server via the so-called 'FMEServerJobSubmitter'. This is based on an Active Directory account. FME version 2022.2.1 On the Safe website we find several articles that authentication within an FME flow via SAML does not support a number of transformers. One of them is the 'FMEServerJobSubmitter'. Two possible 'workarounds' are mentioned. We do have some questions about this. Hopefully someone can comment on this. 1. Use a System Account FME Server can consist of both SAML and system user accounts. Consider creating a system user account whose credentials can be shared with those users who author workspaces in FME Desktop. This account can be used to create the web connection for FME Server transformers. • Eindhoven works with AD accounts

1070
richardatsafe
Safer
M
mygush
asked in General
Since I installed FME FLOW 2023 my jobs can no longer run and I have an error.

Hello I have checked the folder and file tree as well as the user rights, the proxy is disabled but nothing helps... Sincerely Error details : lun.-18-sept.-2023 12:23:20.749 PM INFORM fmeenginemgrnodeclient 402911 : Connecting to Job Queue localhost node host localhost port 6379. lun.-18-sept.-2023 12:23:21.253 PM ERROR fmeenginemgrnodeclient 402902 : Failed to connect to Job Queue. Please ensure Job Queue is started. lun.-18-sept.-2023 12:23:21.253 PM ERROR fmeenginemgrnodeclient Failed to connect to any host resolved for DNS name. redis.clients.jedis.exceptions.JedisConnectionException: Failed to connect to any host resolved for DNS name. at redis.clients.jedis.DefaultJedisSocketFactory.connectToFirstSuccessfulHost(DefaultJedisSocketFactory.java:63) at redis.clients.jedis.DefaultJedisSocketFactory.createSocket(DefaultJedisSocketFactory.java:87) at redis.clients.jedis.Connection.connect(Connection.java:180) at redis.clients.jedis.Connection.initializeFromClientConfig(Connection.java:

1670
M
lifalin2016
Contributor
lifalin2016Contributor
asked in General
How to move location of job log files ?

Hi all. Running 2022.2.6 on Windows. My server is stacked with a 100 Gb C drive, and a 200 Gb E drive. I would like to move the location where FME server stores the job log files from C to E, and have therefore edited the file "C:\\Program Files\\FMEServer\\Server\\config\\logger\\engine\\messagelogger.properties", changing the location in LOG_FILE_PATH to a path on the E drive. But after restarting FME server, it still writes the job log files to the old default location on the C drive !!! Is the logger property even used ? Cheers. Lars

860
lifalin2016
Contributor
lgrie
Contributor
lgrieContributor
asked in General
Authentification error in spite of correct credentials

Hello, I am trying to execute an job in datastreaming via HttpCaller. The message I get back is "HTTP/1.1 401" although I have my login data filled in. I tried to use my usernmae and pw on the browser, it works fine. Just the transformer tells me its not ok. I tried the two possibilities mentioned here for users without a token : https://community.safe.com/s/article/401-unauthorized-error-when-making-fme-server-requ Doesn't work either way.... Maybe someone stumbled accross a similar problem and has a solution ?

180
lgrie
Contributor
itay
Supporter
itaySupporter
posted in General
community.safe.com

Hi Holly, I am addressing you since your name is on the article (https://community.safe.com/s/article/how-to-create-a-wms-service-using-fme-server?t=1694673698026) and it is not possible to leave a comment I have implemented the WMS via FME Flow and I have noticed a strange behavior that I wanted to report. When requesting data from the WMS service I have noticed that the client (QGIS) creates a request per layer. This is as expected, however on the FME Flow side I get 2 identical requests for each WMS layer. This doubles the response time of the WMS service and uses twice the resources on FME, is this something you can look into and reproduce? Since the WMS request is done via the GetCapabilities workspace is there a way to remove this duplicate request before they trigger the GetMap workspace? Cheers, Itay

160
itay
Supporter

Helpful Members This Week

Badge Winners

  • Welcome Back
    johannehas earned the badge Welcome Back
  • Socializer (Storyteller)
    danilo_fmehas earned the badge Socializer (Storyteller)
  • Webinar Watcher (Ruby)
    johannafalk1has earned the badge Webinar Watcher (Ruby)
  • Student (Grey)
    fei2000has earned the badge Student (Grey)
  • Welcome Back
    fei2000has earned the badge Welcome Back
Show all badges

Popular Tags

Community Stats

31,096
Posts
117,900
Replies
38,853
Members

Latest FME

Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.