Skip to main content

Flow Hosted

Deploying FME Flow in the cloud

  • 92 Posts
  • 269 Replies
92 Posts
jferrer
Contributor
jferrerContributor
asked in Flow Hosted
Outputting a csv as txt

I wanted to make a simple app that reads from database and writes as either a csv or txt file. I created parameter to either choose csv or txt. I put that user parameter on the csv writer under dataset extension. When I try the app, I’m able to successfully download the csv but when I choose txt - it does not download but shows the full table right on the internet browser. I was wondering how to fix this. Also I am unsure as to how to use the txt writer and put my data as csv there instead. Maybe that would be a good workaround.

271
hkingsbury
Celebrity
apence231
Contributor
apence231Contributor
asked in Flow Hosted
FME Flow App - Geometry/Map picker Intermittently Not working

In my FME Flow app - I have a geometry/location picker option and sometimes the map is not centered right/doesn’t load correctly (notworking.png) but once a user refreshes the app a few times it goes back to working again (working.png). I’m on version 2022.1 of Flow Hosted and have the screenshots of what the different maps look like below.

101
j.botterill
Influencer
kirti2810kr
Contributor
kirti2810krContributor
asked in Flow Hosted
SQLCreator when used as a single transformer in a workbench file is unable to execute queries when run from FME Flow as a scheduled job

There is one workbench file that only has a SQLCreator within it that executes some update queries in the database tables for Oracle DB. This workbench was previously scheduled to run from FME server but we recently migrated our FME environment from FME Server (on-prem) to FME Flow 2023 (azure environment). We are seeing issues when this process is run from FME Flow , the SQL queries defined to be executed within the SQLCreator are not getting executed. However, when run from FME Form (2023) it is working fine. Can you please confirm if there is a known issue with SQLCreator from FME Flow. We have observed that when SQLCreator is replaced with Creator+SQLExecutor , the process seems to be working fine from both FME Form and FME Flow. Hence need confirmation to proceed with the change

322
kirti2810kr
Contributor
xanduqe
Contributor
xanduqe
asked in Flow Hosted
Allowing end-users to input an ESRI File Geodatabase via User Parameter in FME Flow Self-Serve App?

Hi All - I have done this multiple types with different data formats/inputs (e.g., Excel, CSV, Shapefiles) with no issue. However, I can’t seem to be able to allow end-users to select a fgdb from their drive and use as an input for the script (very simple script which converts Feature Class to other formats). The Workbench works perfectly fine via setting up a User Parameter which is linked to the ESRI File Geodatabase FeatureReader. I could even add another User Parameter to allow users to select specific Feature Classes for the script which is handy too but not necessary (linked to Feature Types to Read). However, once this is published in Flow then the interface doesn’t allow for the end-user to “Upload Files” like other Self-Serve Apps I have created. You only have the option to “Browse Resources” which doesn’t let you browse your computer to select the relevant File Geodatabase. Note that I have tweaked with the User Parameter “Item to Select” choice and chosen either ‘Folder’ or

271
daveatsafe
Safer
janroggisch11
Participant
janroggisch11Participant
asked in Flow Hosted
Access domain network resource (folder) from outside the domain

Hi everybody, Has anyone had success with accessing a file share on a domain-joined server from an FME Flow instance hosted on a VM that is not domain-joined? If so, what mechanism did you use to put this in place? Thanks for any thoughts and ideas!

170
janroggisch11
Participant
aaron_chaput
Contributor
aaron_chaputContributor
asked in Flow Hosted
HTTPCaller Timeout after 300s Regardless of Timeout Values Set

Hi, I’m attempting to run a workspace on FME Flow Hosted from within another workspace with an HTTPCaller using a webhook URL. The child workspace will eventually return a URL link to a zip file as it uses the DataDownload service. The workspace can take some time to run (> 5mins) as the data can be quite large. My issue is that I want to run the job synchronously so I’m able to retrieve the URL within the parent script to send it within an email, but the HTTPCaller always times out if the child script takes longer than 300s to run even if I set the timeout values to anything over 300s or even 0 (wait indefinitely). It is successful if the child script runs quickly (<300s). This is a problem as most instances will take longer than 300s. I don’t understand why it times out if it goes over 300s even if I tell it to wait longer. Is this a bug? If so, is there a work around or is it on the path to being fixed? Thanks

606
aaron_chaput
Contributor
itay
Supporter
itaySupporter
asked in Flow Hosted
How to avoid gatway time-out HTTP 504

Hi, I am using an FME Server app in which a theHTTPCaller is used to call on a second FME Server workspace. Here are some of the tags used in the URL (opt_showresult=true&opt_servicemode=sync&opt_responseformat=json) Long translations fail and return a HTTP 504 (HTTP/1.1 504 Gateway Time-out) even with the connection timeout lenght and transfer timeout lenght set to 0 Is there a way to avoid these timeouts? I suspect that it has to do with the FME Cloud settings, anybody can shed some light on the subject? Cheers, Itay

2069
aaron_chaput
Contributor
anteboy65
Contributor
anteboy65Contributor
asked in Flow Hosted
Mail body not used in sent email

From FME Script I’m using FMEFlowNotifier and sending one attribute value to a specific topic. Then I have a subscription that listens on that topic. So far so good. The problem is that when email is sent, the email body that I specifified on the server is not included in the mail. Anyone who can think of a reason for this?

242
anteboy65
Contributor
sc1
Contributor
sc1Contributor
asked in Flow Hosted
Esri ArcGIS Feature Portal Service writer results in errors, while running to a local .gdb the script runs fine

Hello, we noticed that with multiple scripts that have the feature portal service writer problems occurred: This is part of the log file when trying to run the workbench script: Loaded Python module `arcgisonlinefeatures' from file `C:\Program Files\ArcGIS\Data Interoperability for ArcGIS Pro\python\fme-plugins-py311.zip\arcgisonlinefeatures\__init__.pyc' Writer `ARCGISPORTALFEATURES_2' of type `ARCGISPORTALFEATURES' using group definition keyword `ARCGISPORTALFEATURES_2_DEF' Loaded Python module `arcgisonlinefeatures' from file `C:\Program Files\ArcGIS\Data Interoperability for ArcGIS Pro\python\fme-plugins-py311.zip\arcgisonlinefeatures\__init__.pyc' Message Type: fme::internal::_v0::py::Exception Python Exception <ValueError>: invalid literal for int() with base 10: '<Unused>' ARCGISPORTALFEATURES writer: An error has occurred. Check the logfile above for details When running the script using a local .gdb as a writer there are no problems and the script runs fine. What could be caus

312
sc1
Contributor
maadh.mamari
Contributor
maadh.mamariContributor
asked in Flow Hosted
Modify the message after job is completed in FME FLow

Hi all, I am wondering if anyone has faced a similar challenge. I created an FME workbench and published it to FME Flow successfully with some user parameters. The challenge is that I would like to send a message to the user after the job has completed running (or if failed). So instead of saying the job is completed or failed, I would like to modify it to give a more meaningful message. I do not want to send emails to users, otherwise I would have tried topics or automations. I just want to send a message (from an attribute) that appears at the end of the job. Thanks for the support in advance! Regards, Maadh

1536
maadh.mamari
Contributor
conch
Contributor
conchContributor
asked in Flow Hosted
Can SystemCaller be used to open a file within a FME Server Workspace App??

Hello FME community, here’s an outline of what I’m trying to accomplish: The fmw is included as a FME Server Workspace App (Server version 2021.2.5, Build 21816 - Linux). The fmw searches for features within a specified area (drawn by the user in the map) and if features intersect the drawn area, they are bundled into a FeatureWriter and provided to the user via a DataStreaming service. This works great when features are intersected. When features are not intersected, a NoFeaturesTester (stored in the same Repository as the fmw) directs the output to create a HTML file (FeatureWriter_3), created and stored in $(FME_SHAREDRESOURCE_TEMP). This file says something like “No results returned, the are no features of type X.Y,Z in the extent MinX, MaxX, MinY, MaxY...etc). Each time I test the App, the html file is created and populated correctly. Now the bit I don’t know is possible: at the end of the process is a SystemCaller which is attempting to open the HTML file in a new web browser tab

402
conch
Contributor
freddy17
Contributor
freddy17Contributor
asked in Flow Hosted
Custom Page for Flow Hosted instance is currently unavailable

I have two questions about hosting on the FME Flow Hosted Service The first is, when the Cloud Flow is offline, is it possible to show another page or change the standard offline page? I am trying to save some costs to run the Cloud instance for only certain hours, and it would be nice to give users feedback, which informs them of the times the service is live. The second is, how can I use my own domain for the Flow Cloud Hosting? I would like to change it for pure simplicity and because it avoids confusion to users who don't know what fme is. Is there simple ways to change these two things, any help would appreciated, or links on how to achieve this. RegardsFred

372
freddy17
Contributor
tdun
Contributor
tdunContributor
asked in Flow Hosted
Specify Extension Filters, working in Workbench, but not in Flow app

Hi all, I have a workbench which has a parameter that asks for a .ZIP file for input. Specifying extension filters works in workbench - user can only add/view files with an extension “.ZIP” When i publish this to FME Flow, and create a flow app, the extension filters are ignored and the user can select/view any file of any type. Bug? Using FME 2023.2.0.0. FME Flow 2023.2, Build 23747 - win64 thanks

752
pmcpherson
Contributor
oumar
Contributor
oumarContributor
asked in Flow Hosted
Connection to Flow

Hi All, I am getting this error when i open FME Workbench and I am not sure what to do at this point this was working for me. I am no longer able to connect to my FME Flow established connection. 2024-05-30 11:14:36| | |WARN |SQL Query UPDATE fme_nc_namedconnections set connectiontype = connectiontype WHERE fme_nc_namedconnections.ncid = ? failed. Error: attempt to write a readonly database

551
mattmatsafe
Safer
missp29
Contributor
missp29Contributor
asked in Flow Hosted
FME Flow Hosted connects to on-premise engines with remote engine service

Hi All, We have FME Flow (and Hosted) 2023.2. I would like to set up a FME Flow Hosted instance. The instance will have engines configured both on Cloud and on-premise. I am not very sure if the FME Flow Hosted instance can connect to the remote on-premise engines through so-called remote engine service. I read a discussion of the topic in this Forum below. It appears to be negative. But the discussion was 9 months ago. Not sure if it is still valid today. As the FME Administrator's Guide states, “Customers of FME Flow Hosted can also connect to Remote Engine Services.” https://docs.safe.com/fme/html/FME-Flow/WebUI/Remote-Engine-Services.htm#:~:text=Customers%20of%20FME%20Flow%20Hosted,Flow%20installation%20behind%20a%20firewall. But it is still not very clear and definite. Therefore. can anyone shed some light on this? Thanks -John

470
missp29
Contributor
swethabhupathi
Contributor
swethabhupathiContributor
asked in Flow Hosted
Error communicationg with FME host

We have two hosts for a fme server application. One is working fine. But, another host app service was stopping frequently. getting above error for one of the host

451
hkingsbury
Celebrity
nmatton
Contributor
nmattonContributor
asked in Flow Hosted
Share automation parameters empty box

Hello, In FME flow, when I try to share an “automation” using the corresponding button, I get a blank box with the “OK” button greyed out and no ways to share the automation of other users of the fme flow instance. Did I missed something ? Thanks for your feedback !

322
nmatton
Contributor
dms2
Contributor
dms2Contributor
asked in Flow Hosted
Best Job Submitter service mode (sync | async) for submitting many jobs in a row?

We have 2 job submitter services to validate the data they’re sent, write files to FME Server/Flow resource directory, write data to an Oracle database and send a response of the data validation and writing via an HTTPCaller. As far as I know some users use some automated mechanism to submit a high number of jobs in a row to any of these services, which are called asynchronously. At some point someone suggested to call these services synchronously instead, but we are unsure about what is the best service mode (sync vs async) for this scenario. Any idea? I’ve searched in FME Server/Flow documentation to no avail.

601
hkingsbury
Celebrity
maxime
Contributor
maximeContributor
asked in Flow Hosted
Snapshots for unsupported instances

Hi, I'm trying to upgrade a FME Flow Hosted instance, but I can't create snapshots from the backups tab, because I get this message "Snapshots not supported for unsupported instances"... How can I get a snapshot of my current instance to restore in the new one ? Thanks

856
hkingsbury
Celebrity
johnglick
Contributor
johnglickContributor
asked in Flow Hosted
Download Web Connection from FME Hosted

Hi, I recently switched FME Flow Desktop to a new machine and missed exporting my web connections. Is there a way to download them from FME Hosted?

1050
johnglick
Contributor
redgeographics
Celebrity
redgeographicsCelebrity
asked in Flow Hosted
Reading multiple files from multiple zipfiles

I have a bit of a dilemma. I'm setting up a self-serve workflow where the end-user will have to upload some files and then run them through a validation and processing workspace. The files that are needed are 1 mid/mif and 5 csv's with different schema's. To make things easier I want the user to zip them all up and upload them as a single file. I'm using a File user parameter then point that to a Generic reader which reads [somethingsomething].zip\\*.* and then use wildcards to match them to the specific feature types. This works fine if a single zip file is processed. However... this data is grouped by region and the customer indicated that sometimes they need multiple regions. Plus... features from two adjacent regions may actually geographically coincide, so the processing workspace needs to have them both at the same time. I set up the File parameter to handle multiple files as input, split the value and then run them through a FeatureReader. That's where the issue is: I can't seem

2580
panda
Enthusiast
A
akoundal
asked in Flow Hosted
All 10 engines not available for a shared FME flow 2023.1 database

I have a issue in which your urgent help is required. I have a shared FME flow 2023.1 database which is accessed via two nodes. Both nodes have 5 engines each. When I check from fme flow url I can see all 10 engines ( 5 from each node) available. But if jobs are fired then only 5 engines become available and 5 always show idle. Please help to resolve this issue as it is stopping us from upgrading to latest FME flow.

240
A
virtualcitymatt
Celebrity
virtualcitymattCelebrity
asked in Flow Hosted
Is FME 2023 released yet?

Hey, so I'm looking at the download page here https://engage.safe.com/support/downloads/#official And I'm seeing tabs with "FME 2022.2" and "FME 2023.0" and "Past Versions". Is it fair to assume that FME 2023 is still in Beta? I think this page is pretty confusing now. I'm pretty sure this used to have a Beta section. Anyone visiting this page who wasn't familiar might just download FME2023 thinking it's ready for production... Checking the FME Cloud console I can see that FME 2023 is still listed as Beta anyone at Safe wanna fix the webpage? @andreaatsafe​ @nampreetatsafe​ @mark2atsafe​

1390
p-chessel-vdg
Contributor
cnieman
Contributor
cniemanContributor
asked in Flow Hosted
What version of Python is in FME Flow Hosted 2023.1.1?

I had an FME Cloud 2022.2 instance where I had uploaded a Python module and its dependencies to the python38 directory as that was the version of Python I had on local machine running FME Desktop. Everything worked as expected. When I replaced the instance with an FME Flow Hosed 2023.1.1 instance, the workspaces using the module continued working normally. However, I wanted to upgrade the module as I was using a pre-release version. My local machine is now running Python 3.10, so I uploaded the new version of the modules and its dependencies to the python310 directory on the instance and removed the files in python38. I have not been able to get the module to work in the python310. I have both removed and re-added engines and rebooted the instance. If I move the files into the python38 directory, the module is accessible. I noticed that even though the workspaces have Python capability set to 310, the workspace logs on the instance always say they are using Python 3.8. This makes sense

2000
timatsafe
Safer
bhagyashrisingh
bhagyashrisingh
asked in Flow Hosted
How can we access AWS secret keys for connecting to database in FME workbench?

I don't want to make database connection by giving hardcoded values instead I want to use the secret keys from secret manager. is there any way to implement this in FME ?

1010
bhagyashrisingh

Helpful Members This Week

Badge Winners

  • Welcome Back
    cdoghas earned the badge Welcome Back
  • English Speaker
    jharmanhas earned the badge English Speaker
  • Webinar Watcher (Bronze)
    zeinabhas earned the badge Webinar Watcher (Bronze)
  • Webinar Watcher (Grey)
    dnarkewiczhas earned the badge Webinar Watcher (Grey)
  • Webinar Watcher (Grey)
    edwin.simonhas earned the badge Webinar Watcher (Grey)
Show all badges

Popular Tags

Community Stats

31,048
Posts
117,708
Replies
38,827
Members

Latest FME

Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.