Skip to main content
  • EN

Flow Hosted

Deploying FME Flow in the cloud

  • 93 Posts
  • 270 Replies
93 Posts
bhagyashrisingh
bhagyashrisingh
asked in Flow Hosted
How can we access AWS secret keys for connecting to database in FME workbench?

I don't want to make database connection by giving hardcoded values instead I want to use the secret keys from secret manager. is there any way to implement this in FME ?

1020
bhagyashrisingh
gpt_geoinfo
Contributor
gpt_geoinfoContributor
asked in Flow Hosted
Is there an option to prevent a Job to be automatically restarted after an Instance is restarted?

I would like to prevent a Job to be automatically restarted after an Instance is restarted. In the FME Flow documentation I saw a "Job Recovery" configuration, does this configuration option exist in FME Flow Hosted (Cloud)? Can I set the max number of retries to 0 somewhere in FME Flow Hosted?

150
virtualcitymatt
Celebrity
stkol
Contributor
stkolContributor
asked in Flow Hosted
"Unauthorized request by user due to lack of proper permissions" But only on one engine

I am getting the "Unauthorized request by user due to lack of proper permissions", none of the provided examples seems to be applicable as it should be engine agnostic, and I can run it on one of the two availible engines.. It is a simple "Read table from oracle database" -> "Write table to different oracle database" Running on a schedule it chooses Engine1 where I get the following error"FME Server error: `FME Server error: `Unauthorized request by user due to lack of proper permissions for connection: ODB . Please see: http://fme.ly/zn8'" It connects to said ODB and then connects to ODB2 and then does nothing. Manual run, it chooses Engine2: Connects and reads from ODB, then writes to ODB2

1170
stkol
Contributor
candacel
candacel
asked in Flow Hosted
Is there a way to customize the webhook url in FME flow hosted?

Is there a way to customize the webhook url in FME flow hosted?

710
keziaatsafe
Safer
stalknecht
Contributor
stalknechtContributor
asked in Flow Hosted
Can an existing python library be updated on FME Flow hosted?

I'v been succesfull in loading additional python site-packages on FME flow hosted.Now I have a site-package that needs a newer verion of numpy then the one that's allready in the standard installation.Can I upgrade numpy on the FME Flow hosted environment? 

460
virtualcitymatt
Celebrity
earlw
Contributor
earlwContributor
asked in Flow Hosted
FME Flow Hosted with on prem Remote engine

Is it possible to use FME Flow Hosted with a Remote engine located on an internal network. Thinking that this configuration would minimise FME Flow core maintenance, Simplify firewall rules, provide access to internal network resources like file system shares and databases... If it is possible, is there any documentation on how to setup this configuration.Cheers,e. 

960
earlw
Contributor
jatoxa
Contributor
jatoxaContributor
asked in Flow Hosted
Flow apps not working in Flow Hosted 23?

I've been using FME:23 both Form and Flow since the beta release and I have encountered that none of my Flow apps work as they don't register the input files. The workspaces work fine when running them normally through the webinterface or via REST. I'm also aware that it is in beta and can't expect everything to be perfect, but just wondering if I'm the only one with this problem?

170
jatoxa
Contributor
oliver.morris
Contributor
oliver.morrisContributor
asked in Flow Hosted
I would like to use the tesseract ocr TesseractCaller transformer in FME Cloud. How do I reference it

In other words what do I put in here, FME Cloud is a linux box so I dont think it will be an exe. Many Thanks for the help in advance!

1280
paalpedersen
Contributor
J
jorgeherediasni
asked in Flow Hosted
If I receive a "High Usage disk" alert clearance message before (by 15 mins) a "High usage disk" triggered alert, does it mean that currently I have that usage over the 90%?

Last saturday (23:46) I recieved the first message above. Then, at Sunday (00:01) I received the second one. Should I be worried about that? (So far, I have not received that kind of message again.)

130
kailinatsafe
Safer
freddy17
Contributor
freddy17Contributor
asked in Flow Hosted
Low code front-end options for displaying FME Cloud Output, focus on graphs and 3D model viewers

Hello everyone, I'm looking for recommendations for a low-code front-end solution to display data transformations from the FME Cloud. The front-end needs to be able to display graphs, as well as linked GLTF and JSON files, with the best-case scenario being the ability to interact with 3D models. I am aware of the option to use Esri, but I am looking for other, more independent and cost-effective technologies. Can anyone recommend any low-code or no-code front-end solutions that would be a good fit for this use case? The FME Server Apps are great and simple to get the user to upload data. But at the moment I have an Html that returns information, with javascript graphs. But this is quite a static approach and I would like to be able to send the data to a databank and then just display the data for the user and let them make simple alterations. I know my around FME, but have very little or no experience with front-end development. I am just curious if there are solutions, without do

440
freddy17
Contributor
tim.rastall1
Contributor
tim.rastall1Contributor
asked in Flow Hosted
WorkspaceRunner fails in cloud

When running a workspace runner in FME cloud, it fails silently with the following error.  "FME license system failure: FME is not licensed for this machine. Contact your Distributor." How do you use a workspace runner in cloud?

180
nielsgerrits
VIP
runneals
Contributor
runnealsContributor
asked in Flow Hosted
Is there a way to use FME Cloud for Disaster Recovery to FME Server?

Looking for cost effective ways if an organization buys into FME Server, they can get redundancy if their network should go down by switching to FME Cloud backup.

200
runneals
Contributor
oliver.morris
Contributor
oliver.morrisContributor
asked in Flow Hosted
I am trying to monitor a topic (receiving email) but getting an error connecting to the monitoring service.

Port 25 is open. Any other ideas?I also find that the topic is not appearing in the publishing list - would expect the topic 'receive_emails' here but only getting the out the box ones.All created using a superuser account. Think that these maybe connected in some way, I am running FME Cloud - FME Server 2022.2.1Build 22776 - linux-x64

330
keziaatsafe
Safer
gpt_geoinfo
Contributor
gpt_geoinfoContributor
asked in Flow Hosted
Why do we get a “Disk Usage” Alert (100%) when the Instance Summary shows only 56% of Primary Disk are used?

We have a Standard FME Cloud Instance. After it starts running (scheduled) we get a Disk Usage Alert saying the Disk is 100% full. But the Instance Summary shows only 56% of Primary Disk are used (7.7 of 14 GB). The Monitor shows the Primary Disk usage never was more than 56%.Why do we get an Alert? What is a possibly the reason of the inconsistency? Is there a possibility to see what is using which disk space and get the size of each directory?

200
damiobasa
Safer
dejan11
Contributor
dejan11Contributor
asked in Flow Hosted
FME Server CPU (Dynamic Engines) ≈ FME Cloud?

As far as I understood from the documentation, the self-hosted FME Server (installed on my own server) can be also licensed by CPU (Dynamic Engines)?That means that I have a full control and security (especially in terms of data privacy, etc) of FME Server like self-hosted FME Server with standard engine(s), however in terms of license it acts similar to FME Cloud?So if both questions are correct then the difference between self-hosted FME Server licensed by standard engine(s) and self-hosted FME Server licensed by CPU (dynamic engines) in regards to license is that the client pays for an extra standard engine only once, but for CPU Usage as long it in hours takes - continuous payment?

833
redgeographics
Celebrity
N
nicklabrise
asked in Flow Hosted
I am trying to access a FME Cloud instance but am getting a consistent error. I followed http://docs.safe.com/fme_cloud/FME_Cloud/Content/About_Instances/Instance_Lifecycles.htm but with no success. Any insight into how we can get this instance up ?

40
redgeographics
Celebrity
F
fionahf
asked in Flow Hosted
Issue with FME Server jobs - XML module errors

Hi there, I am running a number of jobs (all using the same workspace) on FME server, and some of them are running for a period of time (each job processes a number of URLs, so it is getting through some of the list, and then failing), and then failing with an XML module error. There are two errors:XML module Error: XalanFileOutputStreamWriteException: Error writing file: and  XML module Error: 'SAXParseException: invalid document structure  I am running 14 jobs at a time (on an FME Cloud Professional Server, so enough CPUs), and I have noticed that three will fail at the same time, and others will continue to run, so I suspect there is something interrelated (perhaps they all try to write to some XML log file at the same time?) If anyone has come across similar issues, or has any ideas of what I can try to work out the cause of this issue, that would be very gratefully received -it is a fairly urgent problem! I am running FME Server 2022.1.2 Build 22627 - linux-x64 I have attached

390
sanaeatsafe
Safer
paalpedersen
Contributor
paalpedersenContributor
asked in Flow Hosted
If I set up azure ad in Authentication Services, will I be able to read and write from an external azure fileshare which use azure ad authentication?

I wonder if I setup azure ad authentication service on my FME Cloud instance, would I be able to read and write drirectly from a azure fileshare? sourceFile //xxx.file.core.windows.net/yyy/source.extdestinationFile //xxx.file.core.windows.net/yyy/destination.ext Is this a common thing?  

130
evieatsafe
Safer
datapunt
Contributor
datapuntContributor
asked in Flow Hosted
Our fme cloud export has been going wrong for about 2 months.

Our fme cloud export has been going wrong for about 2 months.Every other week we import gml-files into a Postgress database. The export from our Postgress database gives errors in a small part (16 of 235) of our export files in the formats csv and shape.Only the BGT_WGL_*.shp/shx/prj/dbf and BGT_WGL_*.csv files fail. The fme scripts have not been changed in recent years.When we run the fme script locally (fme2019) on a PC the export of these files gives no errors.Has anything changed in the "FME cloud" environment lately? In some of the transformers? Last Friday (sept 16) we did a reboot of the FME-cloud environment but this did not help. Attached are some examples of a shape and csv file which look like an error file in html format.Also, we can't find any log files in the cloud of the fme creation process of the shape and csv files.These log files (which we do have locally) can help us on our way solving the problem.We also did not receive an error message that it was no

1517
merlinegeorge
Safer
so_much_more
Supporter
so_much_moreSupporter
asked in Flow Hosted
How to add quotes around parameters values

I want to run a SQL before a writer to a postgis database.I am using parameters to dynamically run the SQL queries. Since SQL is case sensitive and my tables include case characters I need to put quotations around my table names. But putting quotes around my statement make it a string. I just want to add quotes the parameters value.select * from "$(schema)"."(fme_feature_type)"Desired resultselect * from "MySchema"."A_Table" Is there a way to escape the quotes somehow to just add quotes around the paramaneter value.

3236
so_much_more
Supporter
paalpedersen
Contributor
paalpedersenContributor
asked in Flow Hosted
Python Exception <ModuleNotFoundError>: No module named 'fmepy_emailer'

Hi, After upgrading FMECloud to version 2022 our emailer complains with the following error:Python Exception <ModuleNotFoundError>: No module named 'fmepy_emailer'PythonFactory failed to load python symbol `fmepy_emailer.Emailer'Factory proxy not initializedEmailer_CALLER (PythonFactory): PythonFactory failed to process featureAn error has occurred. Check the logfile above for detailsIt looks like the emailer depends on a internal package called fmepy_emailer that does not exist in the environment. 

6048
M
epro_admin
Contributor
epro_adminContributor
asked in Flow Hosted
FME Cloud - send email when process starts. send email when process fails or completes with log file attached.

Hi FMEers, I'm new to Cloud and have been looking at the Automations section. I feel like what I want to do is really simple, but I'm not sure if it's something I set up in Desktop, automations, notifications (classic) or in the Job Submitter notification area? I have my workspace in the Cloud. I've tested it, and it runs and outputs all my data (although it comes up with a failure message). This is why I want to have an email automatically sent to me when the process gets started via a server app by the end user and when it ends (or fails) along with the log file, so I can check if it has written out everything, but is outputting as a failure. I've attached the log file. Thanks in advance for your help.

250
markw
B
backtofirst1
asked in Flow Hosted
Hi Team, we have deployed fme server 2020.1.3.0 version into the linux machine. It is having python 2.7 version. Currently, one of the workspaces requires python 3.0 support. So, Is there any posibility that I can upgrade to the python 3.0 ?

Hi Team, we have deployed fme server 2020.1.3.0 version into the linux machine. It is having python 2.7 version. Currently, one of the workspaces requires python 3.0 support. So, Is there any posibility that I can upgrade to the python 3.0 ?

110
J
K
kd
asked in Flow Hosted
Import error when using paramiko and scp python libraries on FME Server

Hello everyone, I'm using the paramiko and scp python libraries in a pythoncaller to transfer files from my local environment to a remote Linux server. When testing locally I received an import error which I could solve by removing all contents of C:\\Users\\<user>\\Documents\\FME\\Plugins\\Python and reinstalling paramiko and scp. However, when I transferred the contents to the Plugin folder on my FME Server instance, managed by FME Cloud, I received the same import error I previously received on FME Desktop even though the Plugin folder on FME Server was empty to start with. The import error I receive is formatted like this: Python Exception <ImportError>: cannot import name '_bycript' from partially initialized module 'bcrypt' (most likely due to a circular import) (/data/fmeserver/resources/engine/Plugins/Python/bcrypt). The following python code is the source of the import error:import paramikofrom scp import SCPClient I noticed that the importerro

3800
K
tim.rastall1
Contributor
tim.rastall1Contributor
asked in Flow Hosted
Is there a way to add Azure Blob Storage web connections in FME Cloud?

Hi folks, My FME workspace reads data from Azure Blob Storage. I'd like to run it in FME Cloud, but the account/password credentials do not get published to the server.I am able to replace the SourceDataset user parameter with a custom string containing embedded credentials ("fme://safe.azurestorage....") then run the workspace successfully, but this solution has some maintenance issues (not scalable, and would need to be applied to every workspace). I was hoping that I could create a Web Connection for Azure Blob Storage in FME Cloud, but it looks like I can only create an S3 bucket web resource: I also cannot add a new web connection:  Can anyone help solve this issue? Thanks.

640
siennaatsafe
Safer

Badge Winners

Show all badges

Community Stats

31,105
Posts
117,928
Replies
38,858
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.