- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Flow
Flow Hosted

Flow Hosted

Deploying FME Flow in the cloud

84 Posts
253 Replies

When you subscribe we will email you when there is a new topic in this category

84 Posts

Recently active

Most replies Most views Newest first

freddy17Contributor

asked in Flow Hosted

Low code front-end options for displaying FME Cloud Output, focus on graphs and 3D model viewers

Hello everyone, I'm looking for recommendations for a low-code front-end solution to display data transformations from the FME Cloud. The front-end needs to be able to display graphs, as well as linked GLTF and JSON files, with the best-case scenario being the ability to interact with 3D models. I am aware of the option to use Esri, but I am looking for other, more independent and cost-effective technologies. Can anyone recommend any low-code or no-code front-end solutions that would be a good fit for this use case? The FME Server Apps are great and simple to get the user to upload data. But at the moment I have an Html that returns information, with javascript graphs. But this is quite a static approach and I would like to be able to send the data to a databank and then just display the data for the user and let them make simple alterations. I know my around FME, but have very little or no experience with front-end development. I am just curious if there are solutions, without do

322

1 year ago

tim.rastall1Contributor

asked in Flow Hosted

WorkspaceRunner fails in cloud

When running a workspace runner in FME cloud, it fails silently with the following error. "FME license system failure: FME is not licensed for this machine. Contact your Distributor." How do you use a workspace runner in cloud?

171

1 year ago

runnealsContributor

asked in Flow Hosted

Is there a way to use FME Cloud for Disaster Recovery to FME Server?

Looking for cost effective ways if an organization buys into FME Server, they can get redundancy if their network should go down by switching to FME Cloud backup.

182

1 year ago

oliver.morrisContributor

asked in Flow Hosted

I am trying to monitor a topic (receiving email) but getting an error connecting to the monitoring service.

Port 25 is open. Any other ideas?I also find that the topic is not appearing in the publishing list - would expect the topic 'receive_emails' here but only getting the out the box ones.All created using a superuser account. Think that these maybe connected in some way, I am running FME Cloud - FME Server 2022.2.1Build 22776 - linux-x64

183

1 year ago

gpt_geoinfoContributor

asked in Flow Hosted

Why do we get a “Disk Usage” Alert (100%) when the Instance Summary shows only 56% of Primary Disk are used?

We have a Standard FME Cloud Instance. After it starts running (scheduled) we get a Disk Usage Alert saying the Disk is 100% full. But the Instance Summary shows only 56% of Primary Disk are used (7.7 of 14 GB). The Monitor shows the Primary Disk usage never was more than 56%.Why do we get an Alert? What is a possibly the reason of the inconsistency? Is there a possibility to see what is using which disk space and get the size of each directory?

192

1 year ago

dejan11Contributor

asked in Flow Hosted

FME Server CPU (Dynamic Engines) ≈ FME Cloud?

As far as I understood from the documentation, the self-hosted FME Server (installed on my own server) can be also licensed by CPU (Dynamic Engines)?That means that I have a full control and security (especially in terms of data privacy, etc) of FME Server like self-hosted FME Server with standard engine(s), however in terms of license it acts similar to FME Cloud?So if both questions are correct then the difference between self-hosted FME Server licensed by standard engine(s) and self-hosted FME Server licensed by CPU (dynamic engines) in regards to license is that the client pays for an extra standard engine only once, but for CPU Usage as long it in hours takes - continuous payment?

I am trying to access a FME Cloud instance but am getting a consistent error. I followed http://docs.safe.com/fme_cloud/FME_Cloud/Content/About_Instances/Instance_Lifecycles.htm but with no success. Any insight into how we can get this instance up ?

1 year ago

fionahf

asked in Flow Hosted

Issue with FME Server jobs - XML module errors

Hi there, I am running a number of jobs (all using the same workspace) on FME server, and some of them are running for a period of time (each job processes a number of URLs, so it is getting through some of the list, and then failing), and then failing with an XML module error. There are two errors:XML module Error: XalanFileOutputStreamWriteException: Error writing file: and XML module Error: 'SAXParseException: invalid document structure I am running 14 jobs at a time (on an FME Cloud Professional Server, so enough CPUs), and I have noticed that three will fail at the same time, and others will continue to run, so I suspect there is something interrelated (perhaps they all try to write to some XML log file at the same time?) If anyone has come across similar issues, or has any ideas of what I can try to work out the cause of this issue, that would be very gratefully received -it is a fairly urgent problem! I am running FME Server 2022.1.2 Build 22627 - linux-x64 I have attached

311

2 years ago

paalpedersenContributor

asked in Flow Hosted

If I set up azure ad in Authentication Services, will I be able to read and write from an external azure fileshare which use azure ad authentication?

I wonder if I setup azure ad authentication service on my FME Cloud instance, would I be able to read and write drirectly from a azure fileshare? sourceFile //xxx.file.core.windows.net/yyy/source.extdestinationFile //xxx.file.core.windows.net/yyy/destination.ext Is this a common thing?

121

2 years ago

datapuntContributor

asked in Flow Hosted

Our fme cloud export has been going wrong for about 2 months.

Our fme cloud export has been going wrong for about 2 months.Every other week we import gml-files into a Postgress database. The export from our Postgress database gives errors in a small part (16 of 235) of our export files in the formats csv and shape.Only the BGT_WGL_*.shp/shx/prj/dbf and BGT_WGL_*.csv files fail. The fme scripts have not been changed in recent years.When we run the fme script locally (fme2019) on a PC the export of these files gives no errors.Has anything changed in the "FME cloud" environment lately? In some of the transformers? Last Friday (sept 16) we did a reboot of the FME-cloud environment but this did not help. Attached are some examples of a shape and csv file which look like an error file in html format.Also, we can't find any log files in the cloud of the fme creation process of the shape and csv files.These log files (which we do have locally) can help us on our way solving the problem.We also did not receive an error message that it was no

1417

2 years ago

so_much_moreContributor

asked in Flow Hosted

How to add quotes around parameters values

I want to run a SQL before a writer to a postgis database.I am using parameters to dynamically run the SQL queries. Since SQL is case sensitive and my tables include case characters I need to put quotations around my table names. But putting quotes around my statement make it a string. I just want to add quotes the parameters value.select * from "$(schema)"."(fme_feature_type)"Desired resultselect * from "MySchema"."A_Table" Is there a way to escape the quotes somehow to just add quotes around the paramaneter value.

2636

2 years ago

paalpedersenContributor

asked in Flow Hosted

Python Exception <ModuleNotFoundError>: No module named 'fmepy_emailer'

Hi, After upgrading FMECloud to version 2022 our emailer complains with the following error:Python Exception <ModuleNotFoundError>: No module named 'fmepy_emailer'PythonFactory failed to load python symbol `fmepy_emailer.Emailer'Factory proxy not initializedEmailer_CALLER (PythonFactory): PythonFactory failed to process featureAn error has occurred. Check the logfile above for detailsIt looks like the emailer depends on a internal package called fmepy_emailer that does not exist in the environment.

4418

2 years ago

epro_adminContributor

asked in Flow Hosted

FME Cloud - send email when process starts. send email when process fails or completes with log file attached.

Hi FMEers, I'm new to Cloud and have been looking at the Automations section. I feel like what I want to do is really simple, but I'm not sure if it's something I set up in Desktop, automations, notifications (classic) or in the Job Submitter notification area? I have my workspace in the Cloud. I've tested it, and it runs and outputs all my data (although it comes up with a failure message). This is why I want to have an email automatically sent to me when the process gets started via a server app by the end user and when it ends (or fails) along with the log file, so I can check if it has written out everything, but is outputting as a failure. I've attached the log file. Thanks in advance for your help.

Hi Team, we have deployed fme server 2020.1.3.0 version into the linux machine. It is having python 2.7 version. Currently, one of the workspaces requires python 3.0 support. So, Is there any posibility that I can upgrade to the python 3.0 ?

2 years ago

asked in Flow Hosted

Import error when using paramiko and scp python libraries on FME Server

Hello everyone, I'm using the paramiko and scp python libraries in a pythoncaller to transfer files from my local environment to a remote Linux server. When testing locally I received an import error which I could solve by removing all contents of C:\\Users\\<user>\\Documents\\FME\\Plugins\\Python and reinstalling paramiko and scp. However, when I transferred the contents to the Plugin folder on my FME Server instance, managed by FME Cloud, I received the same import error I previously received on FME Desktop even though the Plugin folder on FME Server was empty to start with. The import error I receive is formatted like this: Python Exception <ImportError>: cannot import name '_bycript' from partially initialized module 'bcrypt' (most likely due to a circular import) (/data/fmeserver/resources/engine/Plugins/Python/bcrypt). The following python code is the source of the import error:import paramikofrom scp import SCPClient I noticed that the importerro

2672

2 years ago

tim.rastall1Contributor

asked in Flow Hosted

Is there a way to add Azure Blob Storage web connections in FME Cloud?

Hi folks, My FME workspace reads data from Azure Blob Storage. I'd like to run it in FME Cloud, but the account/password credentials do not get published to the server.I am able to replace the SourceDataset user parameter with a custom string containing embedded credentials ("fme://safe.azurestorage....") then run the workspace successfully, but this solution has some maintenance issues (not scalable, and would need to be applied to every workspace). I was hoping that I could create a Web Connection for Azure Blob Storage in FME Cloud, but it looks like I can only create an S3 bucket web resource: I also cannot add a new web connection: Can anyone help solve this issue? Thanks.

When publishing a workspace in FME to track version history a 'Commit' link is enabled as part of the publishing procedure. When I attempt to publish a workpace to I am not presented with this link.

2 years ago

freddy17Contributor

asked in Flow Hosted

Upload Url to Fme Cloud for processing

Good Day Everyone I am trying to create a directory watcher for a NextCloud folder. Once changes are made, run a workspace and publish results back into the NextCloud folder. So I am attempting to first upload the folder to fme server so that I can create a Directory Watcher to look inside the FME Server Resources folder and go from there. I have managed to get the download url from NextCloud, but I am struggling to conceptualise how to upload the url link as a .zip file to the FME Server Resources / temp folders? I have tried using the "FMEServerResourceConnector", but I either get errors, or it uploads only the url text - and not as a zip file. Resources I looked at:upload .zip file to FME Serverfme server playground - upload file in session As this first post is already 5 years old, I was wondering if there easier way of doing this, without me having diving deep into Rest Apis. I have attached my nextcloud workspace.fmw as well. Thank you for your timeCheers Fred

2 years ago

paalpedContributor

asked in Flow Hosted

Userparameter datefields missing clickable date selector, in workspace app.

Hello, So this is the second time our FMECloud app looses its clickable date selector for user paramterer datefields. When the soultion ran in test I had tom remove the full application, then republish everything. But I won't do the same approch in production, is there a qick way to get my clickable date selectors back?

2 years ago

paalpedContributor

posted in Flow Hosted

So today we did an upgrade from FMECloud 2020 to FMECloud 2022, I was a bit nervous because I was afraid some of the apps would break.

So today we did an upgrade from FMECloud 2020 to FMECloud 2022, I was a bit nervous because I was afraid some of the apps would break. Of course there was a reason for my concern, because I had modified FME 2020 to fit our needs. We like to make nice reports with a structured layout, thats why we use 3rd party libraries. These does not come with an FMECloud instance, so you need to do some tricks to install libraries on it. But how do you install libraries on an instance which is made up from containers, wouldn't they dissapear suddenly? Well, there are some persistent storage on FMECloud which you actually use quite frequently. I'm talking about the FME_SHARED_RESOURCE storage. Yup, you can install libraries on this storage. There are 2 ways to achive this, fire up a linux machine with the same os as FME Cloud install a library to a folder, then upload that data to FME SHARED RESOURCES or use the underlying machine to do the task. I choose option 2, I want packages I can use with t

2 years ago

mlev

asked in Flow Hosted

run my cloud workspace from html page. Get error: Authentication failed: Account is disabled

I adapted code of Upload File In Session example to call my workspace in cloud. I get error message: "Authentication failed: Account is disabled"What am I missing?

How can I retrieve an XML that was sent to an FME Server Workspace which was initiated by a webhook but never run (aborted)?

I have a workspace on FME Server which is initiated by a webhook. There is always an XML that comes with the webhook. The XML is passed into a parameter for the workspace. The workspace parses the XML and processes it into a database. Occasionally, the workspace fails or is aborted. I would like to try to run that workspace again or at the very least extract the XML payload. When the workspace fails (could be because the XML had an incorrect value or there were network issues), is there any way that I can retrieve the XML? Further, and this is probably more critical, if the workspace has been aborted (perhaps it was accidentally cleared from the queue), can I retrieve the XML? Or reprocess the message somehow? If I try to resubmit the failed job again , it doesn't seem to have the XML anymore. Or do I have to send the message again from it's source (Maximo)?

2 years ago

antoineContributor

asked in Flow Hosted

Is it possible to get the billing dashboard info through the API?

In the documentation, i can only get something like :{"balance":0.0,"available_credit":243.67,"estimated_costs":8.99}Is there a way to get as much details as on the dashboard page through the API? If not is there a way to generate a token to call directly the billing dashboard page?

2 years ago

qlddrones

asked in Flow Hosted

How do you edit transformer settings in FME Cloud?

I've uploaded an old FMW workspace for GeoTIF to ECW transformation that was created in FME 2016, but if unchanged it will output the ECW in WGS84, whereas the TIF is GDA2020. How can I update the ECW coordinate system for the output in FME Cloud?

2 years ago

fionahf

asked in Flow Hosted

FME Cloud / Server performance

Hi there, UPDATE 14th Feb 2022: I have now added my workbenches, though not sure how much more insight they will provide - I am wondering if it is the fact that an 'umbrella' process is running and taking a long time and therefore using up a lot of processing? Or if it is simply downloading a lot of zip files and then loading them into the database in a linear fashion that makes it take such a long time.I have also now upgraded my FME Cloud instance to 'Professional' - m5.xlarge, 4 CPUs, 16 GB RAM and 100GB temporary disk space - this did show an initial improvement (see additional graph data 14th Feb), but it is still averaging 00:02:15 per file, so will take 11 days just to download and upload 7,00+ files - this doesn't seem right to me?!Any pointers very gratefully received. And thanks again. I have an FME Server running on a standard FME Cloud (8 GB RAM, 2 CPUs, 25 GB Temp disk space) I am trying to understand the best set up of my workbenches / FME Cloud to en

141

2 years ago

Page 2 / 4

Badge winners

johnthas earned the badge Student (Bronze)
johnthas earned the badge Student (Grey)
johnthas earned the badge Teacher (Bronze)
johnthas earned the badge Teacher (Grey)
charisphhas earned the badge Welcome Back

Show all badges

30,142: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.