Deploying FME Flow in the cloud
Recently active
We have 2 job submitter services to validate the data they’re sent, write files to FME Server/Flow resource directory, write data to an Oracle database and send a response of the data validation and writing via an HTTPCaller.As far as I know some users use some automated mechanism to submit a high number of jobs in a row to any of these services, which are called asynchronously.At some point someone suggested to call these services synchronously instead, but we are unsure about what is the best service mode (sync vs async) for this scenario. Any idea? I’ve searched in FME Server/Flow documentation to no avail.
Hi,I'm trying to upgrade a FME Flow Hosted instance, but I can't create snapshots from the backups tab, because I get this message "Snapshots not supported for unsupported instances"...How can I get a snapshot of my current instance to restore in the new one ?Thanks
Hi, I recently switched FME Flow Desktop to a new machine and missed exporting my web connections. Is there a way to download them from FME Hosted?
I have a bit of a dilemma. I'm setting up a self-serve workflow where the end-user will have to upload some files and then run them through a validation and processing workspace. The files that are needed are 1 mid/mif and 5 csv's with different schema's. To make things easier I want the user to zip them all up and upload them as a single file. I'm using a File user parameter then point that to a Generic reader which reads [somethingsomething].zip\\*.* and then use wildcards to match them to the specific feature types. This works fine if a single zip file is processed. However... this data is grouped by region and the customer indicated that sometimes they need multiple regions. Plus... features from two adjacent regions may actually geographically coincide, so the processing workspace needs to have them both at the same time. I set up the File parameter to handle multiple files as input, split the value and then run them through a FeatureReader. That's where the i
I have a issue in which your urgent help is required. I have a shared FME flow 2023.1 database which is accessed via two nodes. Both nodes have 5 engines each.When I check from fme flow url I can see all 10 engines ( 5 from each node) available. But if jobs are fired then only 5 engines become available and 5 always show idle.Please help to resolve this issue as it is stopping us from upgrading to latest FME flow.
Hey, so I'm looking at the download page here https://engage.safe.com/support/downloads/#official And I'm seeing tabs with "FME 2022.2" and "FME 2023.0" and "Past Versions". Is it fair to assume that FME 2023 is still in Beta? I think this page is pretty confusing now. I'm pretty sure this used to have a Beta section. Anyone visiting this page who wasn't familiar might just download FME2023 thinking it's ready for production... Checking the FME Cloud console I can see that FME 2023 is still listed as Beta anyone at Safe wanna fix the webpage? @andreaatsafe @nampreetatsafe @mark2atsafe
I had an FME Cloud 2022.2 instance where I had uploaded a Python module and its dependencies to the python38 directory as that was the version of Python I had on local machine running FME Desktop. Everything worked as expected. When I replaced the instance with an FME Flow Hosed 2023.1.1 instance, the workspaces using the module continued working normally. However, I wanted to upgrade the module as I was using a pre-release version. My local machine is now running Python 3.10, so I uploaded the new version of the modules and its dependencies to the python310 directory on the instance and removed the files in python38. I have not been able to get the module to work in the python310. I have both removed and re-added engines and rebooted the instance. If I move the files into the python38 directory, the module is accessible. I noticed that even though the workspaces have Python capability set to 310, the workspace logs on the instance always say they are using Python 3.8. This make
I don't want to make database connection by giving hardcoded values instead I want to use the secret keys from secret manager. is there any way to implement this in FME ?
I would like to prevent a Job to be automatically restarted after an Instance is restarted. In the FME Flow documentation I saw a "Job Recovery" configuration, does this configuration option exist in FME Flow Hosted (Cloud)? Can I set the max number of retries to 0 somewhere in FME Flow Hosted?
I am getting the "Unauthorized request by user due to lack of proper permissions", none of the provided examples seems to be applicable as it should be engine agnostic, and I can run it on one of the two availible engines.. It is a simple "Read table from oracle database" -> "Write table to different oracle database" Running on a schedule it chooses Engine1 where I get the following error"FME Server error: `FME Server error: `Unauthorized request by user due to lack of proper permissions for connection: ODB . Please see: http://fme.ly/zn8'" It connects to said ODB and then connects to ODB2 and then does nothing. Manual run, it chooses Engine2: Connects and reads from ODB, then writes to ODB2
Is there a way to customize the webhook url in FME flow hosted?
I'v been succesfull in loading additional python site-packages on FME flow hosted.Now I have a site-package that needs a newer verion of numpy then the one that's allready in the standard installation.Can I upgrade numpy on the FME Flow hosted environment?
I've been using FME:23 both Form and Flow since the beta release and I have encountered that none of my Flow apps work as they don't register the input files. The workspaces work fine when running them normally through the webinterface or via REST. I'm also aware that it is in beta and can't expect everything to be perfect, but just wondering if I'm the only one with this problem?
In other words what do I put in here, FME Cloud is a linux box so I dont think it will be an exe. Many Thanks for the help in advance!
Last saturday (23:46) I recieved the first message above. Then, at Sunday (00:01) I received the second one. Should I be worried about that? (So far, I have not received that kind of message again.)
Hello everyone, I'm looking for recommendations for a low-code front-end solution to display data transformations from the FME Cloud. The front-end needs to be able to display graphs, as well as linked GLTF and JSON files, with the best-case scenario being the ability to interact with 3D models. I am aware of the option to use Esri, but I am looking for other, more independent and cost-effective technologies. Can anyone recommend any low-code or no-code front-end solutions that would be a good fit for this use case? The FME Server Apps are great and simple to get the user to upload data. But at the moment I have an Html that returns information, with javascript graphs. But this is quite a static approach and I would like to be able to send the data to a databank and then just display the data for the user and let them make simple alterations. I know my around FME, but have very little or no experience with front-end development. I am just curious if there are solutions, without do
When running a workspace runner in FME cloud, it fails silently with the following error. "FME license system failure: FME is not licensed for this machine. Contact your Distributor." How do you use a workspace runner in cloud?
Looking for cost effective ways if an organization buys into FME Server, they can get redundancy if their network should go down by switching to FME Cloud backup.
Port 25 is open. Any other ideas?I also find that the topic is not appearing in the publishing list - would expect the topic 'receive_emails' here but only getting the out the box ones.All created using a superuser account. Think that these maybe connected in some way, I am running FME Cloud - FME Server 2022.2.1Build 22776 - linux-x64
We have a Standard FME Cloud Instance. After it starts running (scheduled) we get a Disk Usage Alert saying the Disk is 100% full. But the Instance Summary shows only 56% of Primary Disk are used (7.7 of 14 GB). The Monitor shows the Primary Disk usage never was more than 56%.Why do we get an Alert? What is a possibly the reason of the inconsistency? Is there a possibility to see what is using which disk space and get the size of each directory?
As far as I understood from the documentation, the self-hosted FME Server (installed on my own server) can be also licensed by CPU (Dynamic Engines)?That means that I have a full control and security (especially in terms of data privacy, etc) of FME Server like self-hosted FME Server with standard engine(s), however in terms of license it acts similar to FME Cloud?So if both questions are correct then the difference between self-hosted FME Server licensed by standard engine(s) and self-hosted FME Server licensed by CPU (dynamic engines) in regards to license is that the client pays for an extra standard engine only once, but for CPU Usage as long it in hours takes - continuous payment?
Hi there, I am running a number of jobs (all using the same workspace) on FME server, and some of them are running for a period of time (each job processes a number of URLs, so it is getting through some of the list, and then failing), and then failing with an XML module error. There are two errors:XML module Error: XalanFileOutputStreamWriteException: Error writing file: and XML module Error: 'SAXParseException: invalid document structure I am running 14 jobs at a time (on an FME Cloud Professional Server, so enough CPUs), and I have noticed that three will fail at the same time, and others will continue to run, so I suspect there is something interrelated (perhaps they all try to write to some XML log file at the same time?) If anyone has come across similar issues, or has any ideas of what I can try to work out the cause of this issue, that would be very gratefully received -it is a fairly urgent problem! I am running FME Server 2022.1.2 Build 22627 - linux-x64 I have attached
I wonder if I setup azure ad authentication service on my FME Cloud instance, would I be able to read and write drirectly from a azure fileshare? sourceFile //xxx.file.core.windows.net/yyy/source.extdestinationFile //xxx.file.core.windows.net/yyy/destination.ext Is this a common thing?
Our fme cloud export has been going wrong for about 2 months.Every other week we import gml-files into a Postgress database. The export from our Postgress database gives errors in a small part (16 of 235) of our export files in the formats csv and shape.Only the BGT_WGL_*.shp/shx/prj/dbf and BGT_WGL_*.csv files fail. The fme scripts have not been changed in recent years.When we run the fme script locally (fme2019) on a PC the export of these files gives no errors.Has anything changed in the "FME cloud" environment lately? In some of the transformers? Last Friday (sept 16) we did a reboot of the FME-cloud environment but this did not help. Attached are some examples of a shape and csv file which look like an error file in html format.Also, we can't find any log files in the cloud of the fme creation process of the shape and csv files.These log files (which we do have locally) can help us on our way solving the problem.We also did not receive an error message that it was no