Skip to main content
  • EN

Flow Hosted

Deploying FME Flow in the cloud

  • 95 Posts
  • 280 Replies
95 Posts
K
kd
asked in Flow Hosted
Import error when using paramiko and scp python libraries on FME Server

Hello everyone, I'm using the paramiko and scp python libraries in a pythoncaller to transfer files from my local environment to a remote Linux server. When testing locally I received an import error which I could solve by removing all contents of C:\\Users\\<user>\\Documents\\FME\\Plugins\\Python and reinstalling paramiko and scp. However, when I transferred the contents to the Plugin folder on my FME Server instance, managed by FME Cloud, I received the same import error I previously received on FME Desktop even though the Plugin folder on FME Server was empty to start with. The import error I receive is formatted like this: Python Exception <ImportError>: cannot import name '_bycript' from partially initialized module 'bcrypt' (most likely due to a circular import) (/data/fmeserver/resources/engine/Plugins/Python/bcrypt). The following python code is the source of the import error:import paramikofrom scp import SCPClient I noticed that the importerro

3900
K
tim.rastall1
Contributor
tim.rastall1Contributor
asked in Flow Hosted
Is there a way to add Azure Blob Storage web connections in FME Cloud?

Hi folks, My FME workspace reads data from Azure Blob Storage. I'd like to run it in FME Cloud, but the account/password credentials do not get published to the server.I am able to replace the SourceDataset user parameter with a custom string containing embedded credentials ("fme://safe.azurestorage....") then run the workspace successfully, but this solution has some maintenance issues (not scalable, and would need to be applied to every workspace). I was hoping that I could create a Web Connection for Azure Blob Storage in FME Cloud, but it looks like I can only create an S3 bucket web resource: I also cannot add a new web connection:  Can anyone help solve this issue? Thanks.

640
siennaatsafe
Safer
B
billymcgoff
asked in Flow Hosted
When publishing a workspace in FME to track version history a 'Commit' link is enabled as part of the publishing procedure. When I attempt to publish a workpace to I am not presented with this link.

When publishing a workspace in FME to track version history a 'Commit' link is enabled as part of the publishing procedure. When I attempt to publish a workpace to I am not presented with this link.

50
merlinegeorge
Safer
freddy17
Contributor
freddy17Contributor
asked in Flow Hosted
Upload Url to Fme Cloud for processing

Good Day Everyone I am trying to create a directory watcher for a NextCloud folder. Once changes are made, run a workspace and publish results back into the NextCloud folder. So I am attempting to first upload the folder to fme server so that I can create a Directory Watcher to look inside the FME Server Resources folder and go from there. I have managed to get the download url from NextCloud, but I am struggling to conceptualise how to upload the url link as a .zip file to the FME Server Resources / temp folders? I have tried using the "FMEServerResourceConnector", but I either get errors, or it uploads only the url text - and not as a zip file.  Resources I looked at:upload .zip file to FME Serverfme server playground - upload file in session As this first post is already 5 years old, I was wondering if there easier way of doing this, without me having diving deep into Rest Apis. I have attached my nextcloud workspace.fmw as well. Thank you for your timeCheers Fred

100
freddy17
Contributor
paalped
Contributor
paalpedContributor
asked in Flow Hosted
Userparameter datefields missing clickable date selector, in workspace app.

Hello, So this is the second time our FMECloud app looses its clickable date selector for user paramterer datefields. When the soultion ran in test I had tom remove the full application, then republish everything. But I won't do the same approch in production, is there a qick way to get my clickable date selectors back?  

60
paalpedersen
Contributor
paalped
Contributor
paalpedContributor
posted in Flow Hosted
So today we did an upgrade from FMECloud 2020 to FMECloud 2022, I was a bit nervous because I was afraid some of the apps would break.

So today we did an upgrade from FMECloud 2020 to FMECloud 2022, I was a bit nervous because I was afraid some of the apps would break. Of course there was a reason for my concern,  because I had modified FME 2020 to fit our needs. We like to make nice reports with a structured layout, thats why we use 3rd party libraries. These does not come with an FMECloud instance, so you need to do some tricks to install libraries on it. But how do you install libraries on an instance which is made up from containers, wouldn't they dissapear suddenly? Well, there are some persistent storage on FMECloud which you actually use quite frequently.  I'm talking about the FME_SHARED_RESOURCE  storage. Yup, you can install libraries on this storage. There are 2 ways to achive this, fire up a linux machine with the same os as FME Cloud install a library to a folder, then upload that data to FME SHARED RESOURCES or use the underlying machine to do the task. I choose option 2, I want packages I can use with t

150
paalped
Contributor
mlev
mlev
asked in Flow Hosted
run my cloud workspace from html page. Get error: Authentication failed: Account is disabled

I adapted code of Upload File In Session example to call my workspace in cloud. I get error message: "Authentication failed: Account is disabled"What am I missing?

350
markw
rchoucroun
Contributor
rchoucrounContributor
asked in Flow Hosted
How can I retrieve an XML that was sent to an FME Server Workspace which was initiated by a webhook but never run (aborted)?

I have a workspace on FME Server which is initiated by a webhook. There is always an XML that comes with the webhook. The XML is passed into a parameter for the workspace. The workspace parses the XML and processes it into a database. Occasionally, the workspace fails or is aborted. I would like to try to run that workspace again or at the very least extract the XML payload.  When the workspace fails (could be because the XML had an incorrect value or there were network issues), is there any way that I can retrieve the XML? Further, and this is probably more critical, if the workspace has been aborted (perhaps it was accidentally cleared from the queue), can I retrieve the XML? Or reprocess the message somehow?  If I try to resubmit the failed job again , it doesn't seem to have the XML anymore. Or do I have to send the message again from it's source (Maximo)?

110
rchoucroun
Contributor
antoine
Contributor
antoineContributor
asked in Flow Hosted
Is it possible to get the billing dashboard info through the API?

In the documentation, i can only get something like :{"balance":0.0,"available_credit":243.67,"estimated_costs":8.99}Is there a way to get as much details as on the dashboard page through the API? If not is there a way to generate a token to call directly the billing dashboard page?

150
antoine
Contributor
Q
qlddrones
asked in Flow Hosted
How do you edit transformer settings in FME Cloud?

I've uploaded an old FMW workspace for GeoTIF to ECW transformation that was created in FME 2016, but if unchanged it will output the ECW in WGS84, whereas the TIF is GDA2020. How can I update the ECW coordinate system for the output in FME Cloud? 

80
redgeographics
Celebrity
F
fionahf
asked in Flow Hosted
FME Cloud / Server performance

Hi there, UPDATE 14th Feb 2022: I have now added my workbenches, though not sure how much more insight they will provide - I am wondering if it is the fact that an 'umbrella' process is running and taking a long time and therefore using up a lot of processing? Or if it is simply downloading a lot of zip files and then loading them into the database in a linear fashion that makes it take such a long time.I have also now upgraded my FME Cloud instance to 'Professional' - m5.xlarge, 4 CPUs, 16 GB RAM and 100GB temporary disk space - this did show an initial improvement (see additional graph data 14th Feb), but it is still averaging 00:02:15 per file, so will take 11 days just to download and upload 7,00+ files - this doesn't seem right to me?!Any pointers very gratefully received. And thanks again.  I have an FME Server running on a standard FME Cloud (8 GB RAM, 2 CPUs, 25 GB Temp disk space) I am trying to understand the best set up of my workbenches / FME Cloud to en

190
virtualcitymatt
Celebrity
peteratqfes
Contributor
peteratqfesContributor
asked in Flow Hosted
Error using AttributeFileWriter and FeatureReader on FMECloud - Unfinished file?

I have a workbench which is writing out a zip file containing a shapefile using AttributeFileWriter then using a FeatureReader on the resulting zip file. It works fine in FME Desktop 2021 writing to a temp directory. When I run on FMECloud using the Temp resource folder I get an error when reading the zip file. If I download the zip file from the resource folder the file is valid. It's like the file is being held onto by the AttributeFileWriter (or it hasn't finished writing).I don't get the two warnings below in FME Desktop. It seems to imply the files haven't finished being written out.  Is there any way to avoid this unfinished writing, or is there any way to take the binary shapefile zip data and read that directly without writing out to file?It might be possible to break out the workbench into multiple workbenches in the automation. This might happen on FME Server as well as FMECloud (I haven't tried it yet)

350
peteratqfes
Contributor
P
petrb
asked in Flow Hosted
featureWriter returns different output structure in FME Cloud

Hello. my script in Workbench provides nicely zipped result from FeatureWriter. one excel sheet and one shapefile, named using User Parameter ("someID")  When I publish this to FME Cloud, the structure of resulting zipped is completely mangled, and the user attribute value is not provided to the final file names (SomeID is fallback default value)(picture shows the flat view, each zip is in one of those folders)  Can this be fixed so the result output of Cloud workflow has the same structure as the Workbench result?  if I set the publish parameters in following way, the final zip file contains only one of the result files, either SHP or XLS    

90
T
T
theamai10
asked in Flow Hosted
Elevation numbers exist, but output visually empty in ArcMap?

I am very new to the FME tool, I downloaded it to change my LAZ files to LAS. I have gone through a few tutorials, and my output is not empty. I have LAS point elevations, but visually it is empty. I have a big reg square, representing the outline of the LAZ tile I downloaded, located in the correct place on earth. There is nothing in the red square. Where do I go from here?

40
rahulsharma
Safer
geobiker
Contributor
geobikerContributor
asked in Flow Hosted
Open a file on FME_SHARED_RESOURCE_DATA Directory with pythonCaller

Hello, I want to open a file with the PythonCaller stored on the [FME_SHARERESOURCE_DATA] directory. The python enviroment can access the directory and the script end with an exception:TypeError: expected str, bytes or os.PathLike object, not NoneType Is it possible to map the FME_SHARED_RESOURCE_DATA Directory in the python script?  Kind regardsStefan

1269
david_r
Celebrity
itay
Supporter
itaySupporter
asked in Flow Hosted
Using POST and body to trigger FME Server workspace.

Hi There,I am pretty sure what the answer is, just covering all bases....Normally when running a workspace published to FME Server the workspace parameters are populated via the query parameters and therefore the workspace URL contains the parameters provided. Registrating the workspace to the streaming service and defining the streaming output content, allows to provide the requesting application with the transformation results. Another way to run workspaces on FME Server is via the REST API but this does not return the workspace output to the requesting application, since the streaming service is not used. Now my question is: Is it possible to trigger a published workspace by posting the parameters values in the body and NOT in the URL while using the streaming service to return the transformation results to the requesting application? so using a POST + body and getting the transformation results and NOT the job id (async) or job transformation status (synch) Does naybody know if thi

2680
itay
Supporter
drejkzet
drejkzet
asked in Flow Hosted
FME Cloud dgn writer messes up character encoding.

I have FME desktop 2020.1 installed - when I generate dgn file everything looks ok, however when I publish it on cloud accents and diacritics go crazy.My local machine runs on win-1250. FME Cloud / Server run utf-8, is there a way to make this not mess up my texts? I have tried AttributeEncoder with no success.

620
virtualcitymatt
Celebrity
B
billymc
asked in Flow Hosted
I am being tasked by my manager to devise a process to move on prem FME to FME cloud. I cannt discover any documentation on this - Can you please direct me further. Regards

I am being tasked by my manager to devise a process to move on prem FME to FME cloud. I cannt discover any documentation on this - Can you please direct me further. Regards

80
redgeographics
Celebrity
john.beck
Contributor
john.beckContributor
asked in Flow Hosted
How can I use ReframeReprojector in FME Cloud?

I am trying to use ReframeReprojector to transform swiss coordinates within FME Cloud and I get the following error: "ReframeReprojector: Reproject: Could not reproject the geometry of the preceding feature: Dynamic reproject engine `REFRAMEREPROJECT' cannot be found". Is it possible to make the reframeproject available to the FME Cloud engine?

110
john.beck
Contributor
E
edidimand
asked in Flow Hosted
Is it possible to use deprecated (Python 2.7) transformers on the FME Server in Cloud?

We have a SnakeGridProjector transformer that we would like to use in one of our pipelines. We are wondering if it is possible to use it despite FME advicing against old python versions or if there is any better alternative? The projector is a must for the pipeline

80
david_r
Celebrity
B
bjarnefagerbakk
asked in Flow Hosted
Fmecloud, htmlfile and textbox with autocomplete

Is it possible ​to use autocomplete in fmecloud?

140
B
A
avinashdalvi_
asked in Flow Hosted
How "Pass Against All Base" Criteria work in SpatialFIlter. ?

I tried to find out any example or details about pass criteria shown in "Pass against All base" in Spatial filter but no luck. Can anyone explain how its work ? If example Base is Parcel shape file and candidate is building centroid.  Any help here ? 

110
chrisatsafe
Contributor
mcannalea12
Contributor
mcannalea12Contributor
asked in Flow Hosted
Is it possible to create workbenches in FME Cloud or Server that would allow users to drop in two excel spreadsheets to perform a simple but customizable feature merger?

I am constantly getting asked to perform extremely simple excel tasks for my co-workers - vlookups, pivot tables, etc. Is it possible to create a workbench where they could just drag and drop their two spreadsheets, select their requestors and suppliers and hit run? I know how to do this in FME Desktop but how can I recreate this on cloud with a super simple user-interface and save myself some time?

60
david_r
Celebrity
jatoxa
Contributor
jatoxaContributor
asked in Flow Hosted
UDP message received on FME Cloud is nonsense

I have set up a sensor to send UDP messages to FME Cloud via a GSM modem and it works great as a trigger, but the message that arrives is nonsense.  I believe everything is sent as bytes through the serial port so I have no idea whether its possible to format it before sending or the problem is how FME Cloud is receiving the data. 

70
jatoxa
Contributor
jatoxa
Contributor
jatoxaContributor
asked in Flow Hosted
I'm trying to set up an automation on FME Cloud where the trigger is an UDP message. I have tried several configurations and I'm testing with an UDP sender tool but I can't seem to receive anything.

I have set up static IP adress for the cloud instance as I assume this is necessary?

50
jatoxa
Contributor

Badge Winners

  • Student (Bronze)
    geo-xhas earned the badge Student (Bronze)
  • Student (Grey)
    geo-xhas earned the badge Student (Grey)
  • Teacher (Bronze)
    geo-xhas earned the badge Teacher (Bronze)
  • Teacher (Grey)
    geo-xhas earned the badge Teacher (Grey)
  • Student (Grey)
    akeerihas earned the badge Student (Grey)
Show all badges

Community Stats

31,196
Posts
118,249
Replies
38,801
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.