- - Community Resources
Ideas
Product Updates
Events
Blog

Home
Forums
FME Flow

FME Flow

A space to discuss FME Flow

2323 Posts

Recently active

Most replies Most views Newest first

asked in Flow Hosted

Import error when using paramiko and scp python libraries on FME Server

Hello everyone, I'm using the paramiko and scp python libraries in a pythoncaller to transfer files from my local environment to a remote Linux server. When testing locally I received an import error which I could solve by removing all contents of C:\\Users\\<user>\\Documents\\FME\\Plugins\\Python and reinstalling paramiko and scp. However, when I transferred the contents to the Plugin folder on my FME Server instance, managed by FME Cloud, I received the same import error I previously received on FME Desktop even though the Plugin folder on FME Server was empty to start with. The import error I receive is formatted like this: Python Exception <ImportError>: cannot import name '_bycript' from partially initialized module 'bcrypt' (most likely due to a circular import) (/data/fmeserver/resources/engine/Plugins/Python/bcrypt). The following python code is the source of the import error:import paramikofrom scp import SCPClient I noticed that the importerro

how to secure FME Workbench?

Hi,I have a FME workbench, so i have to use it within my organization and i want to restrict it to outsiders based on domain name or in any possible way. how can i do this ?

Hello, I am trying to figure out how to configure the emailer (To) to be based on a a table attribute (surveyor name) and have set up conditional statements.

I have survey records being written to a database using a work bench. Along the way there is a transformer that checks for null values, if they exist currently the records are wrote to a .csv file to be checked. I would like to send an email to the surveyor so they can edit and resend their records for writing to the database. Currently I have a HTML Report Generator set up for a table of records that have null values. I had tried to use the Attribute File Writer to isolate the surveyor name and then use the html content in the email body. This doesn't seem to work and was hoping someone has a workflow. Basically the Emailer 'To' is conditional based on the survey record submitted and then I would like the email to contain the survey record with null value. Thanks in advance!,Kathy

142

2 years ago

tim.rastall1Contributor

asked in Flow Hosted

Is there a way to add Azure Blob Storage web connections in FME Cloud?

Hi folks, My FME workspace reads data from Azure Blob Storage. I'd like to run it in FME Cloud, but the account/password credentials do not get published to the server.I am able to replace the SourceDataset user parameter with a custom string containing embedded credentials ("fme://safe.azurestorage....") then run the workspace successfully, but this solution has some maintenance issues (not scalable, and would need to be applied to every workspace). I was hoping that I could create a Web Connection for Azure Blob Storage in FME Cloud, but it looks like I can only create an S3 bucket web resource: I also cannot add a new web connection: Can anyone help solve this issue? Thanks.

481

2 years ago

fbinnemanContributor

asked in Automation

Split number of images over the same area into smaller groups for post processing

We have a large number of JPG images that cover the same area (flown with a drone in a criss-cross pattern). We need to split the set of images into smaller, workable groups. The idea is to, if possible, create an area of 2 rows by 2 columns that cover the same area where the images were taken. If an image falls within one of the four quadrants, it should be moved to a specific folder that representsthat quadrant. That way we can correctly subdivide the set of images into four, more manageable blocks. The 2DGridAccumulator seems to be able to setup a grid, but is there now a way to compare each image to each cell of such a generated grid and then move that image to a folder as explained above? As the drone flew in a criss-cross pattern, the date modified for each file cannot be used to determine in what block it should be placed (ie by just using Windows File Explorer to categorise the images). Apologies if there is a straight forward solution for this which I could not find.

843

2 years ago

pmcphersonContributor

asked in Automation

It is possible to set up multiple CRON triggers in a single Automation AND use JSON messages from upstream block set by an embedded Automations writer?

Is it possible to use multiple CRON triggers in the same Automation, also while "passing" values from one workspace block to another using values from an embedded Automations writer? Essentially I would like to set up a single Automation that triggers at a given time, completes a number of steps, and then "waits" for a second CRON trigger to continue with additional steps, and with the additional steps part of the routine using a value from an upstream block.

342

2 years ago

oihdosjContributor

asked in General

File upload progress status is not accurate

I've written an FME Server app that uses the ZipExtrator transformer. I've set the Source Zip File as a user parameter so when it is run, the user is prompted to select the file they want to upload. Once the user has selected their file and kicked off the file upload, I've noticed that when the file upload progress bar has reached 100%, the upload process hasn't actually finshed. If I inspect the network traffic in the browser dev tools, the HTTP request for the file upload process does not complete until several seconds after the file upload progress bar shows 100%. If the user clicks OK before the HTTP request has finished, then the job fails. If the user waits until the HTTP request has finished then click OK, the job runs successfully. Has anyone else seen this behaviour? I've upvoted this idea which is similar to this, but this seems to me like a bug and not an enhancement. I'm running FME Desktop 2021.2 and FME Server 2021.2.

Repository "xxxxxxxx" doesn't exist or you do not have permission to Read or Run from it

If i want to run apps from galery, system send me Repository "xxxxxxxx" doesn't exist or you do not have permission to Read or Run from itBut permissions on repository "xxxxxxxx" is OK - Run and Read.This problem started after i tested changes in permissions on this repositories. Versions: FME Server 2022.0.0.2 Build 22343 - win64 Thank you for your advices

411

2 years ago

markcoopersdcContributor

asked in Architecture

Hi. Im having no luck connect to sql express db. Can FME connect to SQL Express? If so, should I be using the ADO or JDBC reader? Also, is there anything else that could be an issue? Ive put the server and instance name in and port 1433 is open. Tha

134

2 years ago

dustinInfluencer

asked in Automation

Access permissions - FME Server

I have a workbench that is reading in FFS files as source. The files are located at a network location that required permissions from IT under our logins to access, \\\\serverloc\\folder\\source.ffs. Everything works as expected from Desktop. The issue is when we upload the workbench to FME Server. The error is Invalid Dataset '\\\\serverloc\\folder\\source.ffs'. Dataset must exist prior to reading. We have spoken with the admin of FME Server, who said they added a service account that is used for the FME Services to access that network location. We are getting the same error. What steps need to be taken to allow FME Server access to read from this location?

1021

2 years ago

clairestoddartContributor

asked in General

Is it possible to recieve an email when a user has not logged in for 3 months?

I want to be able to manage user acounts, particularly those that have not been used in a significant period of time. Is there a way to do this automatically with FME Server?

133

2 years ago

rishi1804Contributor

asked in Automation

I am creating an FFS after doing some filtering with a DGN file but along with the FFS file, my workbench is creating an FRS file as well. Why is this happening? And it doesn't happen with all the DGN files.

@david_r @Hans van der Maarel @safesoftware safesoftware

193

2 years ago

mkastelijnsContributor

asked in Security

Does the FME platform use the DCOM-protocol in any way?

Dear community,Upcoming June the 14th Microsoft DCOM will get ‘hardened’ by a update. Therefore I would like to know if the DCOM-protocol is used in any way within FME and if anyone knows this update could affect FME server. If this is the case, it is necessary to test the new hardening. For more information on this update: (https://support.microsoft.com/en-us/topic/kb5004442-manage-changes-for-windows-dcom-server-security-feature-bypass-cve-2021-26414-f1400b52-c141-43d2-941e-37ed901c769c) Used FME server versions: FME server 2018.1 & 2021.1

2 years ago

chris28

asked in Automation

Workspace Apps and Gallery Apps

I have created workspace apps and then used them to create my gallery app. If I then update the original workspace and re-publish it, do I need to recreate both the workspace apps and then the gallery app to get the updated workspace?

141

2 years ago

marnickcleContributor

asked in Automation

Inability to use the output of an automations Writer as input for a password user parameter

Hi, I'm trying to use the output of an Automations Writer (workspace 0) as input for the next workspace (1). For the two 'Text' User Parameters, I can use the drop down menu and choose the 'SFTP_Username' Attribute of the Automations Writer as the input for the next Workspace. However, for the 'Password' User Parameter, the is no drop down menu to choose the 'SFTP_Password' Attribute of the Automations Writer. I have tried inserting it as '{route.ConnectionParameters.SFTP_Password}' and this did not work. Any suggestions would be highly appreciated! Regards

2 years ago

stefanhContributor

asked in General

FME Server jobs keeps running (cannot cancel the job)

On FME Server there is a job running in some kind of loop. I am not able to cancel the job; even when I cancel the jobs it keeps running. I have tried many things:- disabling the automation- removing the workspace We restarted the Server, but the job just started immediately. I find this information in the System Events:Event Description: Triggered whenever an error message is logged to fmeserver.log.Event Title: Error Message LoggedMessage: ERROR: duplicate key value violates unique constraint "fme_job_history_pkey" Detail: Key (job_id)=(37020) already exists. Does someone has an idea how I can fix the issue?

1492

2 years ago

johntContributor

asked in General

Receive Emails (IMAP) Part 2 - ghost workspace error (but all works)

Hi, We are running FME Server 2019.2.3.2 - Build 19825 - win64 (yeah, I know - upgrade coming soon). We successfully set up IMAP on an account and the Publication/Topic in FME Server to receive emails. I followed the tutorials and created my own workspace. Everything works as it should, however, in the Jobs completed page on FME Server I see this (ReceiveEmailTester.fmw is mine): The ReceiveSMTPEmail.fmw doesn't exist in FME Server, but I notice that a fmwt version exists in the download package from:https://community.safe.com/s/article/receiving-email-part-2-processing-email-with-a-wor In the tutorial I notice a screenshot that shows their workspace and this SMTP workspace - both having run successfully. I cannot find any reference to this extra workspace or explanation for why it is there or why FME Server tries to run it. Suffice to say there is no log file generated. Particularly odd as it is called SMTP even though I have only set up IMAP for receiving. Whilst everything works

2 years ago

billymcgoff

asked in Flow Hosted

When publishing a workspace in FME to track version history a 'Commit' link is enabled as part of the publishing procedure. When I attempt to publish a workpace to I am not presented with this link.

2 years ago

freddy17Contributor

asked in Flow Hosted

Upload Url to Fme Cloud for processing

Good Day Everyone I am trying to create a directory watcher for a NextCloud folder. Once changes are made, run a workspace and publish results back into the NextCloud folder. So I am attempting to first upload the folder to fme server so that I can create a Directory Watcher to look inside the FME Server Resources folder and go from there. I have managed to get the download url from NextCloud, but I am struggling to conceptualise how to upload the url link as a .zip file to the FME Server Resources / temp folders? I have tried using the "FMEServerResourceConnector", but I either get errors, or it uploads only the url text - and not as a zip file. Resources I looked at:upload .zip file to FME Serverfme server playground - upload file in session As this first post is already 5 years old, I was wondering if there easier way of doing this, without me having diving deep into Rest Apis. I have attached my nextcloud workspace.fmw as well. Thank you for your timeCheers Fred

2 years ago

jrprororo

asked in Automation

How does passing params in a POST request to a manually triggered automation actually work?

Hello, I'm trying to set up an automation that runs a workbench that has one parameter that needs to be passed through. I am running this automation from a manual trigger. I have configured a post request that can hit the trigger successfully, however, I am having trouble getting the param value from the request into my automated workbench. I have read all of the documentation and articles on keys that I could find, but as far as I can tell it's not really clear how these values are passed through. I am currently trying to trigger through the server web UI. My manual trigger has a manual key named 'input_id', and I have mapped this to the workbench parmas on the tick branch, that shows 'manual.input_id'. However, when I trigger the workbench with valid JSON containing as below, it does run the workbench, but fails as the param is passed in as '{manual.input_id'} rather than feeding my JSON attribute value in. {"input_id":"1234567890&quot

2 years ago

brady

asked in General

Are there any logs showing what is deleted via a network resource?

I had a share I thought I was removing at a lower level and it emptied the folder. I doubt it but wanted to ask. The tricky thing is, you can 'remove' a resource and it says do you want to delete this item. At the highest level, this removes the resource only. If you go into a folder inside the resource, it will present exactly the same dialog and ask if you want to delete this item. Of course, the inside one's delete delete the items whereas at the highest level under resource will delete the reference to the network space only. A nasty trap for all players :)

2 years ago

lifalin2016Contributor

asked in General

Job routing and Engine assignments in 2022.0 ?

Hi list.I'm trying out the new version 2022.0 of FME Server, and is looking at handling engine assignments.I imported a backup from our normal production server (2020.2), and it created all my queues, and matched these with the engines on the old server (though I had to redo this part due to the wrong naming).But the coupling of jobs and engines is rather different in 2022 from 2020.One thing that puzzles me, is that the restore created some "properties" for each engine, but I cannot find these anywhere in the interface. E.g. properties "22434", "WIN64" and "FME-SERVER003_Engine1" (see picture below).What are the purpose of these properties, and how can you use them ?And how can you delete them, if you don't want them ?Cheers

176

2 years ago

skjalgParticipant

asked in General

ParameterFetcher doesn't handle unicode when workbench is run through a web service

Hi, I'm currently working on a workbench that will be invoked with the fmedatastreaming web service in FME Server. The web service is called with URL parameters, like so:https://my-fme-server/fmedatastreaming/Test_Public/VindfangDEV.fmw?session=5218605431&contact_name=Innmåler&contact_org=Virksomhet&contact_phone=12345678&metadata_soksys=123&files=I+-+Trekkerør+Utført.gmi&debug=true&contact_mobile=12345678If I inspect the parameter values fetched from ParameterFetcher with a Logger transformer inside my workbench, I get encoding errors: However, in both Request Data and earlier in the log file, these values are not only properly URL encoded in the request URL, but also correctly encoded and displayed: And: The encoding problem appears to only occour in the FME engine executing the workbench, but not in the web service nor the admin web interface. Manually encoding the problematic characters prior to calling the fmedatastreaming web service (...&contact_

373

2 years ago

louielou1234Participant

asked in Automation

Email sent already Counter?

Hi There, I have a workbench that sends an email 24 hours after a certain event occurs. However, the email gets sent everytime the workbench runs and I do not want to spam people, so I only want to send ONE email every 24 hours --but I want to be able to run the workbench often (to check for new events and send out email reminders after 24 hours to those people). --How can I check to see if an email has ALREADY been sent out? That way I only send them ONE email per time period (24 hours in this case) even if the workbench runs many times per day? THANKS FOR ANY HELP HERE! Lewis

2 years ago

ldeContributor

asked in General

ESRI license on FME server. What and Where ?

Hello everyone, I have a licensing question and I find the online documentation not so clear on that topic. I need to use an ESRI SDE writer on FME server. It is not clear to me what I need to install on my FME Server to make it work. What Kind of license do I need (ArcGIS pro standard, advanced, ArcGIS server, ...). Do I need to have the heavy client installed on the machine or an ESRI license server is enough ? And where do I need to install it (on the core machine, on each engine,…) ? The FME Server is a 2020.0.0.1 Build 20202 - win64. Thanks for your support.

3333

2 years ago

Page 36 / 93

Badge winners

007winonehas earned the badge English Speaker
nebsy77has earned the badge Welcome Back
zachwrighthas earned the badge Teacher (Grey)
mahmoud_m.talalhas earned the badge Integrate Data with the FME Platform Training
durgaprasadviyyhas earned the badge Welcome Back

Show all badges

30,082: Posts

Terms & Conditions Cookie settings

Sign up

Already have an account? Login

An FME Account is required to contribute

Login to the community

An FME Account is required to contribute

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

A product of

Company Products Giving Back Careers Contact Privacy Feedback

Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.