Creating and organizing workspaces. How to use Workbench.
Recently active
I'm new to fme can anyone explain how to perform batch translation in cmd,on the fly.
I have data in projection defined as 3 degree polynomial transformations to and from EPSG:2172.x' = e0 + y e4 + x e1 + yy e7 + yx e5 + xx e2 + yyy e9 + yyx e8 + yxx e6 + xxx e3y' = d0 + y d4 + x d1 + yy d7 + yx d5 + xx d2 + yyy d9 + yyx d8 + yxx d6 + xxx d3I know this ex and dx coefficients to and from EPSG:2172Is it possible to define such custom projection type in FME Desktop ?
I have .fme file it’s opening in FME Translator but when i am trying to open in FME workbench having problem I need to edit can any one help me how can I edited the same I have uploaded file please help me out
Hi,I have a table which is using numbered attributes such as the following (this is a fictitious simplified example): Id Description LanguageCode0 NotationAlphabet0 NameText0 LanguageCode1 NotationAlphabet1 NameText1 LanguageCode2 NotationAlphabet2 NameText2 1 Park1 FRE Latin Parc Vert DUT Latin Groenpark ENG Latin Green Park 2 Park2 FRE Latin Parc Rouge DUT Latin Roodpark ENG Latin Red ParkIn the above situation each park has 3 names, one for each language (FRE, DUT or ENG)And I need to re-organize it in such a way that it looks like the following: Id Description LanguageCode NotationAlphabet NameText 1 Park1 FRE Latin Parc Vert 1 Park1 DUT Latin Groenpark 1 Park1 ENG Latin Green Park 2 Park2 FRE Latin Parc Rouge 2 Park2 DUT Latin Roodpark 2 Park2 ENG Latin Red ParkI have tried to achieve
Contexte : appel d'un workbench par une commande batch.Question : est-il possible de passer en paramètre la projection souhaitée pour les fichiers de sortie ? Est-il possible d'utiliser un paramètre dans un workbench pour spécifier la projection de sortie ?
Hi, I'm running a modified version of Dmitri Bagh's LAS to DEM template (https://hub.safe.com/templates/las-to-dem), as I am generating hillsides (and other LAS based rasters) from approximately 2700 LAS files. While this works great when feeding one LAS file at a time in, when batching the process using the Batch Deploy wizard, it becomes very inefficient.The workspace by default will load all 2700 potential surrounding LAS files to the tile I'm working on, buffer, select only the data it needs, and then run. When batching it, it will load the 2700 LAS files to memory each iteration. This iterates 2700 times. Not the best method to do this.Is there any way to run this in such a fashion that it only loads the LAS dataset once, then loops through the dataset one LAS tile at a time, and processes that? I've tried modifying this to use the WorkspaceRunner (and take advantage of parallel processing), but everything I've tried runs into it reloading the whole dataset e
Hello. I created a user parameter to select the separator in the CSV reader. I linked the user parameter to the separator field in the CSV reader and it works. But I do not know how to write TAB as a separator into user parameter. I tried \\t, ^I, <control>, <u0009> and so on. Can someone tell me?
Hi,Background: I want to retrieve the File name of several files in a Folder. A have a Workspace that work, but it is way too slow. At the moment I´m using a FeatureReader to fetch a new "path_rootname" or "fme_basename". I´m sure there´s a couple of more clever ways to achieve this. Finding the Folder isn´t an issue, but I don´t know how to fetch the File names in any other way. A got a tip to try use "Published Parameters", without any luck. I have checked Guides from FME, but I can´t get my head around how to use "Published Parameters". Probably just need a gentle push in the right direction.Please see attached Files. How the workspace look today & what it produces:Regards,//Daniel
I have written a script that extracts information from a DB using python. I want this to be a published parameter list. For instance: FeatureType: Bus, Car And when run after 10 minutes it might be: FeatureType: Car, Train Depending on how this database looks like. Is it possible to use a scripted parameter for this. Or use a startup python script tp generate a published parameter? If I am correct the STartup pythonscript gets executed BEFORE the published parameters?
I have created a workbench that loops through an odata/json url using nextlink. I then placed a tester to stop running after the url returns no value. My problem is that this starts over after it runs the full data-set and repeats never stopping. A 700 feature table ran over the weekend had 70,000 and still counting.
I was wondering if it is possible to access the content of a workbenchs log file in a Shutdown Python script on FME Server and email the content.I have a central workbench calling several other workbenches to perform analysis. I want to parse the finished log-file to get warnings, errors and information about features identified and written. The final statement if the run was successful is unfortunately not enough. The parsed data should be send as text in an email.Until now I was testing locally with success, but the same workbench at a 2018 server fails with FME_END_PYTHON failure.import fme import smtplib from email.mime.text import MIMEText from email.mime.multipart import MIMEMultipart from email.utils import COMMASPACE, formatdate def send_email(send_from, send_to, subject, text, server='*****'): '''send email with analysis results''' assert isinstance(send_to, list) outer = MIMEMultipart() outer['From'] = send_from outer['To
I have another newbie question please.I am reading the input data (ID, NAME1, NAME2) in the example below and creating the new attributes FIRST and LAST.The value of the new "FIRST" attribute is set (to NAME1) when reading the first row for a particular ID. However, the new "LAST" attribute is set (to NAME2) when processing the row associated with the last entry of a particular ID.How do I backfill the value of the "LAST" attribute so that is available for the first row of an ID? (I need this in order to satisfy the required output format).I am aware of the look ahead (and behind) feature in AttributeManager/Creator. However the number of rows to look ahead is not known when reading the input data. In the example below it is 2 then 4 but it could be anything between 0 .. 100+.Example:IDNAME1NAME2FIRSTLAST1aAAAGEFAAA1aGEFCX2CX23yXCRBX4XCR3yBX4GXO3yGXOADL3yADLDARDAR
Hi all,I'm trying to troubleshoot a scheduling anomaly which resulted in jobs that were scheduled to run early this morning.What has happened is there are several jobs which have repeated on their own instead of just executing once at the scheduled time and stopping when complete. This resulted in one job notifying (Slack bot and email) that it wrote multiple times(3) to a postgres log table that it updated 1 record, but in fact the record is not duplicated in the table, so the result (the distinct count) ends up being correct after further inspection. However, the notifications that I have set up in the workspaces are not reflecting the output correctly.I suspect what might be happening is that the set(batch) of 23 tasks(workspaces), which perform the same process on 23 tables in a postGIS db are overrunning and interfering with each other. The tables all reside under one schema in the database, and each workspace will read in a master(staging) db and the current production db wit
I have a workspace with a workspace runner. For testing, I used the 'append to logfile' option, but turned it off again later. But in the "child workbench" all entries still get appended to the logfile, even though the 'append'-box in the workbench-options is not checked. How can I get FME to stop appending to the logfile?Thanks, Vera
Hallo! I want to set a global variable in an subtemplate which i can get from another subtemplate, is there any function possible ? Its like a gett- and sett-function.Thanks for answers.
I am using a featureReader and dynamically writing to a writer.The problem is "BuildingExtent" needs to be replaced to "BuildingFootPrint". This is because the featureclasses are differnt for only that featureclass.Any solution to replace them?
Hallo fme-community i hope you can help me again. I working for an template which should generate a OpenDRIVE structure. I take the data of streets from OSM and wanna try to fill some information into my structure. The workflow is like .I have just rly much questions because i have rly hard problems with fme to work as i want (first try with it). My template looks like And in this template i wanna try to change my subtemplate "GEOMETRY" to calculate the length and some other attributes from one note to the next one.The problem is i just give my template the lanes as you can see in the workflow that i give my subtemplate 3 lines. And if i run this i get this as result.My first question is now how can i split this 3 incoming lines up in 3 roads that i get the first 3 nodes in the first road (marked as 1) and the next 4 nodes into the next road (marked as 2) and so on. I tried it with an if sentence but it doesn't works so i deleted it. The split between the roads work but n
I am a beginner FME user having trouble with using a lookup table. I would appreciate your help.I will need to perform two lookups (there are plenty of examples here using a single lookup).The primary dataset has a structure like this:SEQID1ID21FTYCOM2PRDDCYThe lookup table provides a name for each ID:IDNAMECOMCommodoreDCYDiscoveryFTYFtypePRDPradoCORCorollaFALFalconI would like to perform the two lookups for each row of the primary dataset in order to achieve the result:SEQID1NAME1ID2NAME21FTYFtypeCOMCommodore2PRDPradoDCYDiscoveryThe above examples are simplified. Both the primary dataset and the lookup table contain thousands of rows.Any ideas please? [Did I mention I'm a beginner? :) ]
We are looking to review the possibility of using FME for a BIM to asset management to SCADA. Passing meter readings and outages to the model and any related work orders.Allowing to use FME as the front end, consolidating the data from th third party system.Instead of performing these tasks ourselves, we are looking to engage experts to perform this task. The work would expect to be handled remotely
Hi, I made a workspace that creates folders and uploads files on a web API with the HTTP caller. The first version created folders at one level then uploaded files. Then it went on to do the next level and so on. So it was basically a series of HTTPcallers which worked fine on both desktop and Cloud. However since it's impossible to know how many folder levels there are in advance I made it with a custom loop transformer and just one HTTP caller. This worked even better on desktop but trying to run it on FME Cloud it seems it never gets done. Something that takes 8 seconds in desktop isn't ready after half an hour on Cloud.....seems it never will be. I checked the webconnection and I uploaded the custom transformer both to the repository and to the transformers folder. I run the same version of Desktop and Cloud 2018.1.0.1(18528). It initially didn't accept the custom transformer on an earlier Cloud version. Any ideas to what I might want to check or anyone with simila
Hello,I have a workspace in which I take a lot of data from DB using postGIS reader. Then I try to save it to different files based on fanoutExpression like: output\\@Value(myAttribute).gml In DB I have 20 GB of data so at some point I get out of memory exception. My idea was to first use featureReader to read only myAttribute, then use duplicateFilter and then use FeatureReader with where statement: myAttribute = @Value(myAttribute) but result is saved to file only when all data is read so I get the same: "out of memory exception." Is there any way to:First read all unique myAttribute from given table and then close the connection (because connection timeout may be also a problem) next for each of those unique myAttribute values read data from given table and save to separate file one by one? This way I think that I won't have out of memory or connection timeout exceptions. Thanks for any hints on that!
Hi,I have 2 datasets in my workspace and I want to use "PythonCreator" transformer to create a new feature base on those datasets in my workspace but I don't know how to use workspace datasets in "PythonCreator" transformer. Could you help me?
Has anyone done anything using FME to integrate with PlanGrid. I do not have any direct experience with PlanGrid. But, it appears to be a Project Management software suite specific to Construction. Just interested in any use cases.
I am trying to create a server based tool that will read in multiple files and then process them. At the very beginning I want to prompt the user to select the feature types to read. Specifically, I am reading in MicroStation files using the level names. There can be hundreds of level names so in order to reduce the features being read I want the user to select only those level names they want to process. I see that a private parameter is probably the way to do this, but not sure how that would go. What command would I use to open the schema to select the feature types to read. Will it then pause to allow the user to select what they want and then close the dialog box?
Hi, I have a problem with the fmerest/v3/transformations/submit service and I hope someone can help me. I have a very simple worflow set up in my fme-server process. Creator -> FMEServerEmailGenerator -> TextFileWriterI have set up Topic and Subscription as described and configured my FMEServerEmailGenerator with the right topic. Now I can invoke my process over fme-server gui successfully but if I do it via rest, I dont receive an email anymore. From my understanding the email configuration should be done by the transformer in this case, so sending my necessary published parameters should be enougth:{"publishedParameters":[{"name":"uploadMeasures","value":"No"},{"name":"uploadDailyAverages","value":"No"},{"name":"test","value":"Yes"},{"name":"testEmail","value":"foo@bar.com"},{"name":"DestDataset_TEXTLINE","value":"$(FME_SHAREDRESOURCE_DATA)/output.json"}]}But somehow its not. In my results under request data I'm missing notification manager directives sections. So I had to go