Creating and organizing workspaces. How to use Workbench.
Recently active
I am trying to string together some workspaces to create output from several drives and I think i need to keep the output separate in order to be able to process the latest files from each output. First i am trying to keep the input and output as pairs and thought i need to have parameters in a workspace and call a workspace runner to feed those parameters into. But now i don't see how to do that. Now it looks like i need to have a parameter file and have all of the input. Right now i have the following parameters I1 needs to be run with O1 I=input, O=output. I also need to have specific layers queried when I1 is run. that is an attribute named L1.someone please help.
Hi,I need to design the following process:1. I move the object to a specific point (x, y)2. I check if it fits in another training ground3. generate another object with offset (dx) I repeat steps until dx <1.01 I did it like this: When I created the loops I got a message So I click YES and create custom transformer: But when I start the process I don't get the result from the loop... Does anyone know the easier way? or knows what I have to change?
Hello,I am working on writing large amounts of data to ArcGIS portal and due to these data sizes I am getting 502 Server Error: Bad Gateway errors or the token expires before all the data is uploaded.I have created a workflow that works OK, but isn't perfect, which I'll describe below, but I'm wondering where anyone would have other recommendations.So the first thing I do is empty a feature service on ArcGIS Portal of any existing data to give an empty data structure to upload new data into. I do this using a Feature Writer with Writer Mode set to DELETE. An alternative would be to use the truncate first option.Once the deletion has completed I use a Feature Reader to read in all the new data I want to upload. This data's schema matches that of the dataset on the Portal.To avoid the Bad Gateway and Token errors I divide the data into more manageable volumes and use a workspace runner to batch process the uploading of these into ArcGIS Portal. To do this I add a Counter
Hi, I have several feature classes and I'd like to dissolve them one by one, they all have different attribute fields, I only know which fields to exclude. And because there's no tolerance in LineCombiner, I hope to use Arcpy to do the dissolve processing like @daveatsafe demonstrated in the link below:https://knowledge.safe.com/articles/47216/using-arcpy-for-fme-feature-processing.htmlIs it possible to make this happen?
Hi guys, I'm trying to work out if there is any performance difference between linked vs embedded custom transformers vs Custom Readers I have a workspace which is getting really large and working with Linked Custom transformers and custom formats is much nicer for development and being able to make changes, however, I want to make sure there is no hit to performance. Has anyone looked into this already? Is one faster than the other? Thanks in advance
Hi!If 2 workbenchs run at the same time, each one with a workspacerunner calling the same workspace, is that a problem ? Could it create conflict? If translation failed for one user, does it affect the second user?Thanks!
Firstly I'm fairly new to FME so this might be something so simple but I couldn't find anything. My aim is to read a Geopackage (that may or many not have many layers) and grab a specific layer from that Geopackage that is defined by a user param and write it as a Geopacakage with the associated schema.I started playing with the feature reader and using the Feature Reader with Feature types to read but the output port doesn't change after the first run through.This has to be something simple I'm missing.
Hello thereWe are using change detector in order to update a large data base with million if recordsIs there a wày we could speed up the detection processThanks
I am trying to download a set of GZIPPED log files from Amazon S3The file listing is working but the downloader rejects all files.In my logs I see:-S3Connector_CATCHER (TeeFactory): Cloned 1 input feature(s) into 2 output feature(s)S3Connector_ROUTER (TestFactory): Tested 112 input feature(s) -- 112 feature(s) passed and 0 feature(s) failedS3Connector_OUTPUT Feature Counter -1 6 (TeeFactory): Cloned 112 input feature(s) into 112 output feature(s)S3Connector_INITIATOR Feature Counter -1 2147680258 (TeeFactory): Cloned 1 input feature(s) into 0 output feature(s)S3Connector_<REJECTED> Feature Counter -1 2147745794 (TeeFactory): Cloned 0 input feature(s) into 0 output feature(s)S3Connector_2_CATCHER (TeeFactory): Cloned 112 input feature(s) into 224 output feature(s)S3Connector_2_ROUTER (TestFactory): Tested 112 input feature(s) -- 0 feature(s) passed and 112 feature(s) failed What am I doing wrong here?
I am designing a workflow using workspace runner. My initial design is to have 5 (variable) path location parameters for input and 5 for output. set in the first workspace with a count for any new paths added. those parameters dynamically shared to the second workspace which then does a change detection and creates an updated file list in it's respective output location. Then a 3rd workspace which waits until the first 2 workspaces have run the number of count (path varaible) then uses the file list generated by each run to extract dwg layers to a single fgdb.Can anyone elaborate on the plan to wait for running the 3rd wksp until all lists have completed? or other ideas to make this work? Placing the FeatureHolder after the WorkspaceRunner will my xls writer correctly create?
I have a very simple workspace with just an AttributeCreator transformer, which adds a new attribute called 'MyNewAttr' to my input dataset. But rather than having the attribute name 'MyNewAttr' defined in the transformer, I'd like to do it by Published Parameter.In the AttributeCreator Parameter window, when I try to create a new user parameter from this new attribute, I get the prompt to create a new user parameter. But once I click OK, it does not actually create the user parameter, and my transformer parameter is showing red.The same happens when I use AttributeRenamer or AttributeManager. I simply don't seem to be able to set a attribute name using a user parameter. What am I missing? What am I doing wrong? Is there another way of setting an attribute name using a user parameter?The main reason for asking this question is because I am discovering the power of Custom Transformers, but every time I am struggling with this issue.(I am using FME Desktop v2016.1
how could we extract the attribute definition of all reader in the workspace , the idea is to build a technical document in word or excel, to define all the attributes
Hello, I am using FME Workbench 2019.2, ESRI Reprojector does not support the custom geographic parameters of ArcMap 10.7. I used the 2018 version to see the geographic parameters. Why ca n’t I recognize them after updating?
Hi. I'm trying to write some data into a table which consists of two foreign keys. As you can see on the attached image, I'm reading from two tables, Equipment and WaterMeterPnt. Equipment contains a field BuildingId which I'm going to add to the table WaterMeterPntBuilding. I'm joining the two tables on an common field. The table WaterMeterPntBuilding contains just two fields which is foreign keys. When I try to run this, I get this error when writing:Microsoft SQL Server Non-Spatial Writer: Failed to create Azure table 'dbo.WaterMeterPntBuilding' because no clustered index or primary key was specified.I'm sure that the values exists in the tables and I'm using the existing table, not creating the table each time. Regards,Torbjørn
Hi,I designed a process that contains loop in a loop.I have a problem with iterations. I would like iterations to be numbered continuously and in ascending order. Now the process iterates the loops like this: And I want the algorithm to iterate like this: Outer loop:Inner loop:What do I need to change in the algorithm ??
I have an excel with the definition of the Schema Fme-feature type ( table to create) name ( the attribute to creat )this is only sample data, I used the featured reader to read the empty schema use the list explorer to get the data attached in the excel, how could we create the same schema into the DB Note ( the source has no features )
Hello, I want to add a cus datum transformation. But it is not working.I have created this and saved in the shared folder: DATUM_DEF Pulkovo1942\\DESC_NM "Pulkovo 1942"\\SOURCE "BP"\\ELLIPSOID KRASSOW\\ XFORM_DEF WGS84_Pulkovo1942_Periplus_Test\\DESC_NM "Pulkovo 1942, 7 parameter"\\SRC_DTM WGS84\\TRG_DTM Pulkovo1942\\SOURCE "BP"\\GROUP "PERIPLUS"\\INVERSE Yes\\MAX_ITR 8\\METHOD 7PARAMETER\\DELTA_X -686.10\\DELTA_Y 123.50\\DELTA_Z 574.4\\ROT_X -8.0450\\ROT_Y 23.366\\ROT_Z -10.791\\BWSCALE 2.926\\ COORDINATE_SYSTEM_DEF PULKOV1942_TM\\GROUP "PERIPLUS"\\DESC_NM "Pulkovo1942-PeriPlus"\\SOURCE "BP"\\DT_NAME Pulkovo1942\\PROJ TMAF\\UNIT METER\\PARM1 09\\SCL_RED 1.0\\ORG_LAT 0\\X_OFF 500000\\Y_OFF 0\\ Please, can you help?
Is it possible to find all published workbenches that are using a specific database connection? Nothing is obvious in the UI of FME Server. I've managed to find fme_nc_namedconnections but I've yet to make the jump so i can see connections either in an automation or schedule or details of a workbench. Any help gratefully received......
Hi guys,I recently joined a company and I look after a central system. My system integrates with many other systems to bring in data and host it in this central system.The big issue I found is the way various teams are capturing the data in their specific area and then struggling to deliver the data to my central system.The way they capture the data is through using excel forms or other mechanisms that allow for data entry mistakes. Also, the processes to push into my system is manual from their end.I was hoping to ask on here if you can assist with best practices to help develop and what experiences you had to improve this process:A quick, easy, and sufficient way for data capture to happen by the user who collects the data. Should we look into form entries where it can push into a database or other possibilities? What is the best way to do this?How to monitor data capture and processes (monitoring to see if users have for example submitted data or if they are late). If for example, t
r to Command Line Options.
I have a pythoncaller, that runs the below python, this works OK in FME 2018, but fails in 2020.ERROR |Python Exception <SyntaxError>: invalid syntax (<string>, line 11)FATAL |Factory proxy not initializedI have the python interpreter set to 3.6+So the script works in 2020 if I tag out the last line, so has something changed with the feature.removeAttribute function ? import fmeobjectsdef removeNulls(feature): attrsin = feature.getAttribute('SRC_ATTRS') attrs = attrsin.split(',') for attr in attrs: val = feature.getAttribute(attr) if val == 'VCP' : feature.setAttribute('attname',attr) if val <> 'VCP' : feature.removeAttribute(attr)
Hi list.I need to run the same master-servant workspace setup med two different and non-conflicting sets of data and setup.I tried it yesterday, and first the master workspace complained about it being in use, and even when that's ok, it fails to run the workspacerunner, as the secondary workspace is also in use ?Does this have something to do with the log file being locked, and if so, is there a way to make this work ?My master only spawns workspacerunner once at a time, since I'm not sure parallel processing of the input datasets will work properly. So it's quite well behaved :-)Cheers.
How to access all the fme server apps in one go as a list without loginsHi All,Is there a way to access all the fme server apps without logins in one go as a list, especially the apps that are require authentication feature is disabled? best,Lubna
Hello I've been trying to work with some COVID data from my state in Brazil.Every day the state health department releases a CSV with the data like this where we have a feature for every city and every day with the number from covid( deaths, confirmed cases and recovery cases)I want to create 3 shape file for each situation where the first collum is the city name and all other collumns are the dates, just like these: I was able to do it with AttributeCreator and Exposer but as time goes bye the health department updates the begining of the dates from the CSV( in this example the least date is 23 feb, but now the first day is 04 jan).I know i can use the exposer with all the days of the year but i was trying to create only the necessary collumns of date.I saw this post (https://knowledge.safe.com/questions/21304/get-the-attributes-names-with-python.html) but how can i use this to create the correct "schema" for my shapefiles??
I have a workspace that has 6 published parameters,When I publish this workspace to FME Server the DestDataset_ACAD parameter is missing The parameter is available when I publish a webhook and the webhook runs successfully but the file return from FME Server is named like this.When I change the file extension this file opens in AutoCAD. I have tried to create a parameter and then link to the writer this also goes missing when I publish to FME Server. Is there a setting I am not seeing somewhere? I am using REAL_DWG writer.