Creating and organizing workspaces. How to use Workbench.
Recently active
Hi guys, I'm trying to work out if there is any performance difference between linked vs embedded custom transformers vs Custom Readers I have a workspace which is getting really large and working with Linked Custom transformers and custom formats is much nicer for development and being able to make changes, however, I want to make sure there is no hit to performance. Has anyone looked into this already? Is one faster than the other? Thanks in advance
Hi!If 2 workbenchs run at the same time, each one with a workspacerunner calling the same workspace, is that a problem ? Could it create conflict? If translation failed for one user, does it affect the second user?Thanks!
Firstly I'm fairly new to FME so this might be something so simple but I couldn't find anything. My aim is to read a Geopackage (that may or many not have many layers) and grab a specific layer from that Geopackage that is defined by a user param and write it as a Geopacakage with the associated schema.I started playing with the feature reader and using the Feature Reader with Feature types to read but the output port doesn't change after the first run through.This has to be something simple I'm missing.
Hello thereWe are using change detector in order to update a large data base with million if recordsIs there a wày we could speed up the detection processThanks
I am trying to download a set of GZIPPED log files from Amazon S3The file listing is working but the downloader rejects all files.In my logs I see:-S3Connector_CATCHER (TeeFactory): Cloned 1 input feature(s) into 2 output feature(s)S3Connector_ROUTER (TestFactory): Tested 112 input feature(s) -- 112 feature(s) passed and 0 feature(s) failedS3Connector_OUTPUT Feature Counter -1 6 (TeeFactory): Cloned 112 input feature(s) into 112 output feature(s)S3Connector_INITIATOR Feature Counter -1 2147680258 (TeeFactory): Cloned 1 input feature(s) into 0 output feature(s)S3Connector_<REJECTED> Feature Counter -1 2147745794 (TeeFactory): Cloned 0 input feature(s) into 0 output feature(s)S3Connector_2_CATCHER (TeeFactory): Cloned 112 input feature(s) into 224 output feature(s)S3Connector_2_ROUTER (TestFactory): Tested 112 input feature(s) -- 0 feature(s) passed and 112 feature(s) failed What am I doing wrong here?
I am designing a workflow using workspace runner. My initial design is to have 5 (variable) path location parameters for input and 5 for output. set in the first workspace with a count for any new paths added. those parameters dynamically shared to the second workspace which then does a change detection and creates an updated file list in it's respective output location. Then a 3rd workspace which waits until the first 2 workspaces have run the number of count (path varaible) then uses the file list generated by each run to extract dwg layers to a single fgdb.Can anyone elaborate on the plan to wait for running the 3rd wksp until all lists have completed? or other ideas to make this work? Placing the FeatureHolder after the WorkspaceRunner will my xls writer correctly create?
I have a very simple workspace with just an AttributeCreator transformer, which adds a new attribute called 'MyNewAttr' to my input dataset. But rather than having the attribute name 'MyNewAttr' defined in the transformer, I'd like to do it by Published Parameter.In the AttributeCreator Parameter window, when I try to create a new user parameter from this new attribute, I get the prompt to create a new user parameter. But once I click OK, it does not actually create the user parameter, and my transformer parameter is showing red.The same happens when I use AttributeRenamer or AttributeManager. I simply don't seem to be able to set a attribute name using a user parameter. What am I missing? What am I doing wrong? Is there another way of setting an attribute name using a user parameter?The main reason for asking this question is because I am discovering the power of Custom Transformers, but every time I am struggling with this issue.(I am using FME Desktop v2016.1
how could we extract the attribute definition of all reader in the workspace , the idea is to build a technical document in word or excel, to define all the attributes
Hello, I am using FME Workbench 2019.2, ESRI Reprojector does not support the custom geographic parameters of ArcMap 10.7. I used the 2018 version to see the geographic parameters. Why ca n’t I recognize them after updating?
Hi. I'm trying to write some data into a table which consists of two foreign keys. As you can see on the attached image, I'm reading from two tables, Equipment and WaterMeterPnt. Equipment contains a field BuildingId which I'm going to add to the table WaterMeterPntBuilding. I'm joining the two tables on an common field. The table WaterMeterPntBuilding contains just two fields which is foreign keys. When I try to run this, I get this error when writing:Microsoft SQL Server Non-Spatial Writer: Failed to create Azure table 'dbo.WaterMeterPntBuilding' because no clustered index or primary key was specified.I'm sure that the values exists in the tables and I'm using the existing table, not creating the table each time. Regards,Torbjørn
Hi,I designed a process that contains loop in a loop.I have a problem with iterations. I would like iterations to be numbered continuously and in ascending order. Now the process iterates the loops like this: And I want the algorithm to iterate like this: Outer loop:Inner loop:What do I need to change in the algorithm ??
I have an excel with the definition of the Schema Fme-feature type ( table to create) name ( the attribute to creat )this is only sample data, I used the featured reader to read the empty schema use the list explorer to get the data attached in the excel, how could we create the same schema into the DB Note ( the source has no features )
Hello, I want to add a cus datum transformation. But it is not working.I have created this and saved in the shared folder: DATUM_DEF Pulkovo1942\\DESC_NM "Pulkovo 1942"\\SOURCE "BP"\\ELLIPSOID KRASSOW\\ XFORM_DEF WGS84_Pulkovo1942_Periplus_Test\\DESC_NM "Pulkovo 1942, 7 parameter"\\SRC_DTM WGS84\\TRG_DTM Pulkovo1942\\SOURCE "BP"\\GROUP "PERIPLUS"\\INVERSE Yes\\MAX_ITR 8\\METHOD 7PARAMETER\\DELTA_X -686.10\\DELTA_Y 123.50\\DELTA_Z 574.4\\ROT_X -8.0450\\ROT_Y 23.366\\ROT_Z -10.791\\BWSCALE 2.926\\ COORDINATE_SYSTEM_DEF PULKOV1942_TM\\GROUP "PERIPLUS"\\DESC_NM "Pulkovo1942-PeriPlus"\\SOURCE "BP"\\DT_NAME Pulkovo1942\\PROJ TMAF\\UNIT METER\\PARM1 09\\SCL_RED 1.0\\ORG_LAT 0\\X_OFF 500000\\Y_OFF 0\\ Please, can you help?
Is it possible to find all published workbenches that are using a specific database connection? Nothing is obvious in the UI of FME Server. I've managed to find fme_nc_namedconnections but I've yet to make the jump so i can see connections either in an automation or schedule or details of a workbench. Any help gratefully received......
Hi guys,I recently joined a company and I look after a central system. My system integrates with many other systems to bring in data and host it in this central system.The big issue I found is the way various teams are capturing the data in their specific area and then struggling to deliver the data to my central system.The way they capture the data is through using excel forms or other mechanisms that allow for data entry mistakes. Also, the processes to push into my system is manual from their end.I was hoping to ask on here if you can assist with best practices to help develop and what experiences you had to improve this process:A quick, easy, and sufficient way for data capture to happen by the user who collects the data. Should we look into form entries where it can push into a database or other possibilities? What is the best way to do this?How to monitor data capture and processes (monitoring to see if users have for example submitted data or if they are late). If for example, t
r to Command Line Options.
I have a pythoncaller, that runs the below python, this works OK in FME 2018, but fails in 2020.ERROR |Python Exception <SyntaxError>: invalid syntax (<string>, line 11)FATAL |Factory proxy not initializedI have the python interpreter set to 3.6+So the script works in 2020 if I tag out the last line, so has something changed with the feature.removeAttribute function ? import fmeobjectsdef removeNulls(feature): attrsin = feature.getAttribute('SRC_ATTRS') attrs = attrsin.split(',') for attr in attrs: val = feature.getAttribute(attr) if val == 'VCP' : feature.setAttribute('attname',attr) if val <> 'VCP' : feature.removeAttribute(attr)
Hi list.I need to run the same master-servant workspace setup med two different and non-conflicting sets of data and setup.I tried it yesterday, and first the master workspace complained about it being in use, and even when that's ok, it fails to run the workspacerunner, as the secondary workspace is also in use ?Does this have something to do with the log file being locked, and if so, is there a way to make this work ?My master only spawns workspacerunner once at a time, since I'm not sure parallel processing of the input datasets will work properly. So it's quite well behaved :-)Cheers.
How to access all the fme server apps in one go as a list without loginsHi All,Is there a way to access all the fme server apps without logins in one go as a list, especially the apps that are require authentication feature is disabled? best,Lubna
Hello I've been trying to work with some COVID data from my state in Brazil.Every day the state health department releases a CSV with the data like this where we have a feature for every city and every day with the number from covid( deaths, confirmed cases and recovery cases)I want to create 3 shape file for each situation where the first collum is the city name and all other collumns are the dates, just like these: I was able to do it with AttributeCreator and Exposer but as time goes bye the health department updates the begining of the dates from the CSV( in this example the least date is 23 feb, but now the first day is 04 jan).I know i can use the exposer with all the days of the year but i was trying to create only the necessary collumns of date.I saw this post (https://knowledge.safe.com/questions/21304/get-the-attributes-names-with-python.html) but how can i use this to create the correct "schema" for my shapefiles??
I have a workspace that has 6 published parameters,When I publish this workspace to FME Server the DestDataset_ACAD parameter is missing The parameter is available when I publish a webhook and the webhook runs successfully but the file return from FME Server is named like this.When I change the file extension this file opens in AutoCAD. I have tried to create a parameter and then link to the writer this also goes missing when I publish to FME Server. Is there a setting I am not seeing somewhere? I am using REAL_DWG writer.
I want to add <Name> together which can be opened and closed in Excel (visual compress), so i can see the different attributes for the same <Name> when opening the label. Does anyone know how we can use this in Excel? In the attachment is an example of how the <Name> value should look like.
Hi guys, I've been trying to reduce the number of hit's I need to make to a database by building an IN statement and get it all in one go. So far I've been pretty successful - my wait time from the database has been significantly improved! My process has been to use an Aggregator to collect the Id's into groups of 1000 (limit of features in an in request) - the GroupCounter has been really helpful for creating an ordered attribute to group by. Now I'm at the point where this Aggregation process is taking quite a bit of time (seconds) because FME is splitting the features tables. I'm trying to figure out a way to build a comma separated list from an column without breaking the feature tables. Anyone been able to do this or can think of a way that this might work? CheersMatt
I can group and count attribute values from a table using sqlcreatorselect a.CaseFullRef, count(a.casefullref) as count2from bcapr as ainner join bcinsac as b on a.SystemKey = b.systemkeygroup by a.CaseFullReforder by a.casefullrefThis gives me the required outputBut I need to compare this table with a csv fileI want to group and count the values in the csv file in the same way as the table . How do I group and count the attribute values in the csvfile ? I tried using counter but it just adds a count to each incident of the value .how do I add group by to the counter?
Hi! I'm trying to have FME to output an excelfile and use an attribute as it's filename. Can't get it to work! In the parameters settings for the writer I enter the folder in the "Destination Fanout Directory" and as the Fanout Expression i enter:@Value(ATTRIBUTE THAT I WANT TO USE HERE).xlsxThis gives me one ".xlsx", that does not open, and one file with the correct filename but without a file ending (xlsx). Anyone who can point me in the right direction?Using fme desktop 2020. UPDATE:The error was my own fault. The attribute value contained a : (colon) which a filename can not include. Sort this out and the filename get produced as expected.