Creating and organizing workspaces. How to use Workbench.
Recently active
I am failing to get Workspace Runner working.I have over a thousand MapInfo tables that I want to process. (I am only trying three tables right now)Each table has a single record (a point object).My workspace runner is set up with;Directory and File Pathnames Reader(path filter *.tab)Workspace Runner(Wait for job to complete = YesSource MapInfo tab files = path_windows)But it only processes the first table, although the transformer reports three successesThe workspace that does the work names the output file according to an attribute column, which is different for each table, so it should know to give the three outputs three different names
Hi Related to this earlier question https://knowledge.safe.com/questions/4957/python-startup-script-to-terminate-workspace.html I want to cleanly terminate the creation of a Private Scripted Python Parameter. Throwing an exception pollutes the log with the script from the exception and confuses the user (and author sometimes!)Then discovered the sys.exit() function and this gives me a better result:import sysval = FME_MacroValues['INPUT_TEST']if val == 'Fail': print 'You chose {} \nProgram Terminating\nTranslation FAILED.'.format(val) sys.exit(0)else: return 'all ok'Could do with a sanity check from resident Python Jedi that have any comments or any detrimental issues for use with FME?*Note only tested on FME Desktop NOT Server!
So i have 2 different fmws to run. One I need to run with FME 2016 32bit. The other needs to run on FME 2016 64bit. I'd like to create one parrent fmw that will run these two fmws with each separate workspace runner in series. Can I do that? Or should i use SystemCaller and send a proper command for each workspace.
Hello everyone.I am currently working on FME scripts with different fatal cases. So in one FME script, for each fatal case, there is a terminator (sometimes I have like 3 terminators in the same script). Those terminators all have a different termination message.All of my FME command lines are gathered in a batch file, and I also extract the error level (%errorlevel%).I initially thought that when running the batch file, I would be able to extract the different error codes that I set up in the terminators. Instead, I only get code 0 (success) or code -1 (failure).Is it possible to extract the codes I defined from FME Workbench ?I have seen several solutions like sending the code into an email, or using python, but I have to use a batch file to run all my FME command lines. Therefore, I am looking for a solution that would allow me to get the error code after the FME script terminated, in the batch file. Moreover, I once got error code -1073741510, but I have no idea what it means, an
My current workspace has a prompt for the user to specify a folder that will be copied and uploaded to a few different places. One thing I would also like it to do is copy a .kml file inside this folder to another location. Every time the workspace will be run the user will be selecting a different folder but the .kml inside each folder will be going to the same spot as every other .kml. Here is my current filecopy writer where $(job_folder) is the user specified folder. I try to set the source dataset as the user parameter but to only "filter" through any .kml's inside: Is this possible? Thanks!
Hi,I'm using the FeatureWriter to export a bunch of data from an SDE FeatureReader to a shapefile format. While most shapefiles are getting created with no problems, there are a few where the attribute table cannot be read using either ArcMap or ArcCatalog. The ones that cannot be read seem to be the ones where I am using a Tester transformer to select only certain features for export.The image below shows the 3 layers that are having the problems. Other layers also use a Tester, but they also use other Transformers as well.The three that are having the issue are the only ones where there is just one Tester transformer in the 'chain'.Spatially, all the data is there, but it's just the attribute table that cannot be read. This is the error I get in ArcCatalog.
Hello, I think I've found a little bug.Here my version : FME(R) 2019.1.2.0 (20190829 - Build 19630 - WIN64) I'm using a FeatureWriter to write features in a PostgreSQL DB.Here my parameters : In the Attribute tabs, I set the definition to Automatic so the structure is created from datas comming into the FeatureWriter : Now the bug :As I said, I've plugged datas into the FeatureWriter and set the Attribute Definition on Automatic and "voila", my structures are automatically defined.Now, I add an attribute on a feature type that goes into the FeatureWriter (with an AttributeCreator for exemple).The FeatureWriter doesn't add automatically this new Attribute in the definition of the table that is written in the DB.I have to edit the FeatureWriter parameters so the Attribute definition is automatically updated to get the new attribute (in fact I've just had to click on the button to open the dialog box and then click on "OK" to close it) .The attribut
I am working on a project for a client where i need to handover workspaces that contain multiple feature readers all with multiple outputs in quite a complex workspace. This is fine as the database location is set in a workspace runner outside of these workspaces. However if the client needs to open the workspace to make any edits, i've found since the 2020 update, if you open a workspace and the FeatureReader cant locate the data source it just drops all output ports into a generic port essentially breaking it. Has anyone else found this or can think of a way to stop this from happening?Additionally since the 2020 update i have found that when you select datasets to read in to a FeatureReader via the 'tick' box selection that it is not keeping the ones already selected and removes them and adds the new selected ones only. My workaround has to actually type the feature type name into the text editor to get it to add an additional feature type.
Hi,When I first created my workbench, the FeatureWriter seemed to create all my shapefiles properly. Featres were coming from an SDE GeoDB through a FeatureReader, and then after some manipulation, exported though the FeaureWriter with no problems.Now when I go to take an existing feature that is already in the FeatureReader, and export a different shapefile through the existing FeatureWriter, all of the attributes end up being CHAR 200. I'm not sure why this is happening.Here is a screen shot of an existing shapefile in the FeatureWriter, where the attributes are correct. If I take the same source feature, and add it to the FeatureWriter and just give it a new export name, the attributes are all messed up. Any ideas are appreciated. Thanks
I am looking for a type of loop or other solution where I can update my input data and perform an analysis. The output will effect the input data and so on. A kind of loop. Is that possible to create in FME? My workbench until now is attached to this post.Currently I am working with a large tabel. The input data looks like the figure shown below:Portal_IDVTG_VWHVan-naar11000.005-60113000.003-40012000.005-60533000.002-20233500.003-40144000.005-60144500.002-202My first step was to use the Aggregator and set GroupBy to Portal_ID. VTG_VWH values are combined using 'sum'. 'Van-naar' is used for the Count attribute. The output:Portal_IDVTG_VWHCount_Van-naar16000.00336500.00248500.002My next step was to extract the row with highest value for VTG_VWH (Portal_ID =4). That needs to be my first output, one row with Portal_ID 4 (Result 1).---------------------------------------------------------------------------------------------------------------------------------------------Next
Hi - I am experiencing a strange error when attempting to update the same table twice which I have narrowed down to be a connection lock or something similar. This is a part of my workbench which updates a timestamps table in SQL Server. Incoming to each of these executes effectively at the same time.If I disable either one - I am able to update the table with no issues so I have isolated any configuration of the writers.I have increased timeouts etc. and no luck. Doesn't look to be related to this. These queries only take a sec or so to run but looks like a connection locking issue. I am running SQL Server 2019.Any ideas what could be causing this? Both of the FeatureWriters using the same connection - SQL Server Non-Spatial Writer.ThanksError - 2020-06-08 19:58:07| 2.6| 0.0|INFORM|Microsoft SQL Server Non-Spatial Writer: Trying to connect using Microsoft OLE DB Driver for SQL Server...2020-06-08 19:58:37| 2.7| 0.0|WARN |Microsoft SQL Server Non-Spatial Writer: Failed to write a fe
Hi, I have a coordinated call list, with the values below. My problem is this list: I never know the number of elements that can come into it. How can you create a dynamic method of reading this list and already create attributes, such as: latitude1, longitude1, latitude2, longitude2, latitude3, longitude3 .... "coordinate" : {["latitude" : "-23.2229628000","longitude" : "-35.9099781000","latitude" : "-33.2229628000","longitude" : "-25.9099781000","latitude" : "-33.2229628000","longitude" : "-15.9099781000","latitude" : "-33.2229628000","longitude" : "-25.9099781000"]} Thank´s
I have vector polygon files with LOTS of individual cells. Each cell has an allotted weight value, but I would like to group contiguous polygons so that the sum of their combined weights is as close to a target value as possible (simplified example below). I feel that this likely exists and I just haven't found the correct keyword to find it. TIA
Hello.I'm working on FME workbench 2014. I stumbled upon an issue when creating a writer. It seems like I can't put in a name of an user attribute that has more than 10 characters. If I put in a longer name, FME automatically reduces it to 10. Is there a way to fix this?Regards,Bjorn M
Good Morning All, I'm running FME desktop 2015 and have created 10 custom transformers (10 Canvas that i chain together in the main canvas). How do i reorder the canvas or tabs of the work bench . Currently my workbench tab/canvas order Start/Main/CustomerTransformer3/CustomTranformer2/CustomTranformer7 i want it like Start/Main/CustomerTransformer1/CustomTranformer2/CustomTranformer3 etc. Am i missing something simple ? Thanks Steve
Hello, We OCRd an invoice and we want to split it into attributes for further analysis.The input is: Overzicht mobiele bundels Bundel Verbruik / Beschikbaar Eenheid 0498/00.00.00 Mobile Bis Pack 10 / 10000 Minutes Mobile Bis Pack 45 / 2048 Mega Bytes 0498/00.00.01 Mobile Bis Pack 64 / 10000 Minutes Mobile Bis Pack 25 I 10000 SMS Mobile Bis Pack 892 I 2048 Mega Bytes 0498/00.00.02 Mobile Bis Pack 81 I 10000 Minutes Mobile Bis Pack 32 I 10000 SMS Mobile Bis Pack 577 I 2048 Mega Bytes 0498/00.00.03 Mobile Bis Pack 38 / 10000 Minutes Mobile Bis Pack 53 / 10000 SMS Mobile Bis Pack 276 / 2048 Mega Bytes What I try to achieve (first) then I can split them up further myself Overzicht mobiele bundels Bundel Verbruik / Beschikbaar Eenheid 0498/00.00.00 Mobile Bis Pack 10 / 10000 Minutes 0498/00.00.00 Mobile Bis Pack 45 / 2048 Mega Bytes 0498/00.00.01 Mobile Bis Pack 64 / 10000 Minutes 0498/00.00.01 Mobile Bis Pack 25 I 10000 SMS 0498/00.00.01 Mobile Bis Pack 892 I 2048 Mega Bytes 0498/00.00.02
Hi! I have this project in which there are three shp readers (Feature Merger Requestors) and one excel reader (as Feature Merger Supplier). In this excel there is an attribute in string format, that I want to have it as boolean/logical format on the shp writer. If I specify in the writer the format as "logical", it doesn't transform it, it keeps it as string (or integer, I have tried too). Is there any way to get it? Thanks!Writer Attributes:Result:
I used the sentinel hub dashboard to create a WCS-link. This link works fine in Qgis, however in FME I can not get it to work.I am using FME 2020.0.0.1 When I use the feature reader I can select the coverage (raster band) in the parameters setting, but all other settings I try return an error: Failed to retrieve feature types.<WCS> An error has occured while processing the WCS DescribeCoverage document: 'supportedInterpolations' When I try to run the workbench I get the following error: <WCS> An error has occured while processing the WCS DescribeCoverage document: 'supportedInterpolations' Does anybody know how I can fix this?
I am trying to change the name of features being read in and dynamically write them out. I have been looking to replicate https://knowledge.safe.com/questions/77663/rename-featureclass-coming-out-of-feature-reader.html but unfortunately it isnt working for me. Any suggestions for where i am going wrong, below is where i am switching the fme_feature_type to the new name. Thank you very much in advance.
So I have two database connections in Tools | FME Options | Database Connections.One connection connects to our TEST database, the other to our PRODUCTION database.I am wanting to setup a published parameter so that the user is prompted for it, then they can select either of the two connection files, when they run the workbench. I cannot work out how to create a parameter and reference the database connections. Is this possible?
I have many delimited text files of data for each county and one small delimited file with the column headings. The closest I have found to addressing this is this article https://knowledge.safe.com/questions/4831/attribute-header-mapping.html . However this does not seem to work, I also would think there is an easier way I am missing.
Hi,When you run an FME Server workspace, you can specify a Job Queue. Is it not possible to specify a Job Queue when running the job via the Job Submitter/Data Streaming/etc. URL? Thanks.
Hi.I am trying to run a fme workspace using python 3.7, but I always get: AttributeError: module 'fmeobjects' has no attribute 'FMEWorkspaceRunner' . In the script I added dir(fmeobjects) and I get:['__doc__', '__file__', '__loader__', '__name__', '__package__', '__path__', '__spec__'] I have read several treads in the forum but I cannot found any reason why I don't get all the attributes in fmeobjects. Neither how to solve it. Is my script incomplete? Is there a bug somewhere? Any suggestions? My python compiler is Anaconda => Spyder (Python 3.7) My script is:import sys sys.path.append(r"C:\\Program Files\\FME\\fmeobjects\\python37") import fmeobjects print(dir(fmeobjects)) workspace = r"C:\\Users\\Fredr\\OneDrive\\Documents\\FME\\Workspaces\\Delay.fmw" runner = fmeobjects.FMEWorkspaceRunner.run(workspace)
In my FME 2020.0.0.1 workspace I have a separate (external/exported) custom transformer with a loop and it contains a blocking transformer:When I execute my workspace I would expect the Data Inspector window to show up in the end with one result from the workspace and around three results from the custom transformer. I only get the result from the inspector in the workspace.I do however see 1 + 3 FFS files in my C:\\Users\\me\\AppData\\Local\\Temp\\wb-inspectors-pMivws folder which I can drag into the Data Inspector window and evaluate (though the three loop inspector results are shown as one combined entry).Why am I only seeing the results from the workspace and not those from within the custom transformer?
I am trying to get two feature types at a time. I am not getting any errors, rather the translation is successful but not getting any output table. Also, I am not getting the "Translation Parameter Values" where I can mention both the user parameter. By clicking Run, it is just directly Running the workspace. @markatsafe @nampreetatsafe