Creating and organizing workspaces. How to use Workbench.
Recently active
Hi,I'm having 2 lists: _listold (with 10 coordinates present (before)) & _listnew (with 4 coordinates (after).I want to merge those 2 lists into 1 list but it should merge on the index in order except for the last index, last index of first list should be merged with last index of second list. Afterwards I want to explode the list, aggregate and pivot to get something like this: beforeafter00112234567893I've taken a look at the ListMerger and it merges the 2 lists but how I want, but I have no idea how to modify the python logic behind it (python is still Japanese to me :))Anyone an idea how to get this part?
Anyone using ESDAT lab results to automate to iVAULT web GIS?
Within a series of xml files read into a workspace each xml file contains an attribute 'Code' that will contain a single value from a restricted set of values. Within the same xml files, depending upon the Code value will be a series of attributes in which the attribute name of each will be prefixed by the Code value of the feature. So I may have a feature with a Code value of 'Fd_I' and a series of attributes with name like 'Fd_I_Monument Depth', 'Fd_I_Monument Condition', etc. When processing the attributes within these xml files I need to concatenate some of the values from these related attributes base upon the values they contain. I set up an Attribute Creator to create a temp attribute for each of the related attributes, in each case setting up conditional tests that would check for the existence of the related attributes and its value. So for example I would have a check in place like '@Value(Code)_Monument Depth NOT ATTRIBUTE IS MISSING
I saved my workbench yesterday and today I reopened it. The restore workbench window popped up, so I thought something went wrong with saving, I pressed OK. However, my workbench was missing about 90% of the transformers, no connections whatsoever, only a few transformers, bookmarks and inspectors made it through. Is there any way to undo the restore? Or is there any backup location? There's weeks work in this workbench and I absolutely cannot afford to lose it.Thanks in advance,Pim
I am receiving the following error when i try and set up a Dynamic CSV output for my workspace.MULTI_WRITER: Error fetching dynamic schema definitions from reader 'GEODATABASE_FILE_1'My workspace uses a feature reader to read in a GDB, then a spatial relator. The Desired output is a pivoted table 'flagging' which constraints my data intersects with. I can get this initially but i want to do some further transformation and map schema dynamically based on a look up table that will be changing often.
vani.sm@techmahindra.com
Hi all, I am developing a C++ plugin with a new IFMEDevFactory.The "processClause" method of the factory gets an attribute (TEXT_OR_ATTR-type) as an encoded string:@EvaluateExpression(FDIV,STRING,<at>Value<openparen>mypath<closeparen>,MyModule)How do I evaluate this to resolve the real "mypath" value?Thanks in advance!
HiI am having issues separating this field in FME:I would like to have the output in new attributes ie so it gets split up but stays in the row:240L With Pod 180L Residual 1 1 Any ideas?Regards
I've designed a work flow that makes use of a control bench that subsequently uses the FMEServerJobSubmitter within it multiple times. I've set the wait for completion parameter properly everywhere, and fully qualified server URLs are being used so that jobs run synchronously. When I schedule the one control bench three times (each scheduled job processes a different data set) 00:02, 00:03, 00:04 respectively, I would expect each engine to host an iteration of the control bench. However, at any given time, only one to two engines are being utilized while the third sits dormant. Any ideas or suggestions?
I'm reading in a shape file of points and an ECW image. I then create buffers around each point and clip the ECW using those buffers. I then write the clipped rasters out as individual ECW images. I'd like the ECW files to be named using an attribute from the shapefile (e.g. ID). When I set the fanout options and choose the attribute in the writer the transformation fails with the following error:ECW writer: ECW driver does not support creating ECW files with an extension other than .ecwHow can this be done?
I need to create an alias on a couple attributes in my workspace. They do not have aliases when they are read in but they need to have them when they are written to a different layer. I am reading and writing into a Esri Geodatabase (ArcSDE Geodb). I am pretty sure I can do this with the AttributeManager but am unsure how.
It seems I have a misconception on how FME should access external resources like databases and CSV files. We have a default setup meaning the FME services run as Local System. It doesn't appear there is a way to assign permissions at the workspace level. For instance, Workspace1 is run by domain account X, Workspace2 run by domain account Y, etc. Changing the services to run as a domain account wouldn't provide separate Workspace security to file shares and databases.How should we provide access to external resources like a CSV on a network share or a database? Is the standard to copy files to the FME server and use SQL Authentication? Any thoughts would be appreciated.
Hello,I'm creating a workspace where I'm fetching zipped shapefiles from an external http resource. My goal is to run this workspace automatically on a daily basis and I'm looking for a robust solution.I know that the source is auto generated and normally contains approximately 3.000 features, but if it for some reason out of my control only contains 500 features during processing (which indicates malfunction at the creation of my source) I don't want to overwrite the existing destination shape file.So, how can I halt a translation if the number of features is below threshold X?
I have created a custom looper transformer and embedded the saved FMX file. I may be (probably) doing something wrong or missing one key terminator of the looper but if I set the MAX ITERATIONS manually, the results work perfect.For example, I am running a loop that calculates the cumulative effect of the data monthly meaning that I send the results of the sample out as well as loop them back in. Again, I have this part working perfect but I can't stop the machine at the end programmatically. Either skynet is learning or I screwed up.I can set the MAX iterations via a published parameter and it does work as expected, but when I hand this over to a less diligent client I foresee trouble. If they want to run it iteratively for 3 years (of the dataset), they have to manually enter a max iteration count of 36 (it's setup in months right now.) I do have a calculated max column so if I could somehow set this via an attribute, all would be well. Any thoughts? FME 2016.0.1 Build 16174.
Hi all,I created a little test in order to compare the performance of python and FME. For this test I created a CSV-file containing information of 1 000 000 people (ID, SEX). The goal was to count the number of men and women in this list. I created a very basic Workspace with a reader, StatisticsCalculator and Logger in order to answer this question. The Workbench completes in 45 seconds.When I do the same using only pythoncode, the result is print in 2 seconds.Why is there such a big time difference between those two?I know that the startup time of FME has to be taken into account (less than 3 seconds) and the reader converts the input to the FFS-format which will take some time. But I am sure that when I would change the pythoncode so that the features are written to an SQLite database, it wouldn't take 45 seconds to complete.Can someone clarify this for me?Thanks! (the CSV contains only 500 000 in stead of 1 000 000 features since the file was too big)
Hi!We are using FME Server 2015.1.1 and are now facing a problem with the keywords {workspace} and {repository}, in our case these both keywords are missing in our Job submitter success email. Other keywords like {jobsuccess_topic}, {timeStarted} or {timeFinished} are working fine...any ideas?Thomas
Can FME Server be configured to multiple jobs run on a single engine?
I have an attribute creator running to replace missing values with "NA" in a dataset. I noticed however that if the attribute had parenthesis (e.g. "Actual Values (oct-dec)") would replace every value with "NA" regardless of whether it was missing. Removing the "(oct-dec)" from the attribute name, however, returned the desired result. Can anyone else confirm this or had this experience?
Hi all,I'm looking into running a workspace which is located in a read only folder. If I try to run the workbench I get the notification 'Cannot run workspace 'location' from it's current location because the containing folder is ready-only. Try saving to a new location and continue'. The reason why I would want to do this is about policies ofcourse.I've gone through the basic options in FME workbench itself but cannot find anything related to this. I'm wondering if it's even possible?best regards
Hi all,I am trying to use the module matplotlib inside FME itself so I can create histograms and store them on my hard drive. I installed matplotlib in my standard Python 2.7 - 64 bit interpreter (the one that is used when you type 'python' in the command prompt) and I use this interpreter in pycharm (C:\\Python27\\python.exe) where everything works smoothly.Now I would like to use this interpreter inside FME but I cannot get it working. I checked the internet thoroughly and tried already a lot. I didn't try to install matplotlib in the FME python interpreter since I use different versions of FME.I tried using the following dlls:C:\\Windows\\system32\\python27.dll (but this is 32-bit so it shouldn't work I guess...)C:\\Windows\\SysWOW64\\python27.dll (but this generates an error)In order to try to fix the first error, I checked if the correct paths are added to the environment variables (C:\\Python27;C:\\Python27\\Lib) which is the case.I do not understand the second er
Hey All,So i'm running a pretty intensive FME workflow consisting of multiple workspaces, some memory intensive and some which i didn't think were too bad:Workspace 1: clip large dataset A by large dataset B;Workspace 2: take large dataset from postgres rename some attributes and push back into postgres.My problem is...the memory intensive workspace (workspace 1) ran successfully, but the workspace 2 terminate unexpectedly with the following error:WARN |The system is running low on memory. FME is at risk of being terminated by the OS. Please read the FME Help section 'Adjusting Memory Resources' for workarounds.I'm running 64bit FME2015 on a linux box with 32 cores and 64G of ramSo to get the above error is odd. I though 64bit versions of FME managed the memory usage?I though that as FME should be managing the memory...that as the workspaces are run sequentially one after the other, that the possibly the memory intensive workspace may not have released all the memory after it terminat
Would someone be able to recommend the best method to batch geocode addresses using a local geocoder in an FME workspace? Ideally I want to read addresses stored in sql server table, use HTTPCaller to call the service and output returned coordinates plus address and uid to another sql server table. Is it possible to do it this way?
I am trying to send an email using the PythonEmailer.This works fine if I use the smtp.gmail.com server.But I can not get it to work with the smtp.office365.com server TLS and port 587).Has anybody got that working.Any help is appreciated.This is the error message I am getting:Python Exception <SMTPException>: SMTP AUTH extension not supported by server.Error encountered while calling function `email'f_8(PythonFactory): PythonFactory failed to process feature
I have a lot of shapefiles with the classification in the name of the shapefile and not as an attribute. How can I create an attribute containing the name of the shapefile?
I've been asked to see if its possible to maintain values in a coded domain on an ESRI Geodatabase. I would need to insert, update, and delete code/description combination records in the domain. I've found this article: https://knowledge.safe.com/articles/886/working-wi...but it's referring to updating a table that uses a domain, not the actual domain.I know FME can call a python script like this from within FME...arcpy.AddCodedValueToDomain_management(in_workspace="H:/MyDocs/geodbs/inspections/Inspections.gdb",domain_name="Structure_No",code="ABC-123",code_description="STRUCTURE 123")But can FME do it directly?Thanks, Sarah