Creating and organizing workspaces. How to use Workbench.
Recently active
I'm currently trying to create a script to run a workspace, and test the output against an expected result. However, although I can successful import fmeobjects, it seems to have no attributes?console example: in a script:AttributeError: module 'fmeobjects' has no attribute 'FMEWorkspaceRunner' I'm using fme 2018.1Any ideas?
I have a workspace that uses a feature reader to read just one table from a geodatabase. I need to batch run this workspace for every feature type in the geodatabase.I created a new workspace with a schema reader and a workspace runner to run the original workspace, with the feature type populated from the fme_feature_type_name from the schema reader. The feature reader in the child workspace fails. If I hard code the feature type in the published parameter in the workspace runner in the parent workspace, the feature reader in the child workspace runs. But as I need to batch run this doesn't solve my problem.I've made a pair of sample workspaces that replicate this issue with an Excel Spreadsheet. They're here: Is there any way to do a batch run with a feature type as a parameter that can be varied to cover the whole schema?
I am looking to make lists based off of attributes that have i currently have. For example (photo below), I am looking to build a list between Field1 and Field2.For example in the first row _list{0} = 40, _list{1} = 41, _list{2} = 42, ... _list{10} = 50.
Hello All,I have an excel file wherein i have two header rows, first one with a main heading like 2019 and the second one below it having sub-categories like Furniture, Music, Fun and then the data from third row. Is there a way to write the data to an excel file in the same manner of first row showing the merged cell and the second row showing all showing all separate values?Thanks
FME Server 2017.0 Does anyone have insight on what permissions are required for the FMEServerJobWaiter to work? I have tested with other admin level users and there are no issues using this transformer. FMEServerJobWaiter(ServerFactory): <servername> - Waiting for job #384798 to start; polling every 10 second(s)...FMEServerJobWaiter(ServerFactory): <servername> - Failed to wait for job #384798FMEServerJobWaiter(ServerFactory): Reason - user '<username>' is not authorized to perform this action
Hi all, I have an issue in new FME. I'm trying to set up User Published Parameter that will give user list of attributes available in workbench. But after choosing a Type: Attribute Name it doesn't see any attributes available. As my input I use shp files. Is it a bug or I didn't do it properly? Regards
I need to make an export of my data with a format like this: I want the output to be in seperate files (fanout) based on a single row value per group I grouped the data by groups, so each group has unique attributes. How I can fanout and get the filename to be a single row attribute? ('bestandsnaam'), so in this case '504.pfrl'
Hi guys, i would like to split attribute value into 2 substrings separated by comma delimeter. I am unable to split it with string replacer or attribute creator.Type of data:What i tried:@Substring(@Value(NASLOV),0,@FindString(@Value(NASLOV),",")) andAny suggestions? thanks in advance, Bye Miha
I ran a rather lengthy fmw using feature caching...open in one window.I opened another fmw and decided I didn't need feature caching for that fmw so i disabled feature caching and ran my workspace.When I returned to my completed fmw window the caching indicators were removed since no caching data existed anymore.I think this is an obvious issue. Running or not running with Feature Caching enabled should not be globally reflected just workspace specific. Either that or a previously run fmw should not be altered.Anyone else experience this?Thanks,PeteP.S. About details:FME InformationEdition: FME Database Edition (node locked-crc) Version: FME(R) 2019.1.0.0 (20190704 - Build 19604 - WIN64) Locale: en_US Codepage: 1252 (ANSI - Latin I) Registration Key: 1-542-353-546 Serial Number: 0 Customer Number: Home Folder: C:\\Program Files\\FME\\Beta\\ Operating System: Microsoft Windows 10 64-bit (Build 17763)
I've got an excel spreadsheet of data with a primary key column, a foreign key column, then various other columns that may or may not contain data. I'm trying to create a single attribute that lists all of the columns/attributes that do not contain data for a given PK/FK combination (i.e., are null/empty/missing).PKFKAttribute1Attribute2Attribute31A DATADATA2ADATA 3BDATA DATA4BDATADATADATA So the output would look like this...PKFKList_of_null_attributes1AAttribute12AAttribute2, Attribute33BAttribute24B Any ideas? I can't seem to wrap my head around this. My first thought was to attribute all null/missing/empty attribute values with a unique identifier, then replace all real data values with an empty field so that I can drop those attributes with a ListConcatenator.Right now my workflow for that includes a NullAttributeMapper to replace null/missing/empty values with a specific unique character (lets say "X"), a stringreplacer & regex to replace all data valu
Using FME Server and Desktop 2016.1 I created a workspace calling a job on FME Server using the FMEServerJobSubmitter transformer.The "Wait for server job to complete" is set to "Yes".If the job succeeds I use the _job_id to get the log file and email using the file as attachment.If the job fails (it generated a log file containing an error) I do not get the _job_id attribute (see image).How can I retrieve the log file from the server if the job fails, but produces a log file?This log file is even more urgent than the succeeded job's log file.
Is this expected behaviour?I am extracting a 32 bit real value of "7.35" using python using feature.getAttribute in 2018.1/2019.1 (and probably every other one). It is returning 7.349999904632568 as a 64 Bit Real . I get that this calculating using 64 bit, so that's where it is coming from, but interested that it is performing that calc on an existing known number.The workaround was to use feature.getAttributeAsType(<attribute>, 11) to treat as a stringExample attached
Hi all, Context: I have a workbench that is aggregating and compiling data from 13 different SDEs. The datasets are managed slightly different source-by-source. I determine adds, updates and deletes via a CRC comparison, but there are feature classes (not all, some) that are participating in editor tracking. There are two different possibilities for the pertinent editor tracking field: MODIFY_DATE and last_edited_date. Sometimes, both of these fields exist in a feature class, with one being associated to esri's editor tracking. Objective: I want to use the arcpy method, describe, to pull the editor tracking field name. Based on that result, I want to filter features on 1) if they have editor tracking enabled, then 2) between MODIFY_DATE and last_edited_date. Method: I have a private parameter python (named editorTracking) script as follows:import fmeimport fmeobjectsimport arcpydef processFeature(feature): desc = arcpy.Describe(feature.getAttribute(pathway)) if desc.editorTrackin
Hello,I'm trying to find an elegant solution for a feature merge based on the same list, twice.So, data is a shapefile with polygons as features. Each polygon have a _class{}.ID list. The goal is to compare each _class{n}.ID to other polygons (not itself) _class{n}.ID (nmax is different for each polygon), to finally agglomerate their geometry.Issue is that ListBasedFeatureMerger takes attributes as supplier key and not lists.Example:NAME _class{0}.ID _class{1}.ID _class{2}.ID Oscar 27 92 1 Tango 1 Charlie <Missing> <Missing> <Missing> Golf 22 12 Whiskey 92 Hotel 137 4 6 So here, Oscar, Tango and Whiskey would be agglomerated.How could that be done ?Thanks
Hopefully not too obvious an answer, but I've been wading through FME documentation all day to try and figure this one out.Essentially I want to build a dynamic workflow that I can point to a series of GeoJsons that:Will have similar, but differing schemas Many will share attribute fields, but not universallyWill be consistently namedI want to then write to an SDE, initially as a new table but from then on only as an update. These output SDE FeatureClasses:Will require additional fields that again are not universalWill vary in geometry type, but only between FC, not within a FCI'd like to be able to design a workflow that will be able to generate the output FC schema based on the input, and picture that this should be achievable by using a lookup table something like the following:1FCA, FCBInput attribute fieldDestination attribute field2FCA, FCC, FCDInput attribute fieldDestination attribute field3FCB, FCDInput attribute fieldDestination attribute field4FCA Destination attribu
While using FME 2019.0, I have noticed that I now get the following error when trying to write a datetime to a file geodatabase date field."An error occurred while attempting to convert the '' component of a date. A possible reason for this is that the data in the date field may be corrupt"This is not an issue in version 2018.1 or if I write to a text field instead in the 2019 version.I do use the following in an AttributeManager to reformat the datetime"@DateTimeFormat(@DateTimeParse(@Value(Date_Created), %s), %Y%m%d %T)"If I drop the "%T" part then it works but I no longer get the time which I would like to keep.Is anyone else experiencing a similar issue and/or found any resolutions?Regards
I have a workspace that has three initial inputs - 1 - A DWG file, 2 - A PostgreSQL table and an excel file.I would like to use Workspace Runner to process all DWG files in a particular directory but when it runs doesn't kick off the process for each drawing as I would expect. How do I use workspace runner to pick up the correct input and process each of the DWG files?
There is a workspace that copies a dataset from a production oracle database to a postgresql database. The postgresql database will be weekly updated with fme-server.What is the fastest way to udate the postgresql database?- check for the differences and write only these to the progressql database - drop and create the table, so you write each time the complete dataset.-or maybe another solution?Thanks,Kind regards Kees
I have two sde databases representing different coordinate systems, both used for managing basemaps in a local coordinate system. I am trying to use a dynamic schema to merge those into a web mercator sde database. everything work fine except it adds what looks like the fme_type as a suffix to the featureclass name. Instead of Building I get Building_polygon.Writer setttings:Feature Class or Table Name: fme_feature_typeGeometry: From Schema DefinitionDynamic Properties box is checked.Schema Sources: set to both source sde database readersSchema Definition Name: Default from Feature Class or Table Name aboveClearly I am missing something... Please help. My only other alternative is a static schema process which I would rather not use. Is there any other information I should provide?Aaron
I am looking for advice on what to set the FME_SERVER_WEB_URL parameter to.In our current install it is set to our internal network address, e.g. http://<networkURL>:80This seems to generally be working fine, but using the FMEServerJobSubmitter is problematic. This requires us to connect to FME Server using the FME_SERVER_WEB_URL, but we can only connect to FME Server using our external URL, e.g. https://<myfmeserver>.com, as there is a security certificate on the server that uses this URL.Should we be using this external URL for FME_SERVER_WEB_URL?Are there any ramifications to changing FME_SERVER_WEB_URL to the external URL?ThanksKeith
I read the following on https://knowledge.safe.com/articles/1211/parallel-processing.html."As of FME2019, the Parallel Processing options have been removed from most transformers and exist only in the custom transformer infrastructure. A separate article exists to explain setting up parallel processing in a custom transformer."Why was this change made? Thanks.
Does anyone have any experience of using FME to push out data from a Caris Hydrographic Production Database (HPD)? HPD Server utilises Oracle storage, and FME can obviously be connected to an Oracle db. Can this connection be used to read a Caris HPD?
Has anyone else had issues with feature order in partial runs when there are two parallel streams? Example a SpatialFilter set to Filters First If I run the entire workspace everything behaves as expected. If I Run From This on the SpatialFilter, all the filters are rejected as `EXTRA_BASE_FEATURE' and all the Candidates fail (due to lack of filters).
Hi , How can I pass the CRC attributes as a published user parameter (e.g., $(CRC_ATTR)) The purpose is to automate the workspace, without having to re-enter the attributes manually in the CRCCalculator transformer. FME Desktop 2014 SP3 Thanks, Sami
I'm new to FME. I have a process that intersects a line buffer from Oracle with a shp stored in local. In the end there is a dissolver to reduce the number of polygons and write it in a shp.The problem is that from Oracle come 11 million records ... and in the dissolver I get an error.My question would be if there would be a way to execute the process in the following way: that I read 500,000 records, process them, write them in the shp, then another 500,000, then others and so on until the end. It could be done?