Creating and organizing workspaces. How to use Workbench.
Recently active
Hi all, I have an issue in new FME. I'm trying to set up User Published Parameter that will give user list of attributes available in workbench. But after choosing a Type: Attribute Name it doesn't see any attributes available. As my input I use shp files. Is it a bug or I didn't do it properly? Regards
I need to make an export of my data with a format like this: I want the output to be in seperate files (fanout) based on a single row value per group I grouped the data by groups, so each group has unique attributes. How I can fanout and get the filename to be a single row attribute? ('bestandsnaam'), so in this case '504.pfrl'
Hi guys, i would like to split attribute value into 2 substrings separated by comma delimeter. I am unable to split it with string replacer or attribute creator.Type of data:What i tried:@Substring(@Value(NASLOV),0,@FindString(@Value(NASLOV),",")) andAny suggestions? thanks in advance, Bye Miha
I ran a rather lengthy fmw using feature caching...open in one window.I opened another fmw and decided I didn't need feature caching for that fmw so i disabled feature caching and ran my workspace.When I returned to my completed fmw window the caching indicators were removed since no caching data existed anymore.I think this is an obvious issue. Running or not running with Feature Caching enabled should not be globally reflected just workspace specific. Either that or a previously run fmw should not be altered.Anyone else experience this?Thanks,PeteP.S. About details:FME InformationEdition: FME Database Edition (node locked-crc) Version: FME(R) 2019.1.0.0 (20190704 - Build 19604 - WIN64) Locale: en_US Codepage: 1252 (ANSI - Latin I) Registration Key: 1-542-353-546 Serial Number: 0 Customer Number: Home Folder: C:\\Program Files\\FME\\Beta\\ Operating System: Microsoft Windows 10 64-bit (Build 17763)
I've got an excel spreadsheet of data with a primary key column, a foreign key column, then various other columns that may or may not contain data. I'm trying to create a single attribute that lists all of the columns/attributes that do not contain data for a given PK/FK combination (i.e., are null/empty/missing).PKFKAttribute1Attribute2Attribute31A DATADATA2ADATA 3BDATA DATA4BDATADATADATA So the output would look like this...PKFKList_of_null_attributes1AAttribute12AAttribute2, Attribute33BAttribute24B Any ideas? I can't seem to wrap my head around this. My first thought was to attribute all null/missing/empty attribute values with a unique identifier, then replace all real data values with an empty field so that I can drop those attributes with a ListConcatenator.Right now my workflow for that includes a NullAttributeMapper to replace null/missing/empty values with a specific unique character (lets say "X"), a stringreplacer & regex to replace all data valu
Using FME Server and Desktop 2016.1 I created a workspace calling a job on FME Server using the FMEServerJobSubmitter transformer.The "Wait for server job to complete" is set to "Yes".If the job succeeds I use the _job_id to get the log file and email using the file as attachment.If the job fails (it generated a log file containing an error) I do not get the _job_id attribute (see image).How can I retrieve the log file from the server if the job fails, but produces a log file?This log file is even more urgent than the succeeded job's log file.
Is this expected behaviour?I am extracting a 32 bit real value of "7.35" using python using feature.getAttribute in 2018.1/2019.1 (and probably every other one). It is returning 7.349999904632568 as a 64 Bit Real . I get that this calculating using 64 bit, so that's where it is coming from, but interested that it is performing that calc on an existing known number.The workaround was to use feature.getAttributeAsType(<attribute>, 11) to treat as a stringExample attached
Hi all, Context: I have a workbench that is aggregating and compiling data from 13 different SDEs. The datasets are managed slightly different source-by-source. I determine adds, updates and deletes via a CRC comparison, but there are feature classes (not all, some) that are participating in editor tracking. There are two different possibilities for the pertinent editor tracking field: MODIFY_DATE and last_edited_date. Sometimes, both of these fields exist in a feature class, with one being associated to esri's editor tracking. Objective: I want to use the arcpy method, describe, to pull the editor tracking field name. Based on that result, I want to filter features on 1) if they have editor tracking enabled, then 2) between MODIFY_DATE and last_edited_date. Method: I have a private parameter python (named editorTracking) script as follows:import fmeimport fmeobjectsimport arcpydef processFeature(feature): desc = arcpy.Describe(feature.getAttribute(pathway)) if desc.editorTrackin
Hello,I'm trying to find an elegant solution for a feature merge based on the same list, twice.So, data is a shapefile with polygons as features. Each polygon have a _class{}.ID list. The goal is to compare each _class{n}.ID to other polygons (not itself) _class{n}.ID (nmax is different for each polygon), to finally agglomerate their geometry.Issue is that ListBasedFeatureMerger takes attributes as supplier key and not lists.Example:NAME _class{0}.ID _class{1}.ID _class{2}.ID Oscar 27 92 1 Tango 1 Charlie <Missing> <Missing> <Missing> Golf 22 12 Whiskey 92 Hotel 137 4 6 So here, Oscar, Tango and Whiskey would be agglomerated.How could that be done ?Thanks
Hopefully not too obvious an answer, but I've been wading through FME documentation all day to try and figure this one out.Essentially I want to build a dynamic workflow that I can point to a series of GeoJsons that:Will have similar, but differing schemas Many will share attribute fields, but not universallyWill be consistently namedI want to then write to an SDE, initially as a new table but from then on only as an update. These output SDE FeatureClasses:Will require additional fields that again are not universalWill vary in geometry type, but only between FC, not within a FCI'd like to be able to design a workflow that will be able to generate the output FC schema based on the input, and picture that this should be achievable by using a lookup table something like the following:1FCA, FCBInput attribute fieldDestination attribute field2FCA, FCC, FCDInput attribute fieldDestination attribute field3FCB, FCDInput attribute fieldDestination attribute field4FCA Destination attribu
While using FME 2019.0, I have noticed that I now get the following error when trying to write a datetime to a file geodatabase date field."An error occurred while attempting to convert the '' component of a date. A possible reason for this is that the data in the date field may be corrupt"This is not an issue in version 2018.1 or if I write to a text field instead in the 2019 version.I do use the following in an AttributeManager to reformat the datetime"@DateTimeFormat(@DateTimeParse(@Value(Date_Created), %s), %Y%m%d %T)"If I drop the "%T" part then it works but I no longer get the time which I would like to keep.Is anyone else experiencing a similar issue and/or found any resolutions?Regards
I have a workspace that has three initial inputs - 1 - A DWG file, 2 - A PostgreSQL table and an excel file.I would like to use Workspace Runner to process all DWG files in a particular directory but when it runs doesn't kick off the process for each drawing as I would expect. How do I use workspace runner to pick up the correct input and process each of the DWG files?
There is a workspace that copies a dataset from a production oracle database to a postgresql database. The postgresql database will be weekly updated with fme-server.What is the fastest way to udate the postgresql database?- check for the differences and write only these to the progressql database - drop and create the table, so you write each time the complete dataset.-or maybe another solution?Thanks,Kind regards Kees
I have two sde databases representing different coordinate systems, both used for managing basemaps in a local coordinate system. I am trying to use a dynamic schema to merge those into a web mercator sde database. everything work fine except it adds what looks like the fme_type as a suffix to the featureclass name. Instead of Building I get Building_polygon.Writer setttings:Feature Class or Table Name: fme_feature_typeGeometry: From Schema DefinitionDynamic Properties box is checked.Schema Sources: set to both source sde database readersSchema Definition Name: Default from Feature Class or Table Name aboveClearly I am missing something... Please help. My only other alternative is a static schema process which I would rather not use. Is there any other information I should provide?Aaron
I am looking for advice on what to set the FME_SERVER_WEB_URL parameter to.In our current install it is set to our internal network address, e.g. http://<networkURL>:80This seems to generally be working fine, but using the FMEServerJobSubmitter is problematic. This requires us to connect to FME Server using the FME_SERVER_WEB_URL, but we can only connect to FME Server using our external URL, e.g. https://<myfmeserver>.com, as there is a security certificate on the server that uses this URL.Should we be using this external URL for FME_SERVER_WEB_URL?Are there any ramifications to changing FME_SERVER_WEB_URL to the external URL?ThanksKeith
I read the following on https://knowledge.safe.com/articles/1211/parallel-processing.html."As of FME2019, the Parallel Processing options have been removed from most transformers and exist only in the custom transformer infrastructure. A separate article exists to explain setting up parallel processing in a custom transformer."Why was this change made? Thanks.
Does anyone have any experience of using FME to push out data from a Caris Hydrographic Production Database (HPD)? HPD Server utilises Oracle storage, and FME can obviously be connected to an Oracle db. Can this connection be used to read a Caris HPD?
Has anyone else had issues with feature order in partial runs when there are two parallel streams? Example a SpatialFilter set to Filters First If I run the entire workspace everything behaves as expected. If I Run From This on the SpatialFilter, all the filters are rejected as `EXTRA_BASE_FEATURE' and all the Candidates fail (due to lack of filters).
Hi , How can I pass the CRC attributes as a published user parameter (e.g., $(CRC_ATTR)) The purpose is to automate the workspace, without having to re-enter the attributes manually in the CRCCalculator transformer. FME Desktop 2014 SP3 Thanks, Sami
I'm new to FME. I have a process that intersects a line buffer from Oracle with a shp stored in local. In the end there is a dissolver to reduce the number of polygons and write it in a shp.The problem is that from Oracle come 11 million records ... and in the dissolver I get an error.My question would be if there would be a way to execute the process in the following way: that I read 500,000 records, process them, write them in the shp, then another 500,000, then others and so on until the end. It could be done?
Are there any tools that can be used to document the contents of a workspace?
I would like my script to keep only one attribute designated by the user in a shape in which it will be renamed. I created the workspace below. the attribute "ATTRIBUTE" persists in keeping the value 0 while the selected attribute contains 5, 12, 8, 45 .... Where can my mistake be? Thank you
Is there a transformer that is a cross between an AttributeKeeper/Remover and a Tester? Meaning that I need to dynamically split my data not on attribute values but on the attribute field names, so all of the fields with the suffix '_alias' are routed one direction and all other fields are routed another.Any thoughts on how I can achieve this?
Hi all, I have a geojson file, where I would like to concatenate the some key value pair to one as array. I have tried ListConcatenator however it simple concatenate without creating array. You can see the below my attempt and desired result. Thanks in advance. Output of ListConcatenator{ "type" : "Feature", "geometry" : { "type" : "LineString", "coordinates" : [ [ 4.3458008766, 50.8345288033 ], [ 4.346331954, 50.8348774905 ], [ 4.3474423885, 50.8357197041 ] ] }, "properties" : { "osm_id" : "", "osm_way_id" : "30010739", "_amenity{0}.amenity" : "hospital", "_amenity{1}.amenity" : "pharmacy", "_amenity{2}.amenity" : "drinking_water", "_amenity{3}.amenity" : "pub", "_concatenated" : "hospital,waste_basket,pharmacy,drinking_water,pub"
I am trying to create a custom tool to help me do QA better and faster.I have no problem detecting columns with null, empty ... etc but I really struggle to do so with <missing> values in PythonCaller.Thanks for your help in advance.