Skip to main content
  • EN

Authoring

Creating and organizing workspaces. How to use Workbench.

  • 3,287 Posts
  • 13,484 Replies
3287 Posts
bwasserstein
Participant
bwassersteinParticipant
asked in Authoring
Output a single comma delineated attribute from a list of empty/missing attributes grouped by a PK

I've got an excel spreadsheet of data with a primary key column, a foreign key column, then various other columns that may or may not contain data. I'm trying to create a single attribute that lists all of the columns/attributes that do not contain data for a given PK/FK combination (i.e., are null/empty/missing).PKFKAttribute1Attribute2Attribute31A DATADATA2ADATA  3BDATA DATA4BDATADATADATA So the output would look like this...PKFKList_of_null_attributes1AAttribute12AAttribute2, Attribute33BAttribute24B  Any ideas? I can't seem to wrap my head around this. My first thought was to attribute all null/missing/empty attribute values with a unique identifier, then replace all real data values with an empty field so that I can drop those attributes with a ListConcatenator.Right now my workflow for that includes a NullAttributeMapper to replace null/missing/empty values with a specific unique character (lets say "X"), a stringreplacer & regex to replace all data valu

3460
bwasserstein
Participant
erik_jan
Contributor
erik_janContributor
asked in Authoring
How to get the Job ID from a failing FMEServerJobSubmitter?

Using FME Server and Desktop 2016.1 I created a workspace calling a job on FME Server using the FMEServerJobSubmitter transformer.The "Wait for server job to complete" is set to "Yes".If the job succeeds I use the _job_id to get the log file and email using the file as attachment.If the job fails (it generated a log file containing an error) I do not get the _job_id attribute (see image).How can I retrieve the log file from the server if the job fails, but produces a log file?This log file is even more urgent than the succeeded job's log file.

460
david_r
Celebrity
todd_davis
Influencer
todd_davisInfluencer
asked in Authoring
32 bit real attribute via python getAttribute

Is this expected behaviour?I am extracting a 32 bit real value of "7.35" using python using feature.getAttribute in 2018.1/2019.1 (and probably every other one). It is returning 7.349999904632568 as a 64 Bit Real . I get that this calculating using 64 bit, so that's where it is coming from, but interested that it is performing that calc on an existing known number.The workaround was to use feature.getAttributeAsType(<attribute>, 11) to treat as a stringExample attached

31
david_r
Celebrity
C
cwchumley
asked in Authoring
Filter feature classes by editor tracking field

Hi all, Context: I have a workbench that is aggregating and compiling data from 13 different SDEs. The datasets are managed slightly different source-by-source. I determine adds, updates and deletes via a CRC comparison, but there are feature classes (not all, some) that are participating in editor tracking. There are two different possibilities for the pertinent editor tracking field: MODIFY_DATE and last_edited_date. Sometimes, both of these fields exist in a feature class, with one being associated to esri's editor tracking. Objective: I want to use the arcpy method, describe, to pull the editor tracking field name. Based on that result, I want to filter features on 1) if they have editor tracking enabled, then 2) between MODIFY_DATE and last_edited_date. Method: I have a private parameter python (named editorTracking) script as follows:import fmeimport fmeobjectsimport arcpydef processFeature(feature):    desc = arcpy.Describe(feature.getAttribute(pathway))    if desc.editorTrackin

220
C
L
levonslagmulder
asked in Authoring
ListBasedFeatureMerger with list as Supplier key ?

Hello,I'm trying to find an elegant solution for a feature merge based on the same list, twice.So, data is a shapefile with polygons as features. Each polygon have a _class{}.ID list. The goal is to compare each _class{n}.ID to other polygons (not itself) _class{n}.ID (nmax is different for each polygon), to finally agglomerate their geometry.Issue is that ListBasedFeatureMerger takes attributes as supplier key and not lists.Example:NAME _class{0}.ID _class{1}.ID _class{2}.ID Oscar 27 92 1 Tango 1   Charlie <Missing> <Missing> <Missing> Golf 22 12  Whiskey 92   Hotel 137 4 6  So here, Oscar, Tango and Whiskey would be agglomerated.How could that be done ?Thanks

110
L
R
r.houg
asked in Authoring
Dynamic workflow using schema lookup table

Hopefully not too obvious an answer, but I've been wading through FME documentation all day to try and figure this one out.Essentially I want to build a dynamic workflow that I can point to a series of GeoJsons that:Will have similar, but differing schemas Many will share attribute fields, but not universallyWill be consistently namedI want to then write to an SDE, initially as a new table but from then on only as an update. These output SDE FeatureClasses:Will require additional fields that again are not universalWill vary in geometry type, but only between FC, not within a FCI'd like to be able to design a workflow that will be able to generate the output FC schema based on the input, and picture that this should be achievable by using a lookup table something like the following:1FCA, FCBInput attribute fieldDestination attribute field2FCA, FCC, FCDInput attribute fieldDestination attribute field3FCB, FCDInput attribute fieldDestination attribute field4FCA Destination attribu

150
R
P
potterman81
asked in Authoring
FME 2019 Causes Error When Writing Datetime to File Geodatabase

While using FME 2019.0, I have noticed that I now get the following error when trying to write a datetime to a file geodatabase date field."An error occurred while attempting to convert the '' component of a date. A possible reason for this is that the data in the date field may be corrupt"This is not an issue in version 2018.1 or if I write to a text field instead in the 2019 version.I do use the following in an AttributeManager to reformat the datetime"@DateTimeFormat(@DateTimeParse(@Value(Date_Created), %s), %Y%m%d %T)"If I drop the "%T" part then it works but I no longer get the time which I would like to keep.Is anyone else experiencing a similar issue and/or found any resolutions?Regards

6400
P
deanhowell
Influencer
deanhowellInfluencer
asked in Authoring
Workspace Runner Question

I have a workspace that has three initial inputs - 1 - A DWG file, 2 - A PostgreSQL table and an excel file.I would like to use Workspace Runner to process all DWG files in a particular directory but when it runs doesn't kick off the process for each drawing as I would expect. How do I use workspace runner to pick up the correct input and process each of the DWG files?

190
deanhowell
Influencer
K
kees_v
asked in Authoring
Fastes way to update

There is a workspace that copies a dataset from a production oracle database to a postgresql database. The postgresql database will be weekly updated with fme-server.What is the fastest way to udate the postgresql database?- check for the differences and write only these to the progressql database - drop and create the table, so you write each time the complete dataset.-or maybe another solution?Thanks,Kind regards Kees

90
itay
Supporter
A
aarche
asked in Authoring
sde dynamic writer adding fme_type as suffix

I have two sde databases representing different coordinate systems, both used for managing basemaps in a local coordinate system. I am trying to use a dynamic schema to merge those into a web mercator sde database. everything work fine except it adds what looks like the fme_type as a suffix to the featureclass name. Instead of Building I get Building_polygon.Writer setttings:Feature Class or Table Name: fme_feature_typeGeometry: From Schema DefinitionDynamic Properties box is checked.Schema Sources: set to both source sde database readersSchema Definition Name: Default from Feature Class or Table Name aboveClearly I am missing something... Please help. My only other alternative is a static schema process which I would rather not use. Is there any other information I should provide?Aaron

608
G
keithhastings
Contributor
keithhastingsContributor
asked in Authoring
What URL should I use for FME_SERVER_WEB_URL?

I am looking for advice on what to set the FME_SERVER_WEB_URL parameter to.In our current install it is set to our internal network address, e.g. http://<networkURL>:80This seems to generally be working fine, but using the FMEServerJobSubmitter is problematic. This requires us to connect to FME Server using the FME_SERVER_WEB_URL, but we can only connect to FME Server using our external URL, e.g. https://<myfmeserver>.com, as there is a security certificate on the server that uses this URL.Should we be using this external URL for FME_SERVER_WEB_URL?Are there any ramifications to changing FME_SERVER_WEB_URL to the external URL?ThanksKeith

2190
H
R
ronaldmcoker
asked in Authoring
Why Was Parallel Processing Removed From Transformers in FME2019?

I read the following on https://knowledge.safe.com/articles/1211/parallel-processing.html."As of FME2019, the Parallel Processing options have been removed from most transformers and exist only in the custom transformer infrastructure. A separate article exists to explain setting up parallel processing in a custom transformer."Why was this change made? Thanks. 

130
H
S
simondeeves
asked in Authoring
FME and Caris HPD

Does anyone have any experience of using FME to push out data from a Caris Hydrographic Production Database (HPD)? HPD Server utilises Oracle storage, and FME can obviously be connected to an Oracle db. Can this connection be used to read a Caris HPD?  

700
J
jdh
Contributor
jdhContributor
asked in Authoring
stream order in feature caching partial runs

Has anyone else had issues with feature order in partial runs when there are two parallel streams?  Example a SpatialFilter set to Filters First If I run the entire workspace everything behaves as expected. If I Run From This on the SpatialFilter, all the filters are rejected as `EXTRA_BASE_FEATURE' and all the Candidates fail (due to lack of filters).  

160
jdh
Contributor
samisnunu
Contributor
samisnunuContributor
asked in Authoring
Passing CRC attributes as a published parameter

Hi , How can I pass the CRC attributes as a published user parameter (e.g., $(CRC_ATTR))  The purpose is to automate the workspace, without having to re-enter the attributes manually in the CRCCalculator transformer.  FME Desktop 2014 SP3  Thanks, Sami

140
thejando
Contributor
pcarrerabalsell
Contributor
pcarrerabalsellContributor
asked in Authoring
Iterative execution of an FME workflow

 I'm new to FME. I have a process that intersects a line buffer from Oracle with a shp stored in local. In the end there is a dissolver to reduce the number of polygons and write it in a shp.The problem is that from Oracle come 11 million records ... and in the dissolver I get an error.My question would be if there would be a way to execute the process in the following way: that I read 500,000 records, process them, write them in the shp, then another 500,000, then others and so on until the end. It could be done?

180
redgeographics
Celebrity
deanhowell
Influencer
deanhowellInfluencer
asked in Authoring
Document Workspace

Are there any tools that can be used to document the contents of a workspace?

140
deanhowell
Influencer
4
40_eme
asked in Authoring
Keep only one attribute (published parameter) renamed in a shape?

I would like my script to keep only one attribute designated by the user in a shape in which it will be renamed. I created the workspace below.   the attribute "ATTRIBUTE" persists in keeping the value 0 while the selected attribute contains 5, 12, 8, 45 .... Where can my mistake be?  Thank you

50
alc33
Contributor
joshuadamron
Contributor
joshuadamronContributor
asked in Authoring
Dynamically Keep/Remove attribute fields?

Is there a transformer that is a cross between an AttributeKeeper/Remover and a Tester? Meaning that I need to dynamically split my data not on attribute values but on the attribute field names, so all of the fields with the suffix '_alias' are routed one direction and all other fields are routed another.Any thoughts on how I can achieve this?

730
joshuadamron
Contributor
jugoslaviaa
Enthusiast
jugoslaviaaEnthusiast
asked in Authoring
Combining key value pair to an array

Hi all, I have a geojson file, where I would like to concatenate the some key value pair to one as array. I have tried ListConcatenator however it simple concatenate without creating array. You can see the below my attempt and desired result. Thanks in advance. Output of ListConcatenator{            "type" : "Feature",            "geometry" : {                "type" : "LineString",                "coordinates" : [                    [ 4.3458008766, 50.8345288033 ],                    [ 4.346331954, 50.8348774905 ],                    [ 4.3474423885, 50.8357197041 ]                ]            },            "properties" : {                "osm_id" : "",                "osm_way_id" : "30010739",                "_amenity{0}.amenity" : "hospital",                "_amenity{1}.amenity" : "pharmacy",                "_amenity{2}.amenity" : "drinking_water",                "_amenity{3}.amenity" : "pub",                "_concatenated" : "hospital,waste_basket,pharmacy,drinking_water,pub"        

260
jugoslaviaa
Enthusiast
dataninja
dataninja
asked in Authoring
How to detect missing values dynamically using PythonCaller?

I am trying to create a custom tool to help me do QA better and faster.I have no problem detecting columns with null, empty ... etc but I really struggle to do so with <missing> values in PythonCaller.Thanks for your help in advance.

10411
dataninja
zzupljanin
Contributor
zzupljaninContributor
asked in Authoring
detect changes on website

Hi, I'd like to set up a notification that watches over some web address.When the changes of content occurs, it should notify me via e-mail or something. How can I do that?

290
redgeographics
Celebrity
ebygomm
Influencer
ebygommInfluencer
asked in Authoring
Using a % symbol in a choice type parameter

Is it possible to use a % symbol in a choice type parameter?e.g. if i wanted the parameter options to be %y%m%d or %d/%m/%Y

60
H
geouser97
Contributor
geouser97Contributor
asked in Authoring
how to add an attribute in the Citygml table view

I have an IFC conversion to citygml, in which I created spaces in revit and I converted them using the Citygml Room feature. I want to have the information about the volume of these spaces in the final Citygml Room attribute table after the conversion. the volume information is stored in the BaseQuantities.GroosVolume attribute Of IfcSpace.

270
chrisatsafe
Contributor
N
nademmy
asked in Authoring
Renaming attribute from list with _element_index

I have a list which I exploded using the listExploder. The output contains an attribute _element_index. I want to create an attribute with a name composed of the value of _element_index concatenated with another string. When I try to write the name of this new attribute in an AttributeCreator, it seems like the @Value(_element_index) doesn't work as no new attribute is created (the new attribute name doesn't appear as an option in the AttributeExposer).

520
M

Badge Winners

  • Welcome Back
    tim_goirlehas earned the badge Welcome Back
  • FME Certified Professional
    boonaldshas earned the badge FME Certified Professional
  • Welcome Back
    mjjhas earned the badge Welcome Back
  • FME Certified Professional
    _jacques_has earned the badge FME Certified Professional
  • Integrate Spatial Data
    madihas earned the badge Integrate Spatial Data
Show all badges

Community Stats

31,795
Posts
120,765
Replies
39,408
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.