Creating and organizing workspaces. How to use Workbench.
Recently active
Hi ppl, In a workspace I have several published parameters all have the same type (choice), when prompting the translation, some of the parameters have a extra button to select attributes (which is not ncessary) and some do not. Anybody an idea on how to make the extra button go away? what is causing this difference? Cheers, Itay
Hi, i have one fme flowchart and, in that flux, i have a lot of repeated transformers . So, the problem is: is there a way of change the parameter of all transformer at the same time, or i have to change one by one? Thanks !
Hi, If I define a published parameter for a custom transformer, a menu button always appears in side of the parameter input box. I want to hide or disable the menu button; the interface like Copy Number Attribute of the Cloner is what I want. Is there a way? Thanks in advance. Takashi
I have an FME workspace I run monthly. It compares old data with current data. The old data is usually last month's data with the date stamp as part of the name. Because the feature type changes each time, I want to be prompted to select it. I can't simply use feature types to read because new feature types are being added to the file geodatabase each month (i.e. - it's not a static list). I need FME to read all the feature types in the file geodatabase at runtime and then prompt me to select one. Is there a way to do so? (Win7 64-bit, FME 2014, Build 14230, 32-bit). Thanks, Aaron Albuquerque, NM
I have installed FME Server 2014 and would like to set up the data distribution html / js / css files as in the demo at http://demos.fmeserver.com/datadistribution-googlemaps/index.html. However, I can't find the web root of the FME Server Web Application Server. Where is it, such that when I go to: http://myhost:8080/fmeserver/datadistribution.html ...I wil find that datadistribution.html page? Thanks
Hello all , I am trying to read all the file paths from a text file which is going to be the source file paths for the dynamic reader . I am using below private variable to generate the source reader's path # Get the file from a published parameter ListFile = (FME_MacroValues['Config_File']) f = open(ListFile,'r') featureTypes = '' # Read the file and add each line to the featureTypes Variable featureTypes = f.read() f.close() #Return this list to the parameter return featureTypes And I am publishing it to FME Server . When I run the job I am getting error saying it cannot read "C:\\temp1 C:\\temp2 C:\\temp3" . Any suggestions ???
In a spreadsheet I need to compare the value of an attribute in record 1 to the same attribute in record 2, then move on to compare record 2 with 3, then 3 with 4 and so on. What is the best method? Cheers,
I need to load data from multiple reader to a single writer . I would like to take a backup of the current data before the process begins . I would like to set the option to truncate the features in the output GDB and reload from all the readers . During this process if it fails is there any way to roll back the process ? Can anyone help please . Thanks
Hi, I'm trying to identify what open source components/libraries (and specifically, what versions) are used / deployed with FME2014, but I can't find any definitive statements about this. Does anyone have any info, or can advise? Much appreciated, Pete
Hello, I have noticed that FME Data Inspector is taking to way too long to open sometimes about 30-40min. It stays on splash screen. Also FME workbench doesn't end translation it keeps running for any simple translation even after following message in log window --------------------------------- Translation was SUCCESSFUL with 0 warning(s) (6 feature(s) output) FME Session Duration: 2.5 seconds. (CPU: 1.5s user, 0.6s system) END - ProcessID: 984, peak process memory usage: 134752 kB, current process memory usage: 134752 kB ---------------------------------- Everytime I have to terminate it by clicking "stop translation" button. Is there any reason for this? Thanks john
I would like to do what has been beautifully described on the following blog. The issue is that I currently have FME2013SP1 and the blog is using newer transformers (NullAttributeMapper and newer functionality of FeatureMerger) http://fme-memorandum-takashi.blogspot.ca/2014/02/merge-two-lists-so-that-elements-will.html I am looking for suggestions on how to get the same results but by using what is available in FME2013SP1 (until I am able to get 2014 installed). Thank you
I am to use public parameter to append to SourceDataset macro. I want to keep initial folder fixed in my case it's /roor/FME/. Steps taken -Define Published Parameter as INPUT_DATA which will contain relative e.g. path /data/shape/1.shp. -Append above param to SourceDataset_GENERIC by "/root/FME/$(INPUT_PATH)" This is working well on my windows machine (FME Desktop 2014) but when I publish it to FME server (linux) somwhow it is retaining a reference to my windows machine's path as a result of this it's throwing an error as "No Shape Files found to process in directory `C:/root/FME/data/1.shp'. Check directory and ids statement in mapping file" I am struggling to find a reason for this behaviour.
I have a workbench set up in FME 2014 that makes use of dynamic schema to convert a large number of TAB files into shapefiles as wekk as reproject them into a different coordinate system. However there are certain tab files that are corrupt and so when I run the workbench it keeps failing. Is there a way to get the workbench to skip the files that are corrupt?
Hi all, I have managed to make workflows using transformers and workspacecallers. Create any attribute and acces them without exposure. Took me 4-5 days to figure out, works like a charm! It is based on the solution i provided for community question by Robbie B Creating dynamic attributes per "fme_basename" If anyone is interested i can elaborate next week. (i'm off now..:)
In my python caller script I can not access to feature outside of the function checkViewer(). I would like to be able to access it in the Index() class. How can I make the feature as a global variable? import fmeobjects import json import matplotlib.pyplot as plt from matplotlib.widgets import Button from descartes import PolygonPatch def checkViewer(feature): BLUE = '#6699cc' geometry = feature.getAttribute('_geometry') geoJson = json.loads(geometry) fig = plt.figure() ax = fig.gca() ax.add_patch(PolygonPatch(geoJson, fc=BLUE, ec=BLUE, alpha=0.5, zorder=2 )) ax.axis('scaled') callback = Index() axprev = plt.axes([0.7, 0.05, 0.1, 0.075]) axnext = plt.axes([0.81, 0.05, 0.1, 0.075]) bnext = Button(axnext, 'Garder') bnext.on_clicked(callback.garder) bprev = Button(axprev, 'Rejeter') bprev.on_clicked(callback.rejeter) plt.show() class Index(): def __init__(self):
According to the docs when using FMEServerWorkspaceRunner you can specify the value of published parameters to be a value from attributes of the feature that triggered the job: "Any published parameters associated with the server workspace must be given values. These values can be taken from attributes of the feature that triggered the job to be submitted, or can be typed in (in which case they will be the same for each job that is sent via the transformer)." But I can't seem to find how this is actually done in Workbench. The wizard page lists my published parameters but does not have the usual drop-down arrow to allow me to specify the feature attribute to assign as the value. I also tried setting the value using the macro @Value(attribute_name) but all that did was pass through the string. So is this an error in the docs or am I missing something obvious? FME Desktop 2013 and FME Server 2013
Hi Guys, yu, its met again. I have a question. If i do this $(DestDataset_CSV) as a scripted parameter and tcl script: $FME_MacroValues(Outputdir)\\\\$FME_MacroValues(csv_name).csv (just a simple concatenation) Then $(DestDataset_CSV) ends up like Outputdir\\csv_name the extension is missing. Only when i add this extension to $FME_MacroValues(csvl_name) =filename.csv i get Outputdir\\csv_name.csv wich is correct. Why is this? (in this case i wanted the user not to have to enter the extension, though i changed my mind on that point already..;) Also i have boiled down the issue by Robbie B Creating dynamic attributes per "fme_basename" to just this It consist of 3 workspaces, 2 of wich have callers, an intricate parameter construction, 2 startups and one shutdown script. Now one can pick a directory and read files and their attributes straight to (in this case) excell. I think this workspace might inerest you all because it shows a workaround on the issue of dy
I have a workflow which has 1. Genereric Reader 2. Sampler - Which will send onle 1 feature 3. GeometryFilter- To decide geometry type of source data possible values are Polygon, Point and non-geom data Now I have 3 different workspaces for above 3 conditions. To decide which workspace to run I have written a shutdown python script which will run WorkspaceRunner and it will decide which workspace to run. but I am not able to use vaiable I set in workflow to decide the workspace. In short I need to use variable defined in workflow in Python script? Note: I don't want to use WorkspaceRunner as I am publishing this to FME server.
Hi all, I have a workspacerunner that calls a very basic workspace. All this workspace does is call a csv and writes it to a Excel file. I parametrized the outputdirectory and output filename. Strange thing is, when i use "Directory(output)" and "Filename (output)" parameters, no parameters appear in the workspacerunner. When i use "choice or text" parameters for both variables; no parameters appear in the workspacerunner. But..when i use both, finaly parameters appear in the workspacerunner. See pic. But this is ugly : I want just one set. Now i have solved this by making 1 set (the "choice or text" ones) private parameters so they don't show in the workspacerunner parameters. Anyone know how i can tackle this, just on set without need to hide some by making them private?
Hi guys! I'm finding it quite difficult to figure out how to dynamically produce attributes per my "fme_basename". So let me explain what I have, and what I want. My source is a folder with multiple undetermined shape files in. My output is a .xls file that simply lists the attributes present for each shapefile within my source. So in other words, my writer fans out by "fme_basename". Everything works fine, but instead of each shapefile being represented by a new tab, I'd like for them all to be on one page, in other words, an attribute created for each shapefile found. The intent of the entire workspace is just to summarise all shapefiles for the user, so that they can ensure all fields that should be present are, for each shape file. So what I have is: "ATTRIBUTES" (The field I created that lists all present fields) Type Name level etc [Roadnetwork] (This is the tab in the xls) This is present for each tab generated, where each tab is named
Hi, I am using FME Desktop 2013, Build 13448 to try and complete the following workflow. Read in CSV's from a directory; as these have have differing numbers and names for attribute fields, before I complete the required processing. NOTE that all input files will have the 3 required I need even if they are named differently (extra fields can be ignored). I had planned to create a lookup.csv to manage the mappings and then use the schema mapper to read in the Survey CSV and the lookup csv and then create an output with only the 3 required fields with the new names. However, I must be doing something wrong as it is not working as imagined. Input Survey examples: File1 Schema EAST,NORTH,HEIGHT File2 Schema easting,hei,Nothing,date,time File3 Schema X,Y,Z,Time Lookup,csv old,new EAST,NEW_EASTING easting,NEW_EASTING X,NEW_EASTING NORTH,NEW_NORTHING Northing,NEW_NORTHING Y,NEW_NORTHING HEIGHT,NEW_HEIGHT hei,NEW_HEIGHT Z,NEW_HEIGHT expected output NEW_EASTING,NEW_NORTHING,NEW_HEI
I want to create a workflow which daisy chains a number of workspaces using workspace runners but there may be a complication. Workspace 1 Reads a list of files and passes only the first file (Survey01) from directory A to Workspace 2 (Wait for job to complete is set to Yes) Workspace 2 The first file comes into Workspace 2, the name of the file is used to find a matching pair from directory B (Survey01Attribution). Then temporary versions are created of both files and placed in a TempDirectory, specfici names are given (this is required for Workspace 3) Survey01 will be TempA Survey01Attribution will be TempB Then another WorkspaceRunner is used to invoke Workspace 3 Workspace 3 When Workspace 3 starts The TempA and TempB files are opened and an InlineQuerier is used to perform a join, the resultant table is then output (an attribute is used to name the file Survey01Joined) Then and only then when Workspace 3 is completed do I want workspace 1 to send the next file to workspac
With the schema reader I can get all the "feature type name" from: - shapefiles (...\\**\\*.shp) - File geo database (test.gdb) But how can I get all the "feature type name" from an ArcSDE? or from an oracle database?
Hi there! I'm a bit stuck with something that couldn't possible as hard as I'm finding it to be.. I have a folder with a bunch of shapefiles in, and I simply want an xls output (fanned out by fme_basename) with an attribute that lists all the attributes in each shapefiles. So in other words, my workspace creates a tab for each shapfeile, but I can't figure out how to just list all the attributes present. I simply want to know which attributes are present. Here's an example of what I'd like: "ROADS": (imagine this is one of the xls tabs) "Present Attributes" (This is the field/attribute I create for each tab) "user" "date" "direction" "type" etc etc.. I hope this explination makes at least some level of sense. Thanks in advance,
There is an option SQL Statement to Execute before Translation on the writer side. I have a fairly complicated T/SQL stored procedure that prepares the source data. I don't really want to bother adding all that complexity to my workspace. It would be a lot of work and besides, the current procedure works fine. When does the execute SQL Statement Before Translation on the writer execute? Does it execute before anything else happens? Or does it execute after the rows have been read before any translations have been executed? Is there any way, within the workspace, to execute the stored procedure before the readers read any records?