Creating and organizing workspaces. How to use Workbench.
Recently active
Hi all, if i launch a workbench, it executes no problem but i see this error into log file when i checked "Log Debugging information" from Tools==> FME Options==> Runtime=>Log file Default". ERROR |BADNEWS: File C:\\Program Files\\FME\\metafile\\MULTI_WRITER.fmf could not be opened (tabrdr.cpp:997) ERROR |BADNEWS: File C:\\Program Files\\FME\\metafile\\PythonFactory.fmf could not be opened (tabrdr.cpp:997) ERROR |BADNEWS: File C:\\Program Files\\FME\\metafile\\QueryFactory.fmf could not be opened (tabrdr.cpp:997) What that means this error? Thanks an advance. FarFar
I have a problem where I am trying to load a specifically named .csv file into FME. Basic right!?!? The problem is that the dataset I am loading is broken up in subfolders. For example, I am opening “Folder A” with a hierarchy of “Subfolder A”, “Subfolder B”, “Subfolder C”, and so on. Within each subfolder is CSV file named “example.csv”. I need to batch grab “example.csv” out of each subfolder. I considered using “Merge Feature Type” option but I’m a little rusty on how to structure my *\\**.csv setup. I hope I’ve explained this well enough and would appreciate any direction on how to merge the CSV files (of a specific name) as a reader in the subfolders. *Note, in the meantime, I manually added the 100+ files as a stopgap but it’s not an elegant or sustainable solution. Thanks, Matt
Hi, When using 'Fanout by Attribute' on MS SQL Spatial Writer I can't seem to get it to write using the Database Username, it always writes out to dbo. Is there a tip or trick I may be missing? Thanks
What is the difference between static and dynamic schema when adding a writer to the workbench? Regards, Hani
Hi ppl, In a workspace I have several published parameters all have the same type (choice), when prompting the translation, some of the parameters have a extra button to select attributes (which is not ncessary) and some do not. Anybody an idea on how to make the extra button go away? what is causing this difference? Cheers, Itay
Hi, i have one fme flowchart and, in that flux, i have a lot of repeated transformers . So, the problem is: is there a way of change the parameter of all transformer at the same time, or i have to change one by one? Thanks !
Hi, If I define a published parameter for a custom transformer, a menu button always appears in side of the parameter input box. I want to hide or disable the menu button; the interface like Copy Number Attribute of the Cloner is what I want. Is there a way? Thanks in advance. Takashi
I have an FME workspace I run monthly. It compares old data with current data. The old data is usually last month's data with the date stamp as part of the name. Because the feature type changes each time, I want to be prompted to select it. I can't simply use feature types to read because new feature types are being added to the file geodatabase each month (i.e. - it's not a static list). I need FME to read all the feature types in the file geodatabase at runtime and then prompt me to select one. Is there a way to do so? (Win7 64-bit, FME 2014, Build 14230, 32-bit). Thanks, Aaron Albuquerque, NM
I have installed FME Server 2014 and would like to set up the data distribution html / js / css files as in the demo at http://demos.fmeserver.com/datadistribution-googlemaps/index.html. However, I can't find the web root of the FME Server Web Application Server. Where is it, such that when I go to: http://myhost:8080/fmeserver/datadistribution.html ...I wil find that datadistribution.html page? Thanks
Hello all , I am trying to read all the file paths from a text file which is going to be the source file paths for the dynamic reader . I am using below private variable to generate the source reader's path # Get the file from a published parameter ListFile = (FME_MacroValues['Config_File']) f = open(ListFile,'r') featureTypes = '' # Read the file and add each line to the featureTypes Variable featureTypes = f.read() f.close() #Return this list to the parameter return featureTypes And I am publishing it to FME Server . When I run the job I am getting error saying it cannot read "C:\\temp1 C:\\temp2 C:\\temp3" . Any suggestions ???
In a spreadsheet I need to compare the value of an attribute in record 1 to the same attribute in record 2, then move on to compare record 2 with 3, then 3 with 4 and so on. What is the best method? Cheers,
I need to load data from multiple reader to a single writer . I would like to take a backup of the current data before the process begins . I would like to set the option to truncate the features in the output GDB and reload from all the readers . During this process if it fails is there any way to roll back the process ? Can anyone help please . Thanks
Hi, I'm trying to identify what open source components/libraries (and specifically, what versions) are used / deployed with FME2014, but I can't find any definitive statements about this. Does anyone have any info, or can advise? Much appreciated, Pete
Hello, I have noticed that FME Data Inspector is taking to way too long to open sometimes about 30-40min. It stays on splash screen. Also FME workbench doesn't end translation it keeps running for any simple translation even after following message in log window --------------------------------- Translation was SUCCESSFUL with 0 warning(s) (6 feature(s) output) FME Session Duration: 2.5 seconds. (CPU: 1.5s user, 0.6s system) END - ProcessID: 984, peak process memory usage: 134752 kB, current process memory usage: 134752 kB ---------------------------------- Everytime I have to terminate it by clicking "stop translation" button. Is there any reason for this? Thanks john
I would like to do what has been beautifully described on the following blog. The issue is that I currently have FME2013SP1 and the blog is using newer transformers (NullAttributeMapper and newer functionality of FeatureMerger) http://fme-memorandum-takashi.blogspot.ca/2014/02/merge-two-lists-so-that-elements-will.html I am looking for suggestions on how to get the same results but by using what is available in FME2013SP1 (until I am able to get 2014 installed). Thank you
I am to use public parameter to append to SourceDataset macro. I want to keep initial folder fixed in my case it's /roor/FME/. Steps taken -Define Published Parameter as INPUT_DATA which will contain relative e.g. path /data/shape/1.shp. -Append above param to SourceDataset_GENERIC by "/root/FME/$(INPUT_PATH)" This is working well on my windows machine (FME Desktop 2014) but when I publish it to FME server (linux) somwhow it is retaining a reference to my windows machine's path as a result of this it's throwing an error as "No Shape Files found to process in directory `C:/root/FME/data/1.shp'. Check directory and ids statement in mapping file" I am struggling to find a reason for this behaviour.
I have a workbench set up in FME 2014 that makes use of dynamic schema to convert a large number of TAB files into shapefiles as wekk as reproject them into a different coordinate system. However there are certain tab files that are corrupt and so when I run the workbench it keeps failing. Is there a way to get the workbench to skip the files that are corrupt?
Hi all, I have managed to make workflows using transformers and workspacecallers. Create any attribute and acces them without exposure. Took me 4-5 days to figure out, works like a charm! It is based on the solution i provided for community question by Robbie B Creating dynamic attributes per "fme_basename" If anyone is interested i can elaborate next week. (i'm off now..:)
In my python caller script I can not access to feature outside of the function checkViewer(). I would like to be able to access it in the Index() class. How can I make the feature as a global variable? import fmeobjects import json import matplotlib.pyplot as plt from matplotlib.widgets import Button from descartes import PolygonPatch def checkViewer(feature): BLUE = '#6699cc' geometry = feature.getAttribute('_geometry') geoJson = json.loads(geometry) fig = plt.figure() ax = fig.gca() ax.add_patch(PolygonPatch(geoJson, fc=BLUE, ec=BLUE, alpha=0.5, zorder=2 )) ax.axis('scaled') callback = Index() axprev = plt.axes([0.7, 0.05, 0.1, 0.075]) axnext = plt.axes([0.81, 0.05, 0.1, 0.075]) bnext = Button(axnext, 'Garder') bnext.on_clicked(callback.garder) bprev = Button(axprev, 'Rejeter') bprev.on_clicked(callback.rejeter) plt.show() class Index(): def __init__(self):
According to the docs when using FMEServerWorkspaceRunner you can specify the value of published parameters to be a value from attributes of the feature that triggered the job: "Any published parameters associated with the server workspace must be given values. These values can be taken from attributes of the feature that triggered the job to be submitted, or can be typed in (in which case they will be the same for each job that is sent via the transformer)." But I can't seem to find how this is actually done in Workbench. The wizard page lists my published parameters but does not have the usual drop-down arrow to allow me to specify the feature attribute to assign as the value. I also tried setting the value using the macro @Value(attribute_name) but all that did was pass through the string. So is this an error in the docs or am I missing something obvious? FME Desktop 2013 and FME Server 2013
Hi Guys, yu, its met again. I have a question. If i do this $(DestDataset_CSV) as a scripted parameter and tcl script: $FME_MacroValues(Outputdir)\\\\$FME_MacroValues(csv_name).csv (just a simple concatenation) Then $(DestDataset_CSV) ends up like Outputdir\\csv_name the extension is missing. Only when i add this extension to $FME_MacroValues(csvl_name) =filename.csv i get Outputdir\\csv_name.csv wich is correct. Why is this? (in this case i wanted the user not to have to enter the extension, though i changed my mind on that point already..;) Also i have boiled down the issue by Robbie B Creating dynamic attributes per "fme_basename" to just this It consist of 3 workspaces, 2 of wich have callers, an intricate parameter construction, 2 startups and one shutdown script. Now one can pick a directory and read files and their attributes straight to (in this case) excell. I think this workspace might inerest you all because it shows a workaround on the issue of dy
I have a workflow which has 1. Genereric Reader 2. Sampler - Which will send onle 1 feature 3. GeometryFilter- To decide geometry type of source data possible values are Polygon, Point and non-geom data Now I have 3 different workspaces for above 3 conditions. To decide which workspace to run I have written a shutdown python script which will run WorkspaceRunner and it will decide which workspace to run. but I am not able to use vaiable I set in workflow to decide the workspace. In short I need to use variable defined in workflow in Python script? Note: I don't want to use WorkspaceRunner as I am publishing this to FME server.
Hi all, I have a workspacerunner that calls a very basic workspace. All this workspace does is call a csv and writes it to a Excel file. I parametrized the outputdirectory and output filename. Strange thing is, when i use "Directory(output)" and "Filename (output)" parameters, no parameters appear in the workspacerunner. When i use "choice or text" parameters for both variables; no parameters appear in the workspacerunner. But..when i use both, finaly parameters appear in the workspacerunner. See pic. But this is ugly : I want just one set. Now i have solved this by making 1 set (the "choice or text" ones) private parameters so they don't show in the workspacerunner parameters. Anyone know how i can tackle this, just on set without need to hide some by making them private?
Hi guys! I'm finding it quite difficult to figure out how to dynamically produce attributes per my "fme_basename". So let me explain what I have, and what I want. My source is a folder with multiple undetermined shape files in. My output is a .xls file that simply lists the attributes present for each shapefile within my source. So in other words, my writer fans out by "fme_basename". Everything works fine, but instead of each shapefile being represented by a new tab, I'd like for them all to be on one page, in other words, an attribute created for each shapefile found. The intent of the entire workspace is just to summarise all shapefiles for the user, so that they can ensure all fields that should be present are, for each shape file. So what I have is: "ATTRIBUTES" (The field I created that lists all present fields) Type Name level etc [Roadnetwork] (This is the tab in the xls) This is present for each tab generated, where each tab is named
Hi, I am using FME Desktop 2013, Build 13448 to try and complete the following workflow. Read in CSV's from a directory; as these have have differing numbers and names for attribute fields, before I complete the required processing. NOTE that all input files will have the 3 required I need even if they are named differently (extra fields can be ignored). I had planned to create a lookup.csv to manage the mappings and then use the schema mapper to read in the Survey CSV and the lookup csv and then create an output with only the 3 required fields with the new names. However, I must be doing something wrong as it is not working as imagined. Input Survey examples: File1 Schema EAST,NORTH,HEIGHT File2 Schema easting,hei,Nothing,date,time File3 Schema X,Y,Z,Time Lookup,csv old,new EAST,NEW_EASTING easting,NEW_EASTING X,NEW_EASTING NORTH,NEW_NORTHING Northing,NEW_NORTHING Y,NEW_NORTHING HEIGHT,NEW_HEIGHT hei,NEW_HEIGHT Z,NEW_HEIGHT expected output NEW_EASTING,NEW_NORTHING,NEW_HEI