Creating and organizing workspaces. How to use Workbench.
Recently active
FME 2016 (but happens in 2017 too).A simple workflow:Input -> Dissolver -> Aggregator ->OutputBoth the Dissolver and Aggregator are set to group by an ID, the features are ordered by that ID, and the transformers are set to know this. Parallelism is off for the Dissolver. The result is that features flow smoothly through the workflow, and there is no caching of features at any point. Exactly as desired.However, if I then change the Dissolver to use Parallelism (any level) (to see if I get more speed), and change nothing else, this flowing stops. Now, all features appear to be cached by the Dissolver after the dissolving process has finished by the child threads, and are only released to the Aggregator at the end of the workflow.Anyone else experience this? Is this the expected behaviour? I can't see anything in the docs about the Input Ordered and Parallelism being mutually exclusive, but maybe I missed it.
Hello Everyone,I would like to build a workflow that would prompt users to enter a range (or ranges!) of time (HH:MM:SS to HH:MM:SS) that would be used as a filter an Excel sheet for rows within the ranges. Unfortunately, the AttributeRangeFilter will not permit this time format and I do not want to ask the user to convert to Epoch Time themselves. Any helpful advice will be appreciated
I'm having a bit of a struggle with batch processing of images. I have a set of (usually iPhone) inspection images with GPS coordinates that are to be downscaled and put into a MapInfo TAB as points with a hotlink field containing filename. Using either the JpegGPSPointreplacer (or with Stringreplacer and Expressionevaluator both) works - when I'm using workspace. But, when I batch deploy the workspace the factory pipeline empties between each image and then restarts, effectively overwriting the TAB-file with only the last processed image. Scaling works great using Rasterresampler. The result being a lot of downscaled images and a TAB-file with only one point, containing the last processed image. What have I missed?
Is there a way to export a list of scheduled jobs from FME Server to a txt file or some other format?Thanks in advance.
What I think have in inspector is list. But for some reason FME is thinking its not, because ListElementCounter is not finding it.Someone can explain why so? Its first time for me I have list"ish" features.pic from inspector.
Hi,I try to calculate the difference between to dates. I need the result in Years. From the FME HUb I get the DateDifferenceCalculator. I runs good for difference in days or weeks. But how can I get the result in month or years?
Hello,I am using a FME Server 2014 SP1 with two engines and the corresponding FME Desktop version. We designed a process, which should trigger other workspaces in a specified order, but the complete process should run on only one engine, which is, according to the tutorial, possible and which I could confirm (see list point #4 below). For doing so, we have used the FMEServerJobSubmitter Transformer. Actually our process is very similar to the following tutorial (at least in regard to the technical aspects) https://knowledge.safe.com/articles/1413/fme-serve...Since we are running different services, we need a Job Routing Configuration, which we have realized within the FMEServerConfig.txt:TM_DEFAULT_TAG=default TM_QUEUE_TYPE=DEFAULT# Assign tagTM_REPOSITORY_2=internalProcesses:internalProcessesTagTM_ENGINE_1=Host_Engine1:defaultTM_ENGINE_2=Host_Engine2:internalProcessesTagUsing this config, every workspace in the the "internalProcesses"-repository gets the tag "internalProcessesTag". Fo
Hello,I have this problem when trying to open a directory with a python parameter.The line in my script causing the error:f=open(os.path.join(FME_MacroValues['path_orders'],ftp.nlst()[0]),'w')IOError: No such file or directory: '$(FME_MF_DIR)orders\\\\1234567.WI02290100.vg'How do I tell FME to send the full path as a string and NOT $(FME_MF_DIR)?
Apologies for cross posting. What i'm trying to achieve is from this Excel table ----------------------------------- | Name | Listed_Item | ----------------------------------- | Mr A | [1234] | | Mr B | [6352], [2344] | ----------------------------------- TO ----------------------------------- | Name | Listed_Item | ----------------------------------- | Mr A | 1234 | | Mr B | 6352 | | Mr B | 2344 | ----------------------------------- I using StringReplacer to remove the "[ ]". Beyond that, I not sure how to go abt it. If anyone can just point to me the transformers needed to produce this. Thanks.
HiI have an FME process that uses as its inputs a GDB file and its associated XML schema file. I want to generate the XML from the GDB at runtime, and I have a python startup script to do this in ESRI - this works. My issue is with populating the parameter for the XML reader to set the location (for the generated file). I've read through some of the articles and previous questions, and this one seems to be what I'm looking for, although given I'm not python literate/new to it, I wasn't able to make the solution work for me - apologies for the ignorance. https://knowledge.safe.com/questions/4296/set-published-parameters-in-a-python-startup-scrip.htmlI think I need to add 'import fmeobjects' and 'return ResultsXML' added to my current script (below), but when I do so I get an error about return statement being outside a function. I don't know how to place it inside a function,.. help please. Assuming that works, how do I expose it within FME? I was thi
Hi,In workspace_01 I have a WorkspaceRunner transformer that runs workspace_02 that uses a SQLExecuter transformer. The SQLExecuter utilizes a parameter to receive the Named Connection required (e.g., gisdata_01@SDEDB or gisdata_02@SDEDB, etc..) that's working great.However, the issue happened within the workspace_01 with the WorkspaceRunner, unless I select from the available named connection to assign, the workspace_02 won't work successfully; i.e. assign by 'Attribute Value' or 'User Parameter' from the sub menu.A closer look into the log window revealed how the parameter was interpreted/passed to the workspcase_02 as:--SDE_NAMED_CONNECTION {\\<at>Value<openparen>_Named_Connection<closeparen>}While it should be:--SDE_NAMED_CONNECTION' `gisdata_02@<at>SDEDB' `#FME 2016.1Please help
Hi All,I might be asking a silly question but here it goes:I am trying to pass some records through a Feature Writer and off the back of that pass the unique id of the written records into a SQL stored procedure so I can track it has been written successfully. However if I use the Feature Writer then I lose the attributes in the summary and therefore can't use the unique id in my stored procedure :( Is there a way to expose this attribute so I can use the unique id. I have attached some screen shots.
Hi, Could anyone please help me to transform the 3D object from Revit to ArcScene? I exported the 3D using FME exporter to get RVZ file, however, when I tried to visualize the result in FME data Inspector, the texture of the building wasn't appeared or transformed. I am not sure of the options I have to choose from the Export dialog to export the texture. Any Idea? Also, I transformed the RVZ file as it is (without texture) using FME Workbench Desktop to Shapefile and I have noticed that the multipatch layers for the building didn't come/merge in one attribute in ArcScene, and of course the texture was not appeared as well. Thank you,
Hi guys,I probably can say I'm at the point of being very confident with my skills in using python including libraries such as os, xlrd/xlwt, numpy, arcpy etc. I can create simple to complicated scripts, which can have simple line of codes, or several functions or several class objects and I can pretty much work seamlessly side by side with ArcGIS. In our office we have FME. I am finding it difficult to see any reason why I should use it over my pythonic process. I am thinking if only I encounter a very unique data format that python thru arcpy or another library cant read will I use FME to possibly do some translation. Other than that, any spatial operation I can fully use arcpy. But I don't want my boss to think I'm wasting our investment. I want to use it but cant find anything on the web that will convince me its a practical tool over things I can set up with python.
Folks, first post and rank newbie. I've been using Mapinfo for 25 years and MSSQL for 15 so the basic GIS and query stuff I know well. First time user of FME.I've had a live chat today and the SAFE guys were super helpful but it's clear my lack of understanding of the FME nomenclature has prevented a better outcome.Hopefully I can explain here what I'm after.I have some Mapinfo tables and want to create a GML. That's the easy part. The hard part is that I have a single Mapinfo ID column that could have two different formats. One integer, one alphanumeric. The column is type char.Depending on the value, the ID could be written to a GML tag, techID OR name.My understanding is I use an AttributeManager (I could be wrong) and that I can somehow create a condition that will produce different results.However all the examples I've looked at seem to evaluate the input value, modify the value and insert the modified value into the target field.There doesn't seem to h
I created a custom reader and writer with the wizzards in the reader and writer gallaries. I can install and use the reader, but I can not install and use the writer. Attached the reader, writer and an example file.
This may be more of an idea for an FME enhancement but I'm curious to know if anyone thinks this is possible, or if there's a way to do it...I want to create a truly generic/dynamic workflow. The source and target data and schema requirements can be driven by database tables, as can reprojection requirements. The majority of the time this will likely be sufficient to achieve what we need, however, there may be cases in which a simple source->target mapping is insufficient and we need some custom ETL transformations. Is there any way that the name of a custom transformer can be passed in as a parameter at runtime and have that transformer called during processing?This functionality could be partially met by using the WorkspaceRunner or the FMEServerJobSubmitter but both of those transformers fire up a whole new translation for each feature that enters them. What I really need is a "TransformerRunner" transformer. Something that can dynamically include a (custom) tra
I am trying to update a feature class in sde with a new one. Two of the fields in the existing table are not in the new table so I want to add them to my new table. I have tried featuremerger and not getting the results I want. This seems simple enough but featuremerger isn't copying over the additional two fields. One is modified user and the other is a Gazettedate. Any help would be appreciated to resolve this issue.
I'm trying to run a workspace from the command line and I get an error that the metadata template cannot be read, I am not an FME user and I am coding this for another department in our company. Any help is much appreciated.import osgdbW=r"C:\Users\YouDoWellItDoesGood\Desktop\1701051\DB_TGS_8171_AF2113452_30_C00_00_20170210.gdb"qcWorkspace=r"C:\Transglobal\larry_d_gester_qc_basic.fmwt"def fnRunFromCmd(gdbW,qcWorkspace): os.system("start cmd /c fme.exe C:\Transglobal\larry_d_gester_qc_basic.fmwt --gdbPath C:\Users\YouDoWellItDoesGood\Desktop\1701051\DB_TGS_8171_AF2113452_30_C00_00_20170210.gdb")fnRunFromCmd(gdbW,qcWorkspace)
Related to this post: Datetime: %s / Epoch Time / Unix TimeGreat enhancements regarding date/time manipulation have been done in FME 2017.0, but I think there still is a room to improve the behavior of Date/Time type user parameter on Workbench. 1. Currently (FME 2017.0.0.1), a Date/Time type parameter edit field only accepts a datetime string formatted with %Y%m%d%H%M%S, and rejects decimal places of seconds and a timezone specifier (UTC offset). It would be better if the field could accept datetime representation formatted with Standard FME Date/Time Format, which allows both decimal places and a timezone specifier optionally. 2. Even if you entered a datetime formatted with %Y%m%d%H%M%S successfully, it will appear with a local format in the Navigator window and the re-opened edit parameter dialog. The implicit formatting is also done when selecting a datetime from the date picker tool. It would be better if the datetime would always appear in the parameter field with Standard FME
Hi,When testing a workbench files with a large number of features, is there a way to only test a certain part of the workbench instead of reading through the whole workbench every time you run it, so as to save time?I have access to FME Desktop 2016 and 2017.Thanks
Hello All,Greetings !!I am new to FME tool and wanted to check with you folks here. We have to do a migration of few contents to Documentum, wanted to know the list of meta data files which are supported by it? Could you please help in same, will be grateful to you.Thanks,R. Singh