Creating and organizing workspaces. How to use Workbench.
Recently active
Hello, I am developing workbenches that will process the input data depending on certain conditions. I am publishing to FME server so that it can be used in Java application. I would like to know is it possible to pass any meaningful error message if data is not what is expected. I don't have a clue how I could achieve this. Any pointers in right direction?
I want to keep the attributes of Sentinel downloaded images for AWS server and view them in a shape (or kml) file with the footprint. What are the transformers that keep the attributes from AWS search also and in vector transformation? Thanks
Good afternoon everyone,I have one question regarding FME Server security. I am using FME Server 2014 with an Oracle database. Normally when we create a user in FME Server, the user is create in table FME_USERACCOUNT with an encrypted password. Now I have an issue that one of my web services have to access FME Job so my web services need username / password for basic authentication. Now I have two options either I store password in some local storage with my web service or my web service access Oracle schema fmeserver and get password for user. If i can have decrypted password, the management will be very simple for me. Can anyone guide me, may be I am missing some basic point over here. I don't have AD in my infrastructure. Can you please guide me ? Regards
I'm trying to improve a tool to process Ordnance Survey MasterMap data, and I've been trying WorkspaceRunner as a way to speed things up. The eventual goal is to have a Data Interop tool we could give to customers, have them fill in the bare minimum of data, and set it running without having to know much about what it's doing.The problem I'm running into is that I can't pass in parameters to set the location of the workbench that I'd like WorkspaceRunner to use and set the Parameters for that workspace; WorkspaceRunner can't look up the required parameters until the workspace is set, and because we can't know where the user will put the tool in a folder structure, it can't be hard-coded. I've tried setting the workspace, setting the parameters, then removing the workspace, but it didn't like that at all.There is an extra complication with Data Interop - FME will adjust the filepaths when the workbenches move, so long as the relative filepath
Hi Experts. I have an excel table 'lookup'(attached) with 2 sheets accounting and count. I want to add a column number in the count table wherein the value of number would be from the value attribute from accounting table with respect to the count attribute.I have tried using a combination of sorter, counter, lists and aggregator but didn't get the desired results. May be I had tried somewhat other way.Thanks.
I have a workspace that has several WorkspaceRunners running in sequence. If the workspace in the first WorkspaceRunner writes nothing, no need to run the remaining WorkspaceRunners. But how I can pass the number of the writes of the first workspace to the parent workspace?
I have written a custom reader and writer in C++, and have copied the .dll, .fmf, and .db files to <fme-home-dir>/plugins (and also to <fme-home-dir> as a second try); but neither the reader nor the writer lists show it as an option. We are a member of the developer partner program, and would appreciate a nudge in the correct direction. Thank you!
I'm trying to use a python caller within a custom transformer that is nested inside another custom transformer.With just a single custom transformer I'd use: paramVal = str(FME_MacroValues[MyCustomTransformerName_MyParameterName])to get the parameter value inside the custom transformer. However when this custom transformer is nested inside another custom transformer, this naming convention doesn't work - I get a python exceptionPython Exception <KeyError>: 'MyCustomTransformerName_MyParameterName'The combination of both custom transformer names throws an errorparamVal = str(FME_MacroValues[MyContainingCustomTransformer_MyCustomTransformer_MyParameterName])Using just the parameter name as follows gives me the value from the parent workspaceparamVal = str(FME_MacroValues[MyParameterName])while using concatenating the name of the containing custom transformer gets parameters from within that transformerparamVal = str(FME_MacroValues[MyContainingCustomTransformer_MyParameterName])Is
in my fmw file there are many number of rows updating using database transformer. after thousands of rows fme hangs and not responding. i suspect this happens because database updater not comming after some interval i think. how to pass the value for commit transaction. or did database updater committing by default after some rows?please tell me how to pass the commit/ transaction value to database updater ?
Is it possible to upload data, that has been modified, to Amazon S3 from within the workspace that is modifying the data? For example, I have a workspace that reads in single-band landsat imagery (as GeoTIFFs), processes the images, and combines them into composite images. Instead of writing the combined-band images locally, I want to upload them to Amazon S3. I tried using the S3Uploader in the same workspace, after the image processing transformers, but the data source options for the S3Uploader seem to be limited to existing files or expressions - I ended up uploading the original single-band images, rather than the processed images... Is it possible to upload the processed images directly to AmazonS3 without having to write them locally first (using FME Desktop)? Thank you! Courtney
Hi, I would like to use PythonCaller to generate a new attribute, but I don't know what the attribute name will be until it is set within the Python Script.How can I expose an attribute in the PythonCaller without knowing its name in advance?I am using FME2016 Desktop.Thanks,
Hi,I try to load oracle tables dynamically and export them with a dynamic writer (sqlite).It seems to work, but one area is always missing.When I tried to re-create the source table, another area was systematically missing.When I tried to read from another tables (also with areas) again one area was always missing.Is it something I'm doing wrong or is this a bug ?Details about the script : Thanks !
Hi All, How do i find the abs MAX value of a list.? (ie MAX(ABS(list[-4,-2,1,3))) would return 4Thanks
What do fme_dataset, fme_basename, and fme_feature_type values provide for various formats and how do I get the name and path I need.
Are web connections different from database connections when uploading to FME Server 2017? I have a named connection that I've already uploaded. When publishing, it shows as needing to be uploaded again. But when I try to upload it it says "Named connection already exists". When I uncheck the upload box it says "connection will be unavailable on FME Server". It looks like if I publish the workspace and ignore the "connection will be unavailable" message, it still works. Is this a known issue in 2017.1? I'm using Build 17539. @SteveAtSafe
I noticed that I cannot use parameter values inside the DatabaseJoiner. Am I missing something? An example:When fetching a user parameter to use it is an attribute, the DatabaseJoiner joins another attribute from an excel file to my feature (upper part in the screenshot). When using the user parameter directly to join attributes from an excel, the transformer parameter button shows red and there is not output. The user parameter has its property 'Attribute Assignment' set to 'Default'. I found no relevant information on the forum or in the documentation of the DatabaseJoiner. Could anyone come up with a reason? The workaround using a ParameterFetcher solves the problem easily, but I was wondering why it is not possible to use a parameter directly. I am using FME 2017.1.0.0 (Build 17539 - WIN64). In the zip file you can find my example workspace and data.
I am using ArcGIS 10.3 with Data Interoperability. I am creating new attribute fields within my processes but the data will be loaded later so I need to define the data type parameters within the workbench prior to data load. Some of the attributes will be strings (varchar) of various lengths and some will be integers or dates. I cannot find AttributeManager as an option within DI. Is there another way of defining the attribute fields?
We have a 4 vcpu server and just added a 4th engine. When all 4 engine run concurrently, CPU usage goes up 100%. In order to optmize performances, should we add core to our vCPU or add vCPU. My understanding is that an engin runs on only one core, therefore adding vCPU wouldn't help, wheras adding core to a vCPU could help optmize parallel processing?Tks.
Hi, I am creating a workbench that executes an sql query (select query) and writes the results to an MS SQL table. I would like to write the contents to an email. I have used the shut down python script before (emailing after workbench has run successfully and writes the number of features written) but I cannot find resources in writing the contents of what has been written to the SQL table. I have four rows and with four fields that gets appended every time the workbench is run. Is there a way to parse these values to the email? Thank you.
The attached workspace demonstrates the problems I'm having with @ReplaceRegEx and user parameters. What I'm trying to do is create an output folder name QC within the folder where the input dataset is located.I've created a private user parameter named OutputFolder of type Folder (output) and set it's default value to:@ReplaceRegEx($(SourceDataset_MAPINFO),"^(.+)\\.+$","\1\QC")The intent of the workspace is to simply read the input dataset, create the output folder QC within input dataset folder, and finally write the input dataset to the output folder.When I run the workspace I get the following error messages:Could not create output folder `@ReplaceRegEx(C:\temp\InputGeometries.tab,^(.+)\.+$,\1\QC)' for use by MAPINFO writerCould not create output folder `@ReplaceRegEx(C:\temp\InputGeometries.tab,^(.+)\.+$,\1\QC)' for use by MAPINFO writerDestination Feature Type Routing Correlator(RoutingFactory): Could not create output folder `@ReplaceRegEx(C:\temp\InputGeometries.tab,^(.+)\.+$,
The title says all: what's the best way to send features to a WorkspaceRunner?I tried to use a WKT but for a reason I don't get, it add some `--` in parameters and the WKT received is invalid:Command line arguments are `C:\Program Files\FME2016\fme.exe' `./pg2dxf_reseau_eau.fmw' `--Perimeter' `POLYGON ((507248 137339' `--507484 137669' `507865 137441' `--507629 137111' `507248 137339))'...WARN |Invalid WKT encountered: POLYGON ((507248 137339
I have a database of shared connections in FME. I can use that to share my public database connections with coworkers, but they cannot edit that file (I believe this is because it's encrypted with my key). That's fine, but as a result - the person using my shared database/web connections can't create their own personal connections anymore without switching back to their own user database. Switching back and forth from the shared file to their own file seems like a pain. Are we doing this right? Is there a better way to do this now?
I want to extract a UK postcode from a free-format address field, but only if there is one.I am using the AttributeManager transformer with a new output attribute value: @Substring(@Value(OriginalAddress),@FindRegEx(@Value(OriginalAddress),"[A-Z][A-Z][0-9][0-9] [0-9][A-Z][A-Z]"),8) This works but I am getting unwanted results where a UK postcode is not found.An important point is that OriginalAddress is a derived output attribute: @UpperCase(@Value(OccAddress1) @Value(OccAddress2) @Value(OccAddress3) @Value(OccAddress4) @Value(OccAddress5))I would like to say something on the lines of: If there's a postcode then get postcode else don't bother.Is this possible without resorting to using a python transformer? Trying to set a Conditional Value in AttrubuteManager does not work in this case as only the original input attributes are recognised in the Output Values builder of the Test Conditions (that is, it's only seeing the OccAddressN fields).