Creating and organizing workspaces. How to use Workbench.
Recently active
I need to import shape data into MS SQL spatial database from various file geodatabases. My workspace will be published on the FME server where .net service will call it.The structure of the fgdb is always the same shape_length, shape area and AO number.The feature class name is different in each fgdb. Is there a ways I can have global user parameter to read any feature class name from fgdb???The other choice I would have is to receive the feature class name from the API service and pass as user param but I am not sure if this would work. Any suggestion??@hcode@takashi
Hi!I have an Ubuntu 16.04 VM on Amazon EC2 and installed FME there. Due to compatibility issues, it is not possible for me to get a GUI when establishing a remote connection the the VM. I developed some FME workspaces on another computer and want to run them on the Ubuntu VM. As one of the workspaces uses an ArcGIS Online Reader, I need to add a web connection to the FME installation.However, I haven't found a way to accomplish that without a GUI so far. Is it possible to add the web connection thorugh the command line? Or Can I add the web connection in FME installation from another computer (with GUI) and copy a specfic config file to the other installation?Thanks in advance for any suggestions!Greetings, André
Hi,I have a production server that is mission critical and I cannot impact performance. Unfortunately there is no mirroring or a secondary server I can access and it's hitting the production server or nothing. In reading from this server, I cannot impact that servers performance in any manner...fortunately I can schedule this in the evening when it's load is minimal, however I cannot impact the performance of this server for that minimal load.Does FME have any methods of 'running in the background' where it reads from the server only when it's resources are free (or minimally used)? Or diffrent wording...Is there any method I can use to ensure FME doesn't impact production performance while extracting data from a production server?MSSQL 2008 (source) to a Oracle 12c DW if that makes any difference for this question.Thanks!
recently I try to use Job id to check status of my submitted job on FME Server, based on FME Server Playgound, I try to use Get method to call this url: http://apptest:8080/fmerest/v3/transformations/jobs/397; this case job id is 397, authentication use token, I use browser of postman both get results:"message": "null for uri: http://apptest:8080/fmerest/v3/transformations/jobs/397". If I login FME Server, I can see the job is finished success. My question is how to get "STATUS", "RESULT DATA" information as attached below image. Thank you very much.
Hello, I am developing workbenches that will process the input data depending on certain conditions. I am publishing to FME server so that it can be used in Java application. I would like to know is it possible to pass any meaningful error message if data is not what is expected. I don't have a clue how I could achieve this. Any pointers in right direction?
I want to keep the attributes of Sentinel downloaded images for AWS server and view them in a shape (or kml) file with the footprint. What are the transformers that keep the attributes from AWS search also and in vector transformation? Thanks
Good afternoon everyone,I have one question regarding FME Server security. I am using FME Server 2014 with an Oracle database. Normally when we create a user in FME Server, the user is create in table FME_USERACCOUNT with an encrypted password. Now I have an issue that one of my web services have to access FME Job so my web services need username / password for basic authentication. Now I have two options either I store password in some local storage with my web service or my web service access Oracle schema fmeserver and get password for user. If i can have decrypted password, the management will be very simple for me. Can anyone guide me, may be I am missing some basic point over here. I don't have AD in my infrastructure. Can you please guide me ? Regards
I'm trying to improve a tool to process Ordnance Survey MasterMap data, and I've been trying WorkspaceRunner as a way to speed things up. The eventual goal is to have a Data Interop tool we could give to customers, have them fill in the bare minimum of data, and set it running without having to know much about what it's doing.The problem I'm running into is that I can't pass in parameters to set the location of the workbench that I'd like WorkspaceRunner to use and set the Parameters for that workspace; WorkspaceRunner can't look up the required parameters until the workspace is set, and because we can't know where the user will put the tool in a folder structure, it can't be hard-coded. I've tried setting the workspace, setting the parameters, then removing the workspace, but it didn't like that at all.There is an extra complication with Data Interop - FME will adjust the filepaths when the workbenches move, so long as the relative filepath
Hi Experts. I have an excel table 'lookup'(attached) with 2 sheets accounting and count. I want to add a column number in the count table wherein the value of number would be from the value attribute from accounting table with respect to the count attribute.I have tried using a combination of sorter, counter, lists and aggregator but didn't get the desired results. May be I had tried somewhat other way.Thanks.
I have a workspace that has several WorkspaceRunners running in sequence. If the workspace in the first WorkspaceRunner writes nothing, no need to run the remaining WorkspaceRunners. But how I can pass the number of the writes of the first workspace to the parent workspace?
I have written a custom reader and writer in C++, and have copied the .dll, .fmf, and .db files to <fme-home-dir>/plugins (and also to <fme-home-dir> as a second try); but neither the reader nor the writer lists show it as an option. We are a member of the developer partner program, and would appreciate a nudge in the correct direction. Thank you!
I'm trying to use a python caller within a custom transformer that is nested inside another custom transformer.With just a single custom transformer I'd use: paramVal = str(FME_MacroValues[MyCustomTransformerName_MyParameterName])to get the parameter value inside the custom transformer. However when this custom transformer is nested inside another custom transformer, this naming convention doesn't work - I get a python exceptionPython Exception <KeyError>: 'MyCustomTransformerName_MyParameterName'The combination of both custom transformer names throws an errorparamVal = str(FME_MacroValues[MyContainingCustomTransformer_MyCustomTransformer_MyParameterName])Using just the parameter name as follows gives me the value from the parent workspaceparamVal = str(FME_MacroValues[MyParameterName])while using concatenating the name of the containing custom transformer gets parameters from within that transformerparamVal = str(FME_MacroValues[MyContainingCustomTransformer_MyParameterName])Is
in my fmw file there are many number of rows updating using database transformer. after thousands of rows fme hangs and not responding. i suspect this happens because database updater not comming after some interval i think. how to pass the value for commit transaction. or did database updater committing by default after some rows?please tell me how to pass the commit/ transaction value to database updater ?
Is it possible to upload data, that has been modified, to Amazon S3 from within the workspace that is modifying the data? For example, I have a workspace that reads in single-band landsat imagery (as GeoTIFFs), processes the images, and combines them into composite images. Instead of writing the combined-band images locally, I want to upload them to Amazon S3. I tried using the S3Uploader in the same workspace, after the image processing transformers, but the data source options for the S3Uploader seem to be limited to existing files or expressions - I ended up uploading the original single-band images, rather than the processed images... Is it possible to upload the processed images directly to AmazonS3 without having to write them locally first (using FME Desktop)? Thank you! Courtney
Hi, I would like to use PythonCaller to generate a new attribute, but I don't know what the attribute name will be until it is set within the Python Script.How can I expose an attribute in the PythonCaller without knowing its name in advance?I am using FME2016 Desktop.Thanks,
Hi,I try to load oracle tables dynamically and export them with a dynamic writer (sqlite).It seems to work, but one area is always missing.When I tried to re-create the source table, another area was systematically missing.When I tried to read from another tables (also with areas) again one area was always missing.Is it something I'm doing wrong or is this a bug ?Details about the script : Thanks !
Hi All, How do i find the abs MAX value of a list.? (ie MAX(ABS(list[-4,-2,1,3))) would return 4Thanks
What do fme_dataset, fme_basename, and fme_feature_type values provide for various formats and how do I get the name and path I need.
Are web connections different from database connections when uploading to FME Server 2017? I have a named connection that I've already uploaded. When publishing, it shows as needing to be uploaded again. But when I try to upload it it says "Named connection already exists". When I uncheck the upload box it says "connection will be unavailable on FME Server". It looks like if I publish the workspace and ignore the "connection will be unavailable" message, it still works. Is this a known issue in 2017.1? I'm using Build 17539. @SteveAtSafe
I noticed that I cannot use parameter values inside the DatabaseJoiner. Am I missing something? An example:When fetching a user parameter to use it is an attribute, the DatabaseJoiner joins another attribute from an excel file to my feature (upper part in the screenshot). When using the user parameter directly to join attributes from an excel, the transformer parameter button shows red and there is not output. The user parameter has its property 'Attribute Assignment' set to 'Default'. I found no relevant information on the forum or in the documentation of the DatabaseJoiner. Could anyone come up with a reason? The workaround using a ParameterFetcher solves the problem easily, but I was wondering why it is not possible to use a parameter directly. I am using FME 2017.1.0.0 (Build 17539 - WIN64). In the zip file you can find my example workspace and data.
I am using ArcGIS 10.3 with Data Interoperability. I am creating new attribute fields within my processes but the data will be loaded later so I need to define the data type parameters within the workbench prior to data load. Some of the attributes will be strings (varchar) of various lengths and some will be integers or dates. I cannot find AttributeManager as an option within DI. Is there another way of defining the attribute fields?
We have a 4 vcpu server and just added a 4th engine. When all 4 engine run concurrently, CPU usage goes up 100%. In order to optmize performances, should we add core to our vCPU or add vCPU. My understanding is that an engin runs on only one core, therefore adding vCPU wouldn't help, wheras adding core to a vCPU could help optmize parallel processing?Tks.
Hi, I am creating a workbench that executes an sql query (select query) and writes the results to an MS SQL table. I would like to write the contents to an email. I have used the shut down python script before (emailing after workbench has run successfully and writes the number of features written) but I cannot find resources in writing the contents of what has been written to the SQL table. I have four rows and with four fields that gets appended every time the workbench is run. Is there a way to parse these values to the email? Thank you.