Creating and organizing workspaces. How to use Workbench.
Recently active
Hello,I wonder if anyone has experience in both FME and Pentaho. I have several years experience in FME, but know nothing about Pentaho.Currently our team of Pentaho users considers the switch to FME. I have shown the possibilities and when it comes to functionality, FME seems very promising! However, Pentaho seems to be 6 times faster than FME... This might be a showstopper and we want to know whats is causing this. Does anyone have experience to get better performance writing to (or reading from) Oracle datasets? I never had the experience that FME is slow in reading/writing to Oracle, but when I see the speed of Pentaho, I was surprised of its speed.We did a test of a ETL-script that reads about 912.000 records from an Oracle Database and writes the result directly to another Oracle table. In short: SQLCreator (type Oracle) --> FeatureWriter (type Oracle). Duration in FME: 5 - 6 minutes; duration in Pentaho is about 45 seconds. We were reading and writing to the very same databas
I'm trying to format a human readable date time and I want to include the seconds but nano seconds are a bit much. As far as I can tell there is no date time flag which is just seconds without the fractional seconds so it seems like you need to remove them with a non-datetime tool. Am I missing something? Date times were created using the DateTimeNow function.
Hi, I am using a pythoncaller in FME to convert the KML color from the linestyle (a string, hex ABGR) to a C# Color (ARGB 32 bits integer) (see workbench) KML doc Colorstyle (https://developers.google.com/kml/documentation/kmlreference#colorstyle): For example, if you want to apply a blue color with 50 percent opacity to an overlay, you would specify the following: <color>7fff0000</color>, where alpha=0x7f, blue=0xff, green=0x00, and red=0x00. (ABGR !) With FME Desktop under Windows (2021.2.4), this works well. => 2022-03-29 18:00:28| 0.6| 0.0|INFORM|Attribute(32 bit integer) : `line_color' has value `-16733441' Running this workbench on the Linux FME server (docker install!) gives different results. => 2022-03-29 16:01:14| 0.2| 0.0|INFORM|Attribute(64 bit integer) : `line_color' has value `4278233855' I have some questions here: 1) Why does this happen?2) How do I solve this?3) Is there a more elegant and consistent way to accomplish
fme_dataset and fme_basename attributes are there when read normally, but not when read with a FeatureReader.
I am trying to read metadata in FGDC format from a feature class using a python script and workspace runner to call in a workbench. I want to know how I can set a parameter to call a feature class from a geodatabase.
How can I reference the CSV created from a Writer to upload to AWS S3 using S3Connector? I can successfully use a Reader to reference a file on my computer and upload to AWS S3 using my Web Connection and S3Connector, but I don't know how to reference a newly created file within my worflow. See attached.
Hi,For some time, I used the following approach to open a KML dataset (both in Desktop for development, and in Server for operational use, version 2020.1.0.1, both running on Windows (server) OS): Create a public parameter "INPUT_FOLDER"Create a public parameter "INPUT_FILE"Add a KML Reader for a specific KMl file to the workbench, which defaults to a public parameter "SourceDataset_OGCKML"Make this a private parameter, and change the definition to: "$(INPUT_FOLDER)\$(INPUT_FILE)" I then use either UNC or local paths in the INPUT_FOLDER to point the reader to the correct location. Last week, we started migrating to 2021.2.4, which I installed on my workstation (windows). For the sake of completeness I think I should mention we are targeting an FME server running in a docker container on a linux host. This approach stopped working, with the message :2022-03-19 14:58:52| 0.8| 0.0|INFORM|Loaded module 'OGCKML' from file 'C:\Program Files\FME\2020.1.0.1\plugins/KML21.dll'2022-03-19 14:5
I have a set of points (>100) and I want to calculate a cost raster along a network fpor each point. For 1 point I can do this by:point > netyworkcostcalculator>surfacemodeller. However when I use multiple points the networkcostcalculator only outputs disconnected features (also when using 'group by' point ID). But even if it would have an output, the output does not contain an pointID attribute, so I can not use the group by option in the surface modeller. Is there an easy way to calculate a cost raster for more then 1 point?
Is there a DotNET sample to develop a custom Factory ?
I have a test Shapefile with 19 roads/segments. I want to merge all segments that are shorter than 200m with the shortest adjacent segment, and use the attributes of the adjacent segment for the new road segment. I've got most of the logic working, but can't get it to loop until there are no more segments less than 200m in length. The attached workspace shows one iteration going from 19 records to 18 records. Any pointers as to where I'm going wrong appreciated!
i converted my shape file to tiff which is basically a road layer of an area. That shp contain a name attribute which shows the road names. I want that name to display on tiff image. Pls guide me
I have created a workspace with the help of Mr. Takashi(a person from this forum) that reads the shapefile ,creates buildings then these buildings are separated in storeys and then the storeys are separated in roof,ground and wall surfaces. All this work is attached.I want to find a way to write this information in CityGML (Lod 2).In conclusion i want a workspace that gives me a CityGML writer with the buildings.
I have FME Server running on Machine A. (Engine within this docker compose is working) Now I want to have my engines running on a different machine. I've setup the following docker compose on Machine B (Engine host)version: '3.2'services: fmeserverengine: user: 0:1363 image: quay.io/safesoftware/fmeserver-engine:2019.0.1-20190506 volumes: - '/fmeserverdata:/data/fmeserverdata' restart: always environment: - EXTERNALHOSTNAME=${FME_HOST} - EXTERNALPORT=${FME_PORT} - WEBPROTOCOL=${FME_PROT} hostname: fme-enginserver-engine-1 extra_hosts: - "fmeserverdb:${FME_HOST_IP}" - "fmeservercore:${FME_HOST_IP}" In addition, I mounted the /data/fmeserverdata from Machine A, on Machine B (/fmeserverdata). When I start the engine container on Machine B, I can see the logs from Machine B using the webinterface on Machine A. (/resources/logs) However, When I spin up the container, the only error I see is the following:FME 2019.0.1.0 (20190506 - Build
Hello everybody, For the sake of the question, my computer is a MacBook Pro (13-inch, Mid 2012) equipped with a 2.5Ghz Dual-Core Intel Core i5 processor, 8Gb 1600 Mhz DDR3 of memory and a 1Tb SSD. I am authoring a workspace from NONE to CITYGML.It uses some HTTPCaller transformers to get datasets from a WFS, based on locational user attributes (lat long of the center point and cardinal offsets for the model extents)It models LoD2 trees, LoD2 buildings and LoD1 relief in compliance with the GML 2.0 schema, including appearance and X3D materials.It finally writes all features in a CityModel, which is composed of several feature types on FME (CityModel, Building, Building Parts, etc...) The workspace runs without any errors when feature caching is enabled, and it delivers all features validated according to the CityGML schema. Examples:Center point -23.593186, -46.669269, offset 50m to all cardinal directions.Same center point, offset 100m to all cardinal directions. The problem rises whe
Canadian Cities Open Address Data Attaching a sample FME workspace that shows how to import open address data from various Canadian municipal websites, and other authoritative sources. If there are additional Canadian open address data sources that you can find, please contribute to enhancing this.
If I leave them blank I get an empty string inserted into my database (postgis) - I really want Nulls
I'm playing around with security settings and it seems that if you password protect a custom transformer, it still spews out info in the logs from the internal guts of what's going on. Is there a way to prevent the internal guts of a custom transformer from being logged? Ie. I just want to show the input and output of the transformer. Is that possible? Seemed maybe like it was from this article https://community.safe.com/s/article/password-protection-for-fme-workspaces
Hello, I'm working with FME2020. I want to import several excel files with the same schema from one folder as different features. With a xlsx-reader (select multiple folders/files) all files are written in one feature. With a path reader I can't define a schema. Is there a way to read all the files with one reader or do I have to use one reader per file? Thanks in advance
I received a geopackage named "test.GPKG". When I set up a reader I select OGC GeoPackage as format and browse for the dataset. I select "test.GPKG" and click "Parameters" to select the tables. But then I get a error message that no such file exists. FME does not recognise the extension when written in capital. In the message FME is looking for "test.GPKG.gpkg". Solution: rename dataset to extention with lowercase letters. Like "test.gpkg". Then the tables are shown. Question: Is this behavior wanted? Or should FME also recognise the extension written in uppercase letters? Freek
Now and then I have a need to postprocess data written by a FME Server Data Download Service. In good old days (FME Server 2015) it was possible to do this in the Python Shutdown Script. Nowadays the results are obviously auto-zipped by the writers when running the Workspace on FME Server as a Data Download Service. I have not yet found any way to postprocess the results, as they are already zipped and the result filename is unknown (in the Workspace) when the writer has finished its job. My simple example substitutes some text in the file written by the FeatureWriter. This is necessary because of some limitation in the Writer itself. Everything works perfectly well in FME Desktop. In FME Server, published as a Data Download Service, the AttributeFileReader does not find the file returned by the _dataset attribute in the Summary port. Obviously because it is already zipped and removed by the Writer. Any ideas?
I have data that would need to be loaded into different tables. But I need to load them to load in a specific table order because of foreign key constraint. I have put on a connection runtime order which only controls the very next transformer. One of the data paths has a statistics calculator so i thought if i put a statistics calculator on the path that needs to be loaded last, this would give me the order I need but they are still going first.The first 2 are going in at the right order. The 3rd has the statistics calculator. It also has a tester where only the records that passed will be in the statistics calculator. The records that failed do not need to go anywhere. Also, all records can fail the tester. In that case, no related IDs are created for the 4th table so then the Foreign Key Constraint is not violated.I added 2 feature Holders and 2 statistics calculators on the 4th path hoping the 3rd path will finish first, but the statistics calculator for the 3rd path would stop, an
Right now I have several parameters accepting a single attribute selection and a published user parameter that accepts multiple attributes (basically you select all the ones you selected above). I want to use a single duplicatefilter transformer to filter out duplicates of the several user parameters that have already been provided.
Dear FME users, I have the error: Error decrypting data. Most likely this is because the encryption key is incorrect. Please contact your administrator to retrieve the correct encryption key. System;Remote environment: Windows Server 2012 R2 machines with RDP (remote desktop)The workspace is managed by RES/Ivanti v10.2. with separate autorisationEnvironment variables for Oracle on serverPath=C:\\ProgramData\\Oracle\\Java\\javapath;C:\\Windows\\system32;C:\\Windows;C:\\Windows\\System32\\Wbem;C:\\Windows\\System32\\WindowsPowerShell\\v1.0\\;I:\\APP\\Oracle\\Client11g\\X32\\Client\\binTNS_ADMIN=I:\\APP\\Oracle\\network\\admin and FME: PATH=I:\\APP\\Oracle\\client11g\\x64\\11.2.0\\client_1\\bin;%PATH% The netwokdisk "I" is mapped for every employee. Collegue:With 2 colleges we work with FME.In FME options we have the following in Default Path:Connection Data Directory : I:\\APPDATA\\FME\\FME_ConnPublic key file : I:\\APPDATA\\FME\\FME_Conn\\fme_publicKey.jceksPrivate key file :
I am struggling to read two geometry columns from this database. If I set Handle Multiple Spatial Columns to "No", it only gives me one of the two columns. If I set it to "Yes", then I get the above error. What does it mean to have a "Custom SQL SELECT statement"?Mine is nothing fancy:select building_id, floor_id, space_id, agency_code, space_type, space_category,usable_sq_ft, obj.objgeom, SDO_UTIL.interior_point (OBJ.objgeom) from esm.esmobject obj join esm.att_space ats on obj.IDOBJECT = ats.IDOBJECT where building_id = 'BD0303' and floor_id = '01' It was also difficult to retrieve data tables. I had to type in each one. Luckily there were only two. If I let FME search for tables, it errors:My connection seems fine. I am able to access all tables and do more complicated queries in SQL Developer. Any info is appreciated. Thanks, Loren