General

Welcome to your weekly FME News FME AcademyIf you haven’t already, be sure to check out the FME Academy which is our new self-directed online free training platform.  We also just published a brand new FME Academy Trail: Use Data Integration Best Practices where you can learn how to debug workspaces, design workspaces for advanced reading and writing, design for performance, and optimize workspace performance.  Knowledge Base

I have a number of shapefiles which I want to translate to Geopackage.However I want the original shapefile name intact. So just a one on one batch shapefile to geopackage translation I thought that the FME Quicktranslator app would be handy in this situation, however, it asks me to specify a database connection, even though I want all the individually translated shapefiles as separate .GPKG files in a destination folder. In FME Workbench, a specific filename is also required to translate shapefiles into, and there is no way (as far as I can tell) to let this be a dynamic name based on the fme_basename attribute. Note that I do not want to have a single geopackage file with all the shapefiles combined in it. How do I do this? Thanks for your time. 

I have JSON files where every Linestring includes a Point and in some cases Polygons. I want to filter data to find out which Linestrings do not include Polygons and create a JSON file with corresponding Linestrings and Points. I have tried to use the Spatialfilter, but with mixed results. Files containg data below.

Hello, I am having an issue when trying to overwrite a feature layer in ArcGIS Portal. It writes first time fine, but fails to overwrite.A bit of background of what I am trying to. The workbench reads in a ODBC connection, performs multiple joins, creates vertices based off lat and lng, then writes to ArcGIS Portal.  As mentioned, this is writing fine but I noticed an issue when trying to overwrite the file. The error message is: ArcGIS Portal Feature Service Writer: Encountered an unexpected error. The error code from the server was '500' and the message was: 'JSONObject["globalId"] not found.'. Details: ''ARCGISPORTALFEATURES writer: A fatal error has occurred. Check the logfile above for details I have had a similar issue before when performing a similar task, and I created a forum post discussing the issue -

Hey guys, I'm still quite new to FME. I've been experimenting with using the DatabaseJoiner and SQLExecutor for my use case to join features already in the workspace to a database table. I have around 2+ million features in a workspace, so it takes quite awhile, and need to join them to an external database with a 1:many relationship (features:database records). Initially I thought that it would be much slower to use a DatabaseJoiner in this case, as it must send many smaller requests to the database, but now I'm not so sure. So I tried using an SQLExecutor to read in all the records and join them to the features with a FeatureMerger. The SQL query is set up so that it is only reading in the records that match one of the keys on the feature already in the workspace. However this has its' own issues I've found where the workspace fails about 2 days in translation, although I'm not sure if the error message is related to the SQLExecutor itself and

Hello! I'm trying to help our new teammate with my limited FME knowledge figure out how to get our workspaces to run on her computer. Whenever she tries running a translation, it almost immediately terminates and returns a message that it was unable to open a log file.The FME version she is running is different from the version of the workspace, but when I try and use it on my computer that also has mismatched version, the translation succeeds. We tried setting a logfile that already existed as suggested in this post: https://community.safe.com/s/question/0D54Q00008LczubSAB/i-am-a-new-fme-userwhen-i-try-to-run-a-workspace-that-has-been-authored-by-a-colleague-i-g

Hello, I have what seems to be a simple task, but so far, have not been able to find the right solution. I have an FME process that creates a CSV file with a header row, but it needs another "header" row above the actual header. Below is an example of the CSV file with the header:TagName,TimeStamp,FieldValue,DataQualityLLSCADA.LL_EX02_BATTERY_VOLTS.F_CV,5/24/2021 12:45:00,6.37,GoodLLSCADA.LL_EX02_CHLORPHYL_UG_L.F_CV,5/24/2021 12:45:00,0,Good The additional "header" row is simply the following:[DATA] Appreciate your time and any assistance, Lowell 

Hi, I have to check 2 set of data. The source is a xlsx files and the replication is a Acces files. I would to compare the 2 set of data and send a e-mail if it's have some change beetween the 2 set fo data.Thank you for the help. 

HOW CAN I DO AN FME WORKBENCH DEMO ON ANY TOPIC. WHAT ARE THE STEPS. THANK YOU.

 I understand if there is a mapserver or featureserver I can run the url into a reader, have it read into a table, create a writer to write the information into a shapefile. Then the shapefile is sent to a folder I select. I have all of that down. What I am wondering is how can I do this with a geocodeserver? Every time I take the url of the geocodeserver and try to make it into a reader, it fails....I think I need a certain reader, but I am not sure what I need. I can provide an example url if need be.   

Hi all, this is my first run with both FME and HTTPS API endpoints. The data I'm requesting comes back to me as paginated JSON in sets of 25 and the API uses offset=[Integer] to allow me to cycle through the data.  This means that when I want to pull almost any data in my day-to-day I need to hit the same endpoint multiple times with offsets 0, 25, 50 etc... until I've got all the data. The JSON comes back with a "has_next_page" boolean so I was hoping to use that to do the following: 1: establish a variable called 'offset' = 0 and an attribute called 'endpoint' = [UrlString] which references 'offset' at the end, run the HTTPCaller2: when the JSON comes back, take the "has_next_page" value and turn it into an attribute3: run a test to determine if it's true4: if true, offset+25, run HTTPCaller again 5: repeat until 'has_next_page' returns false what&#

Local Coordinate System - I have a local coordinate system that consists of a 3x3 matrix, i need to multiply each point (x,y,z) in the reader with this 3x3 matrix

Hi all, I have a list of JSON historical file which contains date and time at the end of the URL. I would like to extract both date and time based on the URL and put it in the table. I've extracted the date and time using the DateTimeStamper, but fails as it only generate current date and time. Is there any suggestions on how can I extract the date and time from the URL?

I'm trying to use FME Server to execute a Windows command but the SystemCaller returns code 1 with no details. The same workflow works fine on FME Desktop. I've read a few articles here in the formum regarding the correct use of UNC paths and folder permissions, but none seem to apply in my case. Have others had success using the SystemCaller transformer within Server to execute commands or batch files on the machine running Server?

Hello,How to install Commvault Locally on Windows Computers Using the Installation Package. Please suggest me Thanks,Anita

i would like to resize the polygon and make it smaller .i used scaler transformer but i am not sure how could i use it correctlyi have polygon that has coordinates x min , xmax , y min ,y max .how could i resize the polygon to smaller

OK, so technically this comes from a much older question, but someone recently asked for further assistance on there, so here we go...Question of the WeekThe original question was...Q) I have a shapefile of points and 103 rasters. I wanna overlay the points on the 103 rasters and extract the values to attributes. The final aimed result is the shapefile containing 103 additionnal attributes with extracted values, I want also that attributes have the same names as the rasters. Is there any way to do this batch process?I tried to load all the rasters into the PointOnRasterOverlayer but it seems that it connot do a batch process but work only on a single raster at once.And then this week @fmenoob asked for some assistance in setting up the answer.  A) There are a couple of solutions here. One is is sort of similar to the previous question-of-the-week on

Hi...easy question but i didnt find an article bout or a solution....how can i filter duplicates which have only one have a digit more or less in one specific attribute ....see attachement Thx for easy helpsGreetzFranco

IF I INSTALLED FME DESKTOP ON OUR SCHOOL LAPTOP FOR PRACTICE WOULD IT NOT DISTURB OTHER APPLICATIONS LIKE GOOGLE MEET AND SCHOOL FILES

Dear smarter people than me -I have a cad files with layers that start with either A- or C- and then one basemap layer called Mad_PARCELS. In my reader I only want to read the A- and C- layers. How would I query this out in the Merge feature type using regular expression. Or how do you combing two wildcard expressions? I can't really find any good documentation on regular expression examples. TIA 

I am trying to find the deltas and writing back them to SDE database. While doing this process i am getting error message as "Could not unregister GlobalID column 'GLOBALID' in table 'table name'. Please provide your valuable suggestions to overcome from this.

I use a HTTP caller for a REST API . Right now I am using two HTTP caller. One generates the access Token and this token will be used in the second HTTP caller in authorization header to authenticate the Request.  I also have a FME web Connection for the same API. I tried to use the web connection in HTTP caller but it seems as the authorization header is blank , the server is returning a "unauthorized access" response. Can we somehow use the tokens generated by Web Connection in the authorization header . So that I can reduce to one HTTP caller.

Hi Everyone,Very new to FME. We have a small team which will be developing interfaces using FME workspaces (exposed as APIs and call APIs exposed by other systems).I wanted to know if there is a way to set global variables/settings so that all workspaces/webhooks can use the same variables. These variables will be used to store Database connections, error mailbox email address, urls to be used in HTTP caller. Idea is these values are common for all workspaces and also change depending the environment we are in i.e. dev, QA, UAT and production. APIs will be hosted on Kong API GW. Any help is appreciated? Or if someone can point me to documentation that explains doing this.

As an ex-land surveyor, I know how useful it is to have data in a local coordinate system. If I'm working on a construction project site, I'll likely have a local grid instead of a UTM zone - and I certainly won't be using latitude and longitude. So let's see how I can handle that sort of thing in FME... The CommonLocalReprojector TransformerOne technology available to us in FME is a "dynamic coordinate system." What that means is FME automatically generates a coordinate system based on the input. The Reprojector transformer can be set to write to a dynamic coordinate system:But in that case each feature gets its own coordinate system. What we want here is a grid that covers all features. The CommonLocalReprojector will do that for us. Here is an example of its output:

I'm trying to read data from attribute enabled feature classes, but FME is defaulting to using my ArcGIS 64bit background geoprocessing installation to read the data, instead of my arcpro installation. This is solved by un-installing 64bit background geoprocessing, which means FME can only find the arcpro installation, which it then uses and reads the data. Is it possible to tell FME which to use manually, so background geoprocessing does not need to be un-installed?