Data

One of my workspaces recently broke because FME can't read in the features from AGOL. I'm running Win 7 x64 and FME Beta Build 18198. Has anyone else experienced this issue?When trying to inspect the AGOL feature layer, this is the error I receive:ArcGIS Online Feature Service Reader: Requesting portal informationUpdating access token for 'Daniel.Matranga Esri ArcGIS Online'JSON Message: {"error":{"code":498,"error":"invalid_request","error_description":"refresh_token expired","message":"refresh_token expired","details":[]}}JSON Error: JSONObject["error"] not a string.Unable to update access token for 'Daniel.Matranga Esri ArcGIS Online'Updating access token for 'Daniel.Matranga Esri ArcGIS Online'JSON Message: {"error":{"code":498,"error":"invalid_request","error_description":"refresh_token expired","message":"refresh_token expired","details":[]}}JSON Error: JSONObject["error"]

I'm wondering if there is a glitch in the Geomedia SQL Server Reader. I have a number of feature classes that have boolean fields in them that I want to use in my FME process. When I read in the data with a Reader and connect it to an AttributeExposer, the boolean field comes across, but the data all shows as "<missing>". However, when I do the same thing but with a FeatureReader, it works fine. So, I'm wondering if there is a glitch with this type of Reader. 

Hi, When i set the CAT reader to read a .txt file the first character it returns on the first line is a '¿ ' which messes up the content of the first row. All other rows are read fine. The contents of the first row become shifted because of the extra character at the start of the text line. When opening the text file in a text editor I see nothing wrong. Any help would be welcome.  

Is there a way to check the page size of an AutoCAD DWG that is read into a FME workspace?

We are converting Microstation 7 design file data to Oracle 3D spatial (12C).When there is a complex line (line with an embedded arc or a line that starts as arc), then FME strokes the arcs. This is acceptable. However, the SDO metadata (SDO_ELEM_INFO) still has direct definition of the original microstation complex line (SDO_ELEM_INFO_ARRAY(1,4,2, 1,2,1) indicating arc and line segment). I would expect the resulting metadata after transformation would be a line(1,2,1). The problem with this definition is that we cannot use Oracle spatial primitives to use these geometries. SDO_GEOM.VALIDATE_GEOMETRY_WITH_CONTEXT flags these as invalid geometries.The only workaround we found was to transform them again (Oracle spatial to Oracle Spatial) with just a reader and writer in the workspace. This is not acceptable as we are dealing with millions of linear features.We have tried - Geometry validator - this does not repair this type of error.We

Hi, I tried to use Directory and File Pathnames and FeatureReader to control workflow, I used Directory and File Pathnames linked to a gdb file, then put a Tester after it, connected passed port to FeatureReader. But it seems that gdb was treated as folder, every file in picture below was passed to FeatureReader, as result all feature were read muti-times instead of one, how can I set parameters right to get what I want? Or else, how can I control workflow if I don't want some gdbs to be read in fmt?

I've been experimenting with writing out 3DTiles and gLTF/GLB models with FME. One issue I've run into is that FME seems to be creating some kind of shininess to the surfaces which I can't seem to get rid of. The model just has a single color appearance which I want to be able to cast shadows if there is a light source, however, I don't want the appearance to be 'shiny', it should just be dull.  I've set my appearance to be a single Diffuse (I've also tried Ambient) color. I've set the shininess to 0 and for I've set the Opacity to 1.  This is in my resulting gLTF file, FME has given a 'metallicFactor' to the model which I'm guessing is why there is a shine to it: "materials" : [ { "name" : "[Color M02]", "pbrMetallicRoughness" : { "baseColorFactor" : [ 0.7764705882352941, 0.7764705882352941, 0.7764705882352941, 1 ], "roughnessFactor" : 1, "metallicFactor" : 0.5 } } ],

Hi Experts,I am merging many csv files into one and I want to get the name of the input file in an attribute 'filename'. I am using FileNamePartExtractor for this purpose and its working correct with single input. But, when I use this with multiple files, it takes the name of the last input file and shows in all the rows. Can anyone help me with where I am going wrong!!

Hello All,I am trying to understand the best way to take a series of features that are created when I import a DWG and export to an XML file based on the Esri Cadastral Fabric Data Model.Basically the validation creates a four tables that form a hierarchical structure - plan, parcels, lines and points. A plan contains multiple parcels and each parcel contains multiple lines and each line contains multiple points. The model is fairly complex but at present the data is output to PostGIS tables.I have an XSD that has been created from an existing XML - see attached zip file.What I am seeking is an understanding how to take the four tables as above and create the XML based on the XSD structure rather than sending them to PostGIS.Any examples or assistance would be very much appreciated.

Hello, I'm trying to get open LiDAR data from https://remotesensing.agiv.be/gis/geoserver/wms?REQUEST=GetCapabilitiesAs I only need an extent, a big one nonetheless (Xmin = 40050, Ymin = 202950, Xmax = 48385,3778, Ymax = 206209,4442, EPSG: 31370) I always get the same error on I guess the same area.---------------------------HTTP transfer error: 'Failure when receiving data from the peer'XML Parser error: 'Error in input dataset:'

Hello,I am running into OAuth issues on FME Cloud 2019 with the Google API. After approximately 1 hour the HttpCaller no longer authenticates with the web connection.  I can re-authorize the web connections and all is good. We want to run this on a schedule and do not want to re-authorize each time we start up. @GerhardAtSafe, ideas?

I am having difficulty with the output of the filecopy writer that I am using. I have the filecopy_source_dataset setup correctly in the sense that it is pointing correctly at the full path of the original file. My filecopy_dest_dataset is set to write to the destination I want and create subfolders based on the value PLAN_SET_ID.I have set the filecopy_dest_filename to what I want the different record drawings labeled as. The issue I am having is on the creating of the .TIF files, some of the folders contain only the TIF's, which is what I want and only happens on about half of the .TIF being written out. Here is an example of what I am wanting.

Im trying to write a polygon from one polygon to another using FMEs GEODATABASE_SDE writer against a SDE database in SQL Server. Unfortunately Im totally stuck. Everytime i try writing something I get an error saying Unable to convert value taken from Z_ORIGIN keyword to a float data type. A fatal error has occurred. Check the logfile above for details  This makes totally no sense as I very carefully have removed all posibility traces of anything 3D using both the 2DForcer and in the writers format parameters have anwsered no to if there is any Z values.  Have anyone the slightest idea whats happening ???

Hi,I would like to write to an Excel Spreadsheet where the header row is formatted differently from the rest of the spreadsheet. I tried using an Excel Template but that requires me to overwrite the output every time and I do not want to overwrite the existing output.I thought perhaps I could add a new record where the values are the same as the column names and then use a TestFilter and ExcelStyler to style that row of values differently from the rest, but I can't work out how to create a new record with the column names as values.I am using FME Desktop 2018.1Any ideas?Thanks,

Trying to add WMS url in as a screen overlay/ ground overlay. I believe it has to be both, one to have it the navigation tree and one to display in GE. Here's the kml I'm trying to replicate: <ScreenOverlay id="kml_8"><Icon><href>https://seamlessrnc.nauticalcharts.noaa.gov/arcgis/services/RNC/NOAA_RNC/ImageServer/WMSServer?VERSION=1.1.1</href></Icon><overlayXY x="0" y="0" yunits="fraction" xunits="fraction"/><screenXY x="0" y="0" yunits="fraction" xunits="fraction"/></ScreenOverlay> <GroundOverlay> <name>Seamless NOAA RNCs</name> <visibility>0</visibility>

Hii am trying to extract attributes from a pdf (marked in the screenshot) In the inspector i see in the attribute pdf_all_layer_names 2 layer (Map Frame, Gemeinde) but not de Number and the Attributes. I also tried to expose additional attributes, but i didn't find the attributes, which are in the red box.i am using FME2019.1

I'm using FME 2018 (via ArcGIS data interoperability extension) so am limited to the use of the UpdateDetector, but I assume the same question is applicable to the ChangeDetector.Is there a way to specify multiple match fields? My use case is that I have a WFS data set that I am using to inform updates of an SDE table. There is a matching ID column between the two (system_id), but when an item in the WFS base database is replaced, the ID will be written to a separate column (prior_id) and the record given a new ID. Therefore, the equivalent record in the table- which contains data not stored in the database- would be removed by the UpdateDetector and the new record written in if just matching on system_id. So I would envision a solution taking the form of specifying the UpdateDetector to check for a match between WFS system_id and SDE table system_id, and if none exists check for a match between WFS prior_id and SDE table system_id, and if none exists treat the rec

I have been working on an issue for a few months to automate ‘Expose Attribute’ in such transformers as XMLXQueryExtractor. FME said it is on there development list, I/we have to crack open these HTML fields and type the Expose Attribute on average once a week. I have tried many gyrations, wanted to see if you have done this or have an idea how to automate. Many Thanks

If your looking to make a connection with JDBC Reader and you need to specify JAVA_OPTS you can do the following: 1) ADD a new multi-parameter System Environment Variable called JAVA_TOOL_OPTIONS and specify your paramters.JAVA_TOOL_OPTIONS = -Djava.security.login.config=C:\folder\some.config -Djava=anothervalue 2) Restart FME 

In a workspace, I do a conditional copying of files into several places, and I want to deliver the results of the copy actions - especially the target filenames - in one final emailWhat I do have is a structure like this (the condition part omitted for clarity)where the email sending part already works.But I can't figure out how to send the target filename each filecopy writer receives basically as a list.Any help would be greatly appreciated.

I have recently just discovered this software and it seems like a really powerful utility. What I would like to do is take a kmz file of building geometry that has been verified in Google Earth and convert the file into a meshable file type such as an stl. Is this possible? I see from the data inspector that all of the points necessary to define each building exist in LLA format and data sets are defined as boundaries and polygons so I'm inclined to think it's possible, I just can't get it to work. I've also noticed that kml/kmz files can't be inspected in 3D which I believe is a manifestation of my issue. Any help is greatly appreciated! I've attached a screenshot from the data inspector in 2D and 3D as well as one from Google Earth   

HI All, Has anybody tried using FME to write to the MilSoft STD format?The format is not in the formats list on the Safe website.Maybe somebody created a work-around for the format.Any help is highly appreciated. Thanks,Erik

Hi,I'm working on Smallworld for the first time. I observed that understanding of Small world readers are not like other readers. It has a unique feature of adding readers based on status i.e. existing, abandoned, etc but reads all the data when we add existing or abandoned reader. I do not understand this logic. Why Smallworld reader is reading all the data every time when we placed only existing/abandoned reader...?In my case pole_exi table has 1lakh records and pole_aba have 9 records as well as there is another reader with name pole which has 25k feature.1. Why it has so many readers when it is reading all 125009 features every time2. Is there any settings we have to change or it is not in our control3. Even if we pass "10" in "max features to read", surprisingly, it reads all 125009 and pass 10 features out :) by which it is even more wasting the time while testing.Can we any one help me... Thank y

I've got a bunch of input files that are stored in sub-directories, I use a path and directory reader to grab these and send them into a workspace runner. A bunch of things take place and then I want to write them all out to 2 layers within a gdb. So dozens of files being brought together to 2 central layers (point, polyline).That's all fine...when I don't run the child workspaces concurrently. I of course get layer locks if I run multiple processes.Ideally I'd like to run multiple processes and have each feature inserted/appended to the table.Any suggestions on how to get around this gdb locking? I'm happy to go out to another spatial db format, that I can later update.

Hi I am reading a json file. Here is one I am reading now: https://outages.electra.co.nz/api/weboutageviewer/get_live_data?Start=&End=&Duration=0&CustomerResponsible=false&Historical=false&_=1564371572592What I want to know is how do I create a reader that can update dynamically if the number at the end changes ie.1564371572592 will not stay constant and this will change.