Using readers and writers to extract and load data.
Recently active
My question is more on the SoQL than FME. I have a JSON reader with a filter on hospitals located in GA and AL.In my workspace, the user enters a location parameter (Lat, long) which is then buffered by 50 miles. The 50mi buffer is then used as a clippee on the hospital points and this results to the number of hospitals in the two states that are within 50 mi of the user location entered during run time.I wanted the reader to be more efficient by using the SoQL function DISTANCE_IN_PARAMATERS on the filtered list. (Reference: https://dev.socrata.com/docs/functions/distance_in_meters.html)I tried several things but none of my attempts has worked so far.Once I get the results this will be published to FME Server where the workspace will be used in another app.<a href="https://data.medicare.gov/resource/xubh-q36u?$where=%28%28state ='AL'%29 OR %28state = 'GA'%29%29">https://data.medicare.gov/resource/xubh-q36u?$where=((state ='AL') OR (state = 'GA'))</a>
Hi, i would like to copy some files from a directory by using an ESRI shape file containing the name and the file extention.We have a directory with over 300+ aerial photos of our town. Every photo has an unique name. Using an georeferenced Esri shapefile of a specific area we want to copy the photos that are coverd by the shapefile to another directory.I used a feature reader that reads the directory. Apparently the feature reader reads the directory with the rasters and loads all the rasters into its memory. The scanning process of 300+ files (800mb each) takes very long and uses a lot of memory. This is a problem, we are short of memory. That is why i would like to use a selection polygon to select only the 4 rasters that i need and copy them to a different directory.How can this be done?
It is possible convert OBJ files (from LiDAR source) to FLT files with texture?I just select OBJ (input box) and FLT (ouptut box) and then RUN... but no textures...FME DESKTOP 2018Help, please: https://we.tl/t-7RksIu0kJZThanks
I have several workbenches running as jobs on FME Server that read/write to an ArcGIS SDE geodatabase in SQL Server. They all use a shared SDE connection file, currently stored in the \\Shared Resources\\Data folder on the server. One of the workbench jobs is apparently having an issue with this connection file. Whenever it runs (and the workbench logic allows trying to open the SDE geodatabase for a write operation), the job fails with this error:Creating writer for format: Esri Geodatabase (ArcSDE Geodb) Trying to find a DYNAMIC plugin for writer named `GEODATABASE_SDE'Loaded module 'GEODATABASE_SDE' from file 'C:\\Program Files\\FMEServer\\Server\\fme\\GEODATABASE9.dll'FME API version of module 'GEODATABASE_SDE' matches current internal version (3.8 20180209)FME Configuration: No destination coordinate system setFME API version of module 'GEODATABASE_SDE' matches current internal version (3.8 20180209)Writer `FeatureWriter_2_0' of type `GEO
I am trying to adjust the text orientation by changing the fme_rotation attribute in the TextAdder transformer. However, the text orientation attributes does not take the changes. Do you know how I can access or somehow manipulate the values in the red box from the image below? In this example i have change the rotation to 116, but the text still have a rotation of 118.
Hi Everyone,I attempt to create a new work space in FME Desktop 2018 and add a reader to read .shp file. However, I wasn't able to create the reader and saw the following error:"Failed to obtain any schemas from reader 'ESRISHAPE' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more information"Can some one please point me to where I can resolve this issue? Which components are the culprit in this case? I've ArcGIS and ArcGIS Background Geoprocessing installed as well.Thank you for looking into this
Hi all,I have a table with (XYZ) coordinates measured in time. Each time the Z-value (field J and further) of the specific point changes. The XY-coordinates (field E and F) stay the same. Sometimes the Z-value is missing.How can I project all of these point without manual adjustments to the table? So for the second row we have:1st measurement: X=94439,5, Y=435795,0 and Z=-0,803702th measurement: X=94439,5, Y=435795,0 and Z=-0,805003th measurement: X=94439,5, Y=435795,0 and Z=-0,806004th measurement: X=94439,5, Y=435795,0 and Z= missing here so no projectionand so further onIn the end I want to have a geodatabase.Many thanks for you reply!Alan
Afternoon, Just wondering if any one uses FME to extract data from Northgate M3 - as I am having trouble getting the UPRN out of the worksheets to then link to our spatial layer which is an oracle database and the joiner would be the UPRN.Below is the field that i am trying to extract on the address tab If anyone which db that sits in that would be appreciated ThanksDarren
I have an Excel Spreadsheet and in one of the sheets there are about 10 tables, they all have the same column names and all appear in the same column, e.g. Description will appear in Column A for all 10 tables etc.Rows are not predictable, these are based on how much data is displayed.Rather than creating a named range in Excel, is there an easier way within FME to do this, maybe combining all 10 tables into one large table? Also if in future there were to be 15 tables within one spreadsheet, could this be incorporated to make it future proof?
Hello, I want to do the same operation like this tutorial : https://knowledge.safe.com/articles/19918/how-to-expose-feature-attributes-from-kml-tag.html or this topic : https://knowledge.safe.com/questions/29326/how-can-i-extract-the-html-table-from-kml-descript.htmlIt consits in expose feature attributes from KML tag.I've done the step with HTMLtoWHTMLconverter and I obtaint this : <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"><html xmlns="http://www.w3.org/1999/xhtml"><head> <title></title></head><body> Survey Parameters<br /> <br /> <hr /> <table border="0" padding="10"> <tr> <td></td> <td>Planned</td> <td>Current</td> <td>Desired</td> </tr> <tr> <td>Scan Frequency [Hz]</td> <td>66</td> <td>66</t
We're having significant performance issues with Xref drawings created by FME. In AutoCAD there are options in the "Save As" dialog to allow the drawing to be saved with layer and spatial indexes, but I can't find a way to set this in the DWG or Map OD writers in FME. Is this available somewhere or simply not possible with FME 2018? If it turns out this is not possible in the currently available writers, then as a work -around, if I safe the template drawing with layer and spatial indexes, will this carry through to the drawings created by the writer in my workspace? Thanks,Gary
One of my workspaces recently broke because FME can't read in the features from AGOL. I'm running Win 7 x64 and FME Beta Build 18198. Has anyone else experienced this issue?When trying to inspect the AGOL feature layer, this is the error I receive:ArcGIS Online Feature Service Reader: Requesting portal informationUpdating access token for 'Daniel.Matranga Esri ArcGIS Online'JSON Message: {"error":{"code":498,"error":"invalid_request","error_description":"refresh_token expired","message":"refresh_token expired","details":[]}}JSON Error: JSONObject["error"] not a string.Unable to update access token for 'Daniel.Matranga Esri ArcGIS Online'Updating access token for 'Daniel.Matranga Esri ArcGIS Online'JSON Message: {"error":{"code":498,"error":"invalid_request","error_description":"refresh_token expired","message":"refresh_token expired","details":[]}}JSON Error: JSONObject["error"] not a string.Unable to update access token for 'Daniel.Matranga Esri ArcGIS Online'Python Exception <HTTP
I'm wondering if there is a glitch in the Geomedia SQL Server Reader. I have a number of feature classes that have boolean fields in them that I want to use in my FME process. When I read in the data with a Reader and connect it to an AttributeExposer, the boolean field comes across, but the data all shows as "<missing>". However, when I do the same thing but with a FeatureReader, it works fine. So, I'm wondering if there is a glitch with this type of Reader.
Hi, When i set the CAT reader to read a .txt file the first character it returns on the first line is a '¿ ' which messes up the content of the first row. All other rows are read fine. The contents of the first row become shifted because of the extra character at the start of the text line. When opening the text file in a text editor I see nothing wrong. Any help would be welcome.
Is there a way to check the page size of an AutoCAD DWG that is read into a FME workspace?
We are converting Microstation 7 design file data to Oracle 3D spatial (12C).When there is a complex line (line with an embedded arc or a line that starts as arc), then FME strokes the arcs. This is acceptable. However, the SDO metadata (SDO_ELEM_INFO) still has direct definition of the original microstation complex line (SDO_ELEM_INFO_ARRAY(1,4,2, 1,2,1) indicating arc and line segment). I would expect the resulting metadata after transformation would be a line(1,2,1). The problem with this definition is that we cannot use Oracle spatial primitives to use these geometries. SDO_GEOM.VALIDATE_GEOMETRY_WITH_CONTEXT flags these as invalid geometries.The only workaround we found was to transform them again (Oracle spatial to Oracle Spatial) with just a reader and writer in the workspace. This is not acceptable as we are dealing with millions of linear features.We have tried - Geometry validator - this does not repair this type of error.We tried to modify fme_type before converting it to 3D
Hi, I tried to use Directory and File Pathnames and FeatureReader to control workflow, I used Directory and File Pathnames linked to a gdb file, then put a Tester after it, connected passed port to FeatureReader. But it seems that gdb was treated as folder, every file in picture below was passed to FeatureReader, as result all feature were read muti-times instead of one, how can I set parameters right to get what I want? Or else, how can I control workflow if I don't want some gdbs to be read in fmt?
I've been experimenting with writing out 3DTiles and gLTF/GLB models with FME. One issue I've run into is that FME seems to be creating some kind of shininess to the surfaces which I can't seem to get rid of. The model just has a single color appearance which I want to be able to cast shadows if there is a light source, however, I don't want the appearance to be 'shiny', it should just be dull. I've set my appearance to be a single Diffuse (I've also tried Ambient) color. I've set the shininess to 0 and for I've set the Opacity to 1. This is in my resulting gLTF file, FME has given a 'metallicFactor' to the model which I'm guessing is why there is a shine to it: "materials" : [ { "name" : "[Color M02]", "pbrMetallicRoughness" : { "baseColorFactor" : [ 0.7764705882352941, 0.7764705882352941, 0.7764705882352941, 1 ], "roughnessFactor" : 1, "metallicFactor" : 0.5 } } ],This also comes through into my 3D Tile when creating them. I see the same properties in the b3dm file
Hi Experts,I am merging many csv files into one and I want to get the name of the input file in an attribute 'filename'. I am using FileNamePartExtractor for this purpose and its working correct with single input. But, when I use this with multiple files, it takes the name of the last input file and shows in all the rows. Can anyone help me with where I am going wrong!!
Hello All,I am trying to understand the best way to take a series of features that are created when I import a DWG and export to an XML file based on the Esri Cadastral Fabric Data Model.Basically the validation creates a four tables that form a hierarchical structure - plan, parcels, lines and points. A plan contains multiple parcels and each parcel contains multiple lines and each line contains multiple points. The model is fairly complex but at present the data is output to PostGIS tables.I have an XSD that has been created from an existing XML - see attached zip file.What I am seeking is an understanding how to take the four tables as above and create the XML based on the XSD structure rather than sending them to PostGIS.Any examples or assistance would be very much appreciated.
Hello, I'm trying to get open LiDAR data from https://remotesensing.agiv.be/gis/geoserver/wms?REQUEST=GetCapabilitiesAs I only need an extent, a big one nonetheless (Xmin = 40050, Ymin = 202950, Xmax = 48385,3778, Ymax = 206209,4442, EPSG: 31370) I always get the same error on I guess the same area.---------------------------HTTP transfer error: 'Failure when receiving data from the peer'XML Parser error: 'Error in input dataset:'https://remotesensing.agiv.be:443/gis/geoserver/wfs?SERVICE=WFS&VERSION=1.1.0&REQUEST=GetFeature&TYPENAME=Agiv%3ALiDAR_DHMV_II_LAZtiles&NAMESPACE=xmlns%28Agiv%3Dhttp%3A%2F%2Fmobile-mapping.agiv.be%29&BBOX=40050%2C202950%2C48385.3778%2C206209.4442%2Curn%3Ax-ogc%3Adef%3Acrs%3AEPSG%3A31370&OUTPUTFORMAT=application%2Fgml%2Bxml%3B%20version%3D3.2&MAXFEATURES=30000' line:1 column:415988 message:input ended before all started tags were ended; last tag started is 'gml:posList''The XML Module halted on err
Hello,I am running into OAuth issues on FME Cloud 2019 with the Google API. After approximately 1 hour the HttpCaller no longer authenticates with the web connection. I can re-authorize the web connections and all is good. We want to run this on a schedule and do not want to re-authorize each time we start up. @GerhardAtSafe, ideas?
I am having difficulty with the output of the filecopy writer that I am using. I have the filecopy_source_dataset setup correctly in the sense that it is pointing correctly at the full path of the original file. My filecopy_dest_dataset is set to write to the destination I want and create subfolders based on the value PLAN_SET_ID.I have set the filecopy_dest_filename to what I want the different record drawings labeled as. The issue I am having is on the creating of the .TIF files, some of the folders contain only the TIF's, which is what I want and only happens on about half of the .TIF being written out. Here is an example of what I am wanting. What I am getting for the other half of the .TIF's is this. Folders with subfolders that are empty, but include part of the name of a .tif that should be written out.Or a combination of subfolders that are empty, but include part of the name of a .tif that should be written out along with .tifs that wrote out correctly. I am a bit c
Im trying to write a polygon from one polygon to another using FMEs GEODATABASE_SDE writer against a SDE database in SQL Server. Unfortunately Im totally stuck. Everytime i try writing something I get an error saying Unable to convert value taken from Z_ORIGIN keyword to a float data type. A fatal error has occurred. Check the logfile above for details This makes totally no sense as I very carefully have removed all posibility traces of anything 3D using both the 2DForcer and in the writers format parameters have anwsered no to if there is any Z values. Have anyone the slightest idea whats happening ???
Hi,I would like to write to an Excel Spreadsheet where the header row is formatted differently from the rest of the spreadsheet. I tried using an Excel Template but that requires me to overwrite the output every time and I do not want to overwrite the existing output.I thought perhaps I could add a new record where the values are the same as the column names and then use a TestFilter and ExcelStyler to style that row of values differently from the rest, but I can't work out how to create a new record with the column names as values.I am using FME Desktop 2018.1Any ideas?Thanks,