Using readers and writers to extract and load data.
Recently active
Hei,The SQLExecutor transformer uses sets of 10000 records (as postgis reader uses as default). Is there any way to increase it?
Hello everyone,I am new to FME, I just turned to it in search for a GIS problem I couldn't solve in ArcGIS and I am surprised by the wide choice of tools! But I still haven't found the solution I was looking for.I am looking for a way to dissolve or even better smooth touching 3D data. My input data is ESRI shapefile (either multipatch or polygonZ). Any workaround would help, and avoiding to obtain a single feature in the output but maintain the attributes of segments (except at crossings) would be a great plus. Briefly, what I have is a street network as 3D polyline shapefile, with a field indicating the width of every street. In ArcGIS I used 3D symbology to create a strip of the right width, and "3D layer to feature class" to obtain a multipatch. However, this operation naturally cause overlaps at road crossings, which are a) not nice, and b) causing many issues when I process my data further (e.g. flickering "Z-fighting" polygons).One idea was to use th
If I choose Frankfurt region, does all my data including backups and snapshots remain only in the Amazon Frankfurt availability zone or is there a backup/ mirroring into another zone (Ireland) or Region (US East)?
Hi Guys,I am new at the FME Software and actually trying to transform an json file to an csv file. With the example i could create such flow that works. I checked the Output and wondering a little bit that the headlines of the json objects are in the fields. Example:{"cruise_nid":413358Cruise_nid is the object name (in a json array) and the 413358 is value. In my powershell script that i actually using for that transformation, the cruise_nid used as Headline. How i can configure the JsonFragmenter to use the objective names as Headlines?The second Point that i got is that on anorther json i got an error that the json is not valid:A JSON syntax error was found at line 39, column 28A sequence of bytes was found which is invalid in the utf-8 Encoding.I checked the json file, but there isnt a column 28 in the line 39. In column 59 i got an umlaut. But i thought that that will be in UTF8 be no Problem. Any tips?RegardsTimo
Hello all, I am being sent a large number of ESRI file geodatabases. Within these I need to: 1) check if the individual feature classes contain a specific field (this field, e.g. [Field_x]), should be contained in all feature classes so can be a generic test accross all feature classes). 2) secondly I need to check the fme_data_type, this should always be Integer I am first trying to test this on one field - however I will have a lot more to test and will need to add and remove more tests over time. Can anyone help on how to achieve this? I have loaded the .gdb into FME using the "Schema (Any Format)" translator and I can see the values I need to test agains recorded in the attribute{}.fme_data_type and attribute.{}name attributes - I just can't work out how to test them! Any help would be very much appreciated. Regards, Kevin P.S. I am happy to share models/data etc if easier - however it is only the second time I have posted on this forum so not sure if this i
Hi, Can anyone advise me how I can configure a workbench to read all the files into a workbench? However, I do not want to read them all in at the same time (using the 'directory' reader feature) so that the features from different dataset are all running through at the same time. In essence, I want to read the first file in directory, process and write out the results from the workbench, then and only then read in the next file and process, repeating until all files have processed. (Because the processes I want to run I think it will be too difficult if I try to process all the files at once, therefore I would rather that the datasets are handled in isolation. Thanks in advance, Rob
Is there some way I can make use of the featurereader to clip LAS files with the initiator?
I have been using a workbench for months which writes to a file geodatabase using the 'Esri Geodatabase (File Geodb ArcObjects)' writer. I am using FME 2016.1.3.1 64-bit (I was using a previous version of FME 2016.1 and was hoping that an update to this most recent version might solve my issue) on a computer where ArcGIS 10.4.1 with background geoprocessing and ArcGIS Pro 1.3 is installed. Coincidence or not, since the latest updates for Windows the workbench is not working anymore. In the image below you can see which updates have been installed.On my computer runs Windows 7 Enterprise Service Pack 1.The error I get in FME is: Unable to perform any licensing related tasks. This is a 64-bit version of FME which requires a 64-bit version of ArcGIS Server. Or download and install a 32 bit version of FME. Refer to this this article http://fme.ly/qua for more details Following the link in the error message I read that I need ArcGIS Pro or ArcGIS Desktop background processing, but that is
Hi,I have a bunch of files in .ROI format, that I need to convert into something useable by ArcGIS. Each .ROI file has 3 fields - lat, long, and a temperature value - and there is about a million rows. I've managed to convert one into a .IMG file using a manual ROI --> convert to CSV --> convert to shapefile --> convert to raster process, in Excel and ArcGIS. This took about 3 hours. So, with 20 of them to do (and more in the future) I'm hoping to find a better solution. I'm new to FME, and have had a couple of attempts but I'm not really sure what I'm doing so hopefully there is someone out there who does! FME doesn't appear to read a .ROI file, so I'll have to do a manual conversion to CSV, then go from there. *Edit: I think .ROI files were exported from ENVI or MATLAB, as I can't find much else that will read them.Any assistance on this is appreciated!
I have a mapinfo tab file and some of the text strings are not displaying correctly. I need to extract this string into an attribute but it is populating as 2 Á¶ . Is there a way to use the custom ttf file in fme to obtain the correct string?Thanks
When I add a new Reader, e.g., Excel, select a file, and then open the 'parameters' dialog, there's a summary showing 1. Sheets to Read, 2. Preview (of selected sheet), and 3. Attributes (of selected sheet). I want to replicate that in a workflow... how to do it? I just want to know how to get this information from the file, I don't need to know how to format it and all that.
Hi, I'm looking to convert CAD text to a line feature where the geometry represents the centre-line of the text. The basic algorithm is:generate the oriented bounding box of the CAD textgenerate the center line of that bounding box.This is working fine however it looks like FME uses a 'default' font style so when I change the font style in CAD the bounding box does not change. I've tried exposing various autocad properties and changing the style but when I use inspector the text (and resultant bounding box) are always the same. (Changing the size works, just not the style).Is there any way of converting the font style so it is honoured when you open it in Inspector?Or does inspector have a 'default' font it always uses?Thanks.Ash.
I have a number of google geocoder transformers in sequence which amongst other things take in the rejected outputs from the previous geocoder transformer. This works fine apart from the first geocoder in the sequence which doesnt carry a rejected count despite not passing the full input count. Has anyone come across this before? Any help appreciated!
I have a workspace that reads from a text file where each line is the path to a shapefile. I then have a workspace runner that passes each path to a second FME script as the [SourceDataset_SHAPE] parameter. The second FME script opens the shapefiles one by one and does some processing. This works well for formats like shape, DWG, and geojson, but it doesn't work for Excel because the FME script that gets sent the parameter doesn't know which sheet name to open. I can't seem to pass the sheet name as a parameter, and the sheet names are different for each Excel that I sent to this script so I can't hard code it. Is there a way to send that sheet name to the FME script and have it open the Excel and read from the desired sheet name? Thanks
I have problem reading SHP-file when i run workbench on FME-server. The same workbench runs without problem on the same machine in FME-desktop.I get the error:BADNEWS: Shape Reader: Failed to open dataset '\\\\sv101\\webkartor\\ValsProd\\PPL_PPL_Y.shp' which is neither an existing file nor directory (shapread.cpp:307)Shape Reader: Failed to open dataset '\\\\sv101\\webkartor\\ValsProd\\PPL_PPL_Y.shp' which is neither an existing file nor directory (stftrans.cpp:275) - (..\\..\\..\\foundation\\framework\\engine\\reader.h:130) - (shapread.cpp:307)
I'm reading an FGDB point feature class containing single points but the geometry type has been incorrectly set as "multipoint". I thought I would need to fix this in my Workspace as I'm then sending the data to FeatureMerger to compare (attributes & geometry) against an older version of the data where the geometry type is set correctly as "point".So I used GeometryRefiner which appears to output the "multipoint" features as "point" features.However, FeatureMerger doesn't seem to need this. It produces the same results without using GeometryRefiner as it does with it. Happy days.Maybe Matcher would be less tolerant and GeometryRefiner would be needed there...?
I have a oracle special data from database one which looks like below, it was a label or a text something. MDSYS.SDO_GEOMETRY(2001,82232,NULL,MDSYS.SDO_ELEM_INFO_ARRAY(1,0,6001,11,1,1),MDSYS.SDO_ORDINATE_ARRAY(360.784660012623,0,0,1,131072,16,7209045,7602281,3211296,655373,630758.221843477,5523011.93164305))and I want to copy it to database two with FME.I added an AttributeExposer as a transformer to expose oracle_element{}, and added a ListExploder to list _element_index for the oracle_element{}. I also set geomedia_text_font_size to 0 with another AttributeCreater. But the result I got was always something like below:MDSYS.SDO_GEOMETRY(2001,82232,NULL,MDSYS.SDO_ELEM_INFO_ARRAY(1,0,6001,8,1,1),MDSYS.SDO_ORDINATE_ARRAY(360.784660012623,0,0,1,65536,4,437918234,630758.221843477,5523011.93164305)).It seems the source data saved the geometry_text_string with 16 bytes, while the target data saved it in 8 bytes. My question is that is there any transformer or any way to copy the source data
I am trying to write a polygon dataset to an ArcSDE database, but it is failing on one of the features!2016-11-17 18:59:51| 130.7| 3.7|ERROR |An error occurred while attempting to insert a row into the table 'citystreets' using a cursor. The error number from ArcObjects is: '-2147215968'. The error message from ArcObjects is: {Linestring or poly boundary is self-intersecting}I am using a GeometryValidator, but it isn't picking up any errors! What can I do?
Is there any workaround to export 3d pipes from revit to postgis 3d? I installed the fme plugin to revit and exported into ifc with various options on but none of the exported files contained (or at least I couldnt find). My and goal is to export 3d pipes with various attributes + the 3d geom into postresql/postgis and visualize it in augmented reality (augment . net) Could you provide me some help how can I export pipes from revit to postgis 3d?
This morning, FME Server started to throw errors writing <NULL> values to numeric values using the ArcGIS Online Writer. Everything was working until Esri upgraded AGOL overnight. We've submitted a ticket to Esri, but wanted to submit a question here as well.The error we're getting is: ArcGIS Online Feature Service Writer: 'addResults' error for a feature in 'AVL DB'. The error code from the server was '1000' and the message was: 'Attribute 'Right Wing Plow State' has an invalid value of ''. The value should be data type esriFieldTypeDouble.'We were able to successfully add a feature via the REST API using the following:[ { "geometry" : {"x" : -94.44920, "y" : 41.88339}, "attributes" : { "LABEL" : "Test Insert", "RIGHTWINGPLOW" : null, "ACTIVE_MATERIAL" : "NONE" } } ]Does anyone have the syntax needed
Hi.I have to store a raster (ECW format) in a MBTILES (the writer is SQLITE).The raster looks like this:My first FME attempt has been this one: The MBTILES format needs two tables in the database: tiles and metada. FME builds the first one and then I create the second one with SQLite Browser. After renaming the database from .sqlite to .mbtiles, I add the file to QGIS to see the result: The bigger the zoom the crazier the puzzle.I have almost zero experience with FME and I don't know what I could do to fix this.Does anyone know what is wrong with the process? Or is there a better way to get a MBTILES from a raster?Thanks for your help!