Using readers and writers to extract and load data.
Recently active
Hi,I need to vallidate SHP (or DWG blocks with attributes) attribute value against Field Data Type and Domains specified in template GDB or XML Workspace Document. Reader: ESRI SHP Writer: ESRI GDB ISSUE: If the SHP attribute value doesn't match with GDB Field Data Type, the translation fails. I need to validate those values and write the fails.I wanted to use 'AttributeValidator' but the Validation Rules must be specified manually. Is there any way how to read the Validation Rules from the template (GDB or XML Workspace Document) and write them automatically?EXAMPLE:Reader SHP feature 'PIPE' has got field 'MATERIAL' with attribute value 'UPVC'. Writer GDB feature 'PIPE' has got field 'MATERIAL' with specified domain values: 'PVC-U, HDPE, PE' There is no match so the translation failsThanks.
Hi all,I'm very new to FME and GIS so sorry if I get any terminology wrong!To give you a run down, I've created a TIN surface from an ESRIASCIIGRID file. I have then extracted the boundary of this to get a footprint in a .shp file.With this, I am trying to download a satellite image from either google earth or google/bing maps (to drape over the surface later).Attempt 1:Import the .shp file into google earth, I then attempted to export an image from the extents of the polygon from the .shp file. I can't figure out a way to do this so I've just saved an image from google earth manually with 4K resolution, showing the extents of the polygon in red.Is there a way for FME to detect a red polygon and to clip the image around this? Would it then be possible to add geo-spatial data to this image to match the previously created surface?I have read through this post but am unable to get it to work, but thankyou @takashi as it's helping me to better understand FME.Attempt 2:U
I'm trying to read a feature layer and write to a geodatabase. I'm able to connect to my feature layers but I get the following error when running the processArcGIS Online Feature Service Reader: Encountered an unexpected error. The error code from the server was '400' and the message was: 'Cannot perform query. Invalid query parameters.'. Details: 'Unable to perform query. Please check your parameters.'
See this question, I suspect it may be a bug and would appreciate it if somebody from support could take a look at it.
For some reason when you change the "name" of an xref in a workbench the writer doesn't replace the old xref, it just adds a new one. Purging in the writer doesn't work. Does anyone know how to get rid of defunct xrefs?
HiI have a few thousand shape-files arranged in pairs of 5 in the form of a1.shp, a2.shp, a3.shp...... and b1.shp, b2.shp..... and so on. I would like to batch merge these into a.shp, b.shp and so on.Some guidance on how to create this batch would be much appreciated.Best regards, robin123
We are using FME to read DWG and write OBJ. OBJ only supports flat surfaces, so objects such as cylinders in the DWG are converted to flat surfaces in OBJ. Which DWG reader parameter I should look for to increase the number of flat surfaces written to the OBJ? I have an existing fme workbench made by someone else, and I'm new to fme. Thanks much for any quick help from the community!
We are attempting to standup FME server in an automated fashion using Docker to spin up Linux containers. Because of the linux containers, our workspaces can only run SQL Server JDBC reader/writers per FME. Plus, in order to spin up the containers quickly, we avoid using any ESRI dependencies. For one of the workspaces, we are using Spatial readers and Non-Spatial writers because we are just updating attributes based on the processing results. The JDBC writers work but are twice as slow as the native SQL Server writers. Do we have any other options for updating the attributes in these SQL Server tables that may give us a performance boost since we don't actually have to write any data?
Hi I have a CSV file with X,Y coordinates. I am loading this to a point feature class. However the XY coordinates sometimes come in quotes and have a comma, e.g.GLOUCESTERSHIRE,ST BRAIVELS COMMON,GL15 6SD,"355,280","203,644"Any suggestions what's the best way to handle this when using the CSV reader.
INSERT INTO `stations`.`observation` (`station_id`, `date`, `time`, `energy`, `power`, `average`, `temperature`, `voltage` ) VALUES ( 1, @Value(interval_start), @Value(_timeOutSubstring), @Value(_dataEnergyOutString), @Value(_dataPowerOutString), @Value(_dataPowerAvgString), @Value(_dataTempString), @Value(_dataVoltString) )
Hey, I'm getting a unique constraint error coming from an indexThe error number from ArcObjects is: '-2147216072'. The error message from ArcObjects is: {Underlying DBMS error [ORA-00001: unique constraint (FACILITY.A17846_IX1) violated]}Is there a switch in the writer I can set?? I have tried GRID 1 = Nothing and GRID 1 = 0 and both fail.Thx Brian
Hi, I'm trying to read data from this server:https://geodata.nationaalgeoregister.nl/bag/wfs?request=GetCapabilitiesbut only a 1000 features (the same ones it seems) come through. I've tried switching some parameters around, like what was suggested in previous questiosn about WFS on this forum (ignoring the schema etc. ). However, nothing has worked so far.
Hello,FME 2017.1.0.0 64-bit, FME 2017.1.1.1 64-bit / Windows 7, Windows 10I encountered this error when adding the Esri ArcGIS Online (AGOL) Feature Service Reader to the workspace.Logged Message:ArcGIS Online Feature Service Reader: Encountered an unexpected error. The error code from the server was '500' and the message was: 'Unable to get user.'. Details: 'Unable to get user.'The Feature Service list has been retrieved correctly, but I cannot get the Layer List from any service.The AGOL account has been provided by a client in order to test collaboration between their AGOL site and FME Server. I can access their AGOL site with the account using a web browser. The error occurs only when accessing the AGOL feature service via FME AGOL reader. (I also have my own AGOL account, and the reader can access the feature service in my AGOL site with no problem)Question: How can I resolve the error and read the layers from the feature services?Thanks.
Hello,I have a shp file with ZIP code level polygons. I need to combine all of them to give me polygon for the state, is it possible to do in FME?I tried to use the Aggregator, which took all my polygons and showed 1 output, but when inspecting the file, there was no geometry.Thank you!
I have a lot of .fmw files with Oracle readers pointing to sources outside my control. Sometimes, the names of the tables I'm reading from will change, or they'll get dropped, or my credentials will lose permission to them. When this happens, FME just reads 0 features, and says the translation was successful.How can I make FME output an error instead when this case happens?
Couldn't write to MongoDB with multi-polygon geometry. I get this error.MONGODB writer: Bulk write: OperationException: { index: 890, code: 16755, errmsg: "Can't extract geo keys: { _id: ObjectId('59fcc51628de9b19a60bf281')Any parameters to be changed for bulk write/multi-polygon geometry type?Thanks.
I'm having a frustrating hit-and-miss writing a handful of non-spatial feature types to sqlite non-spatial. Regular row-column tables, no relationship between the features or anything else. And sometimes it works, and sometimes one of the feature types will FAIL SQLite 3 Writer: Failed to write to table `myFeatureTypeName' in the database. SQLite3 Engine error: `SQL logic error or missing database' Removing the feature and then adding it manually will SOMETIMES fix the problem. And sometimes not... I've tried fiddling with the writer parameters (different modes of writing, No luck there. Finally, just now, I fiddled with the "Initialize Tables" - setting and changed it from FIRST FEATURE => IMMEDIATELY. This did the trick for me -- for the time being, at least. Hopefully this will make my problems go away for good. Anyone else having these kind of problems? Other sqlite / spatialLite hints and tricks I should know about? Oh, and running FME desktop 2014 Build 14235 win32.
Hello I am new to FME and I am trying to bring in spatial data from SQL server by adding where clause in the reader using function "SQL to Run before Read". I am not sure what query do I use?I am using the following statement but it is giving error. select * from SDEDBO.Services where Date>=Dateadd('day', GETDATE(),-30)thanks for your help!
Hi,I need to tile a 3D city model. I have the model in formats .obj, .dxf, .dwg and .gdb. I drawed polygons (shape) which i intend to use as clipping/cutting/splitting boundaries, whatever helps. After hours of googling and trying in FME with different formats and with clipper boundaries as shape as well as 3D obj, and trying in NetFabb and other software, i really dont know how to address this problem. I found a thread in this forum:https://knowledge.safe.com/questions/5061/splitcut-3d-solids-and-surfaces.htmlBut the links to the example workbenches are unavailable. Can anyone point me in a direction or maybe even provide an example workbench? Many thanks for any type of help!
Hello,I am trying to generate a *.tif-File with certain tags. I found that setting the Photometric Interpretation parameter in the writer leads to the tag of the same name being set (eg. to "YCbCr") in the resulting file. However, I am looking for a FME way to set the XResolution, YResolution and ResolutionUnit tif tags so that they are included in the resulting tif file. thank you,Ludwig
Greetings!I'm using the INSPIRE GML reader to create a GML for the CadastralParcel theme.My FeatureCollection tag looks like this:<gml:FeatureCollection xmlns:xsi="..." xmlns:gml="" xmlns:cp="..." xmlns:base="..." gml:id="MY_ID" xsi:schemaLocation="...">Is there a way to change the position of the gml:id attribute. I would like to obtain the following:<gml:FeatureCollection gml:id="MY_ID" xmlns:xsi="..." xmlns:gml="" xmlns:cp="..." xmlns:base="..." xsi:schemaLocation="...">Maybe I'm missing a setting of the Reader to do this.My FME version is 2017.0Thanks for any help provided!
Hello, I have a GML in WGS84 coordinate system (EPSG:4326). The GML contains CircleByCenterPoint element, which has its radius set in kilometers. However, if I open the file with Universal Viewer, FME interprets the radius in degrees of latitude/longitude and the circle is therefore extremely huge. I would appreciate a suggestion how to convince FME to take the units of measure into account. Thanks Example: <gml:patches> <gml:PolygonPatch interpolation="planar"> <gml:exterior> <gml:Ring> <gml:curveMember xlink:type="simple"> <gml:Curve> <gml:segments> <gml:CircleByCenterPoint interpolation="circularArcCe
Hi allIm trying to set up a gml writer to write to a gml file that matches the attached gml. Im new to GML writing a have been trying to get FME to use this xsd schema: http://soap.plansystem.dk/pdk_schemas/PLANDK2_KommunePlanRammeType.xsd as a baseI anyone has an idea where to start making a working writer i would be very happy :)
I'm currently mosaicking 600 geotiffs, these amount to 400mb. Everytime the writer gets to between 80%-90% completed I get the following error: FATAL |Insufficient memory available -- error code was 2 - please read the FME Help section 'Adjusting Memory Resources' for workarounds.Out of memory. Program terminating. Please read the FME Help section 'Adjusting Memory Resources' for workarounds.I have run several others mosaicks with geotiffs in the same workbench except smaller amounts (between 150mb-350mb) and there has been no issues. The smaller mosaicks also seem to complete at a much quicker rate. Anything seemingly over the 350/400mb mark seems to crash the program.I have FME 2017.1 (64bit). I have 8gb of ram. Thanks very much for any help!!