Using readers and writers to extract and load data.
Recently active
What controls the order in which tags are written in the OSM XML writer? I have a set of attributes that are ordered alphabetically in the writer. The attributes are even ‘ordered’ on the features (which shouldn’t matter?). As you can see 'smoothness’ was assigned as the second tag, when I would have expected ‘highway’ to be the second tag.Inspecting the written dataViewing the XML file in Notepad++Attributes are listed alphabetically on the OSM XML writer.
Hello ! I have a DWG that has a different type of feature that I cannot convert to ArcGIS Pro because it does not recongize it or unable to keep it preserve the line..This is an oiginial DWG I have here : After I save them to a new DWG with set to ESPG 26913. I got this It looks like a feature change for line from an oroginal to a new one above the picures here… Is there a way for me to preserve the lines from change it ? Thanks
Hi,I am trying to read from a publicly available WMS service (https://environment.data.gov.uk/spatialdata/nafra2-risk-of-flooding-from-surface-water/wms), layerrofsw_4band.I have connected to the service in FME Form using a reader and bounding box for my area of interest. The reader runs, reporting success, but returns only a single line entry and a white dotted square in the preview.Adding the layer to ArcPro works fine and data can be viewed as expected.I believe the issue is due to scale thresholding applied to the service by the provider. No features are returned unless the map scale is less than 1:50k. My bounding box is much bigger.This forum post is the closest to my problem, Problems reading WMS layers? | Community, but doesn't suggest a solution.In the reader it does not seem possible to set the scale to operate at.Would the workflow required to access the features be something like:Split my area of interest into a grid, where each square is <1:50k. Somehow call the WMS ser
Hello,I'm scraping data using an HTTPCaller.One of the attributes contains GeoJSON data:{"type":"FeatureCollection","features":[{"type":"Feature","properties":{},"geometry":{"coordinates":[[[5.96266096723135, 51.9996241913007],[5.96267141231219, 51.9996290142943],[5.96315710713663, 51.999175649922],[5.96290120337337, 51.9991708268575],[5.96266096723135, 51.9996241913007]]],"type":"Polygon"}}]}I'd like to visualize these polygons in the Data Inspector but I don't know how to convert this data into an actual polygon.What transformers do I need?Thanks
Which Fme Transformer will enable me write an Excel Output Data to accept Large Numbers (e.g. No1 below) No1 4111101101005601100102002 No2 Instead of this Scientific Notation of Enconded Number (e.g. No 2 below) 4.1111011010056E+24
Hello Folks,I have been presented with an interesting issue.I have a CSV which consist of data with multiple headers and related data for those headers. #header 1 and valuesobservationId,broid,_response_body_new,_http_status_codeid_01682157639,GLD000000036023,"""BRO-ID"",""bronhouder"",,""kwaliteitsregime"",""datum eerste meting"",""datum recentste meting""GLD000000036023"",""50200097"",,""IMBRO"",""(2005-11-27, JJJJ-MM-DD)"",""(2025-04-10, JJJJ-MM-DD)"",,,,,#header 2 and values""put BRO-ID"",""put buisnummer"",,""monitoringnet BRO-ID"",,GMW000000074173"",""2"",,,,,,,,,#header 3 and valuesobservatie ID"",""start observatieperiode"",""eind observatieperiode"",""observatietype"",""mate beoordeling"",""observatieproces ID""id_OMO_95135"",""(2024-07-18, JJJJ-MM-DD)"",""(2025-04-10, JJJJ-MM-DD)"",""reguliereMeting"",""volledigBeoordeeld"",""id_OP_95135"",,,,,#header 4 and values""tijdstip meting"",""waterstand"",""status kwaliteitscontrole"",""censuurreden"",""censuurlimietwaarde"",""inter
Hi everyone,I’m pretty new to FME and I’m using FME Workbench 2024.2 to move data from my sde gdb schema to an Esri Parks and Grounds solution fgdb schema. I’m having trouble with the SchemaMapper and moving my domains(attribute values) to the fgdb’s schema. Currently they are not mapping. Previous SchemaMapper parameter settings moved the source attribute value over to the target attribute, but kept the same source attribute value (MULTI-FEATURE STRUCTURE should’ve changed to Jungle Gym but instead it stayed as MULTI-FEATURE STRUCTURE). Can anyone help provide more instruction on how to get the source attribute values to move to the target attribute name and change to the target attribute value?Here’s the .xlsx I’m referencing Here’s my SchemaMapper Parameters
I have an ArcGIS Online hosted feature layer containing point features that have attachments enabled. Could someone help me with some advice for how to use the ArcGIS Online feature reader that will allow me to access the features and their associated attachments (if there are any-not all features have an attachment)? It is easy enough to get the features, but I can't see a way to access the attachments. Thank you!
Hi, I am using a bufferer and a dissolver transformer to generate a buffer polygon from an aggregated set of 500+ geometries. The Inspector is showing the generated geometry but the Oracle Spatial writer is unable write the geom into the spatial table. I am getting the error "Bad geometry detected in the following feature; Geometry could not be encoded for Oracle". I have added a GeometryValidator after the Dissolver transformer. The generated geom comes through the PASSED output but still the error remains. FME Desktop 2013 is used. Regards, Ananda
I’ve got a weird problem where an Excel reader is reading an entire file correctly, except for one column where it is only getting part of the data. When I decode the XML of the Excel file (change extension to .zip and expand), I can look at sheet1.xml and I see the following data:<c s="12" t="inlineStr" r="AK10"> <is> <r> <rPr> <b val="0"></b> <i val="0"></i> <strike val="0"></strike> <u val="none"></u> <sz val="10"></sz> <color theme="1"></color> <rFont val="Courier New"></rFont> </rPr> <t xml:space="preserve"> </t> </r> <r> <rPr> <b val="0"></b> <i val="0"></i> <strike val="0"></strike>
I’m using FME 2021.WAL is possible pour SQLite since 2010, Geopackage is based on SQLite. I didn’t find any way to activate WAL on a Geopackage FeatureWriter in order to avoid lock problems.How can I use WAL on Geopackage ? Is it available in later release ?
Hello, I am using FME Form 2025 and looking to write shapefiles/ geodbs dynamically to an ArcSDE Geodb.My issue is that where my source data has the data type VARCHAR2 it is written into Oracle as NVARCHAR2.According to our database manager our preference is VARCHAR2 due to: “VARCHAR stores each character using a single byte, NVARCHAR columns typically consume twice as much storage space as equivalent VARCHAR columns.”I have tried multiple options of resetting the data types and writing out either using automatic attribute definition or dynamic (using the readers schema), but in any case the final table stores NVARCHAR2.Is it possible to change the data type from within FME?Many Thanks!
Hi all, how do I easiest update change the field type in a GDB?Esri Introduced the BigInteger, which is giving me a lot of issues. It dosn’t work in all applications, and I can’t even do a relate or join on it. I need to get it into a integer. For some reason the data we get delivered now on a weekly basis has all the number fields in BigInteger.I need it to find the BigInteger Fields, and change the type, without loosing data. The data also fits an normal integer.Any thoughts would be much appreciated. Thanks
Hi, I'm having an issue with a Microsoft Access Reader. I have a script that reads a query from Access. This query is a subquery of two other queries. Until now, the script has always worked, but now the query reader doesn't show anything.
Hi, taking my first steps in the FME REST API and webhooks, and struggling on passing coordinates. I published a simple workspace to FME server using the Geometry Pïcker as only parameter, the drawn polygon is noted in GeoJson, like:{"type":"Polygon","coordinates":[[[3.732869,51.016178],[3.733537,51.016688],[3.734896,51.015998],[3.734086,51.015473],[3.732869,51.016178]]]} I created a webhook from this workspace, the URL preview shows the special characters should be encoded, like:https://FMEserver/workspace.fmw?DrawnPolygon=%7B%22type%22%3A%22Polygon%22%2C%22coordinates%22%3A%5B%5B%5B3.732869%2C51.016178%5D%2C%5B3.733537%2C51.016688%5D%2C%5B3.734896%2C51.015998%5D%2C%5B3.734086%2C51.015473%5D%2C%5B3.732869%2C51.016178%5D%5D%5D%7D&opt_showresult=false&opt_servicemode=sync but, when I GET-request through this URL, the workspace fails:55 2021-12-7 17:05:35 | A JSON syntax error was found at line 1, column 256 2021-12-7 17:05:35 | Unexpected character: 't'. One of the following ch
Hello FME Community,I need to divide a line FC into 100 m segments. I can reach that with the IterativeSnippet transformer, but I have an issue with the leftovers; I don't want to divide the leftovers. In another way, I need to keep the leftover to be joined or merged with the last segment to avoid generating segments with 0. X values or other small values like 1 or 2 meters.Is there any possible way to reach this in FME?
Hi, I’m struggling to tag a set of features with an ID, input data looks like the left case in this image:What I want is shown on the right. My input has a line of data with the ID, and it’s implied each record after that has that ID, until a record resets the ID for the subsequent features. Here’s a very similar example but differs from mine in that my ID is on a separate line: It seems like a Python caller might work, but I’m not very handy with Python & FME. Any suggestions welcome. Thanks in advance!
I am trying to do a very basic read/write of an annotation feature class from one file geodatabase to another. In my case, I’m first running a PythonCaller transformer to remove any and all annotation feature classes in the target file geodatabase, then I use a FeatureReader to read the annotation feature class from the source file GDB, and then run a FeatureWriter to write the annotation FC to the target geodatabase with “Insert” and “Create if Needed” options selected for the table, which I assume is creating a new annotation feature class in the target FGDB.Regardless of minor tweaks I make to both the FeatureReader and FeatureWriter transformers, FME Flow keeps writing these as individual features instead of bulk features. There are ~450k annotation features in the feature class, so running this by writing individual features takes over an hour, which will not work for our scenario.Interestingly, the first time I ran this in an earlier workspace, FME Flow used the bulk feature sett
Hi all,Trying to set up workspaces in Form that read files directly from my ACC project using a web connection. However, my project isn’t appearing under my Hub? Appreciate this is vague but any suggestions would be great! Update - there seems to be two environments - one linked to autodesk EU and one linked to autodesk UK - not sure if this is impactful! 2nd update - one (UK) environment i can install the FME app on Autodesk but on the EU one i dont have this option - will the project not appear if the Autodesk FME app is not installed? Thanks
Hello...I've created a HTML report using HTMLReportGenerator/HTML Writer and am trying to write this report to a pdf but have not been successful. I've tried connecting both a pdf FeatureWriter and a PDF Writer to the HTMLReportGenerator output and do get a pdf file created but it's blank. Thanks.
I've run into this issue multiple times now, and it's quite serious. My SQL table writer was set to automatic and selected TINYINT as the datatype. However, one of the values I attempted to write was 5000, which exceeds the valid range for TINYINT. As a result, I expected 57 rows to be written, but only 51 actually made it into the database. Because the system only throws a warning (and buries it in a long list of logs), this kind of data loss can easily go unnoticed unless you're scanning through potentially hundreds of warnings. The warning I wish to flag or somehow cause the workbench to fail if it occurs:2025-07-17 14:15:40| 0.5| 0.0|WARN |Microsoft SQL Server Non-Spatial Writer: Failed to parse Unsigned TinyInt' from attribute value 5000' for column `How many kilolitres (kL) of liquid waste was generated?' Silent data loss is extremely dangerous in data pipelines. How can I flag this better. I am quite surprised FME doesn’t do this by default. I am sure this has impacted many peop
I’m working on a flood-affected buildings project in St. Pauli, Hamburg, using FME’s SpatialFilter transformer. I uploaded an image of my setup (see attached). Almost all buildings are being rejected, and I’m not sure why. My buildings are the "generic object," and the flooding areas are the clipped ones.
I want to re-project an image file into CRS EPSG 20047 BCSG2020But that CRS is missing from my drop-down list.I am running FME Desktop FME(R) 2022.1.3.0 (20220928 - Build 22630 - WIN64) Is CRS EPSG 20047 BCSG2020 available in a more current version?
I know I that you cannot delete feature under DWG, but what if you want seleteed a few because one of them is bad. I am GIS Specialist and I have the DWG files here… The DWG I have is a campgound that somebody worked on it and gave it to use and as I prepare to make a map for that campground and discovered that one of the entity I think “X” is out of place.What I was trying to open the 2024.1 Data Inspector and bring that Dataset into the View to see it andI use the X to turn it off and use the Save As as a new Dataset without the “X” layer . When I save it and it still comes with it every time. I tried to use different method.here is the screen shot I have here. The one I want to remove this X layer under the DWG Layer is “X” . The Red line I drew is that one that I want to delete it. I don’t have the latest version to 2025 yet… Can anyone tell me if there is another way around to fix this ?
Hello, I'm currently working with FME 2022.1 on NETCDF files from https://daac.ornl.gov/cgi-bin/dsviewer.pl?ds_id=1851 The files are .nc4 and when I try to open them on FME Workbench I have this warning. (on picture) It seems that FME can't link the dimensions defined in the file with its own "lat/lon and time functions" I tried opening these files on ArcMap 10.8.1 and the dimensions are immediately recognized correctly. How can I make FME understand that lat = lat, lon = lon and time = time ? Or how can I set it when reading the nc4 file ?