Using readers and writers to extract and load data.
Recently active
Hi everyone, I’ve got many excel files and I need to extract some values in specific cells from them, then write these values into a new excel file. These excel file come with same schema, but may with different sheet names.For example, I got resume A, B and C, I want to extract NAME from cell B2, AGE frome cell C4, E-MAIL from D3 and PHONE from D6. And sheets name for resume A is ‘Jack’, for resume B is ‘sheet1’ and for resume C is ‘resume’. And now I want to write these information into a new excel, column A is NAME, column B is AGE, column C is E-MAIL and column D is PHONE.I know this must be a very basic function for FME, but how can I make this possible, I tried to search from the community without any result, maybe I input wrong keywords due to I’m a non-English speaker, please help me out, if would be better for me to understanding if you can attach a screenshot or a workbench file.Thank you very much.
I am trying to load data from a previously created ArcGIS geodatabase into another previously created one.Utilizing FME Workbench, I designed the workflow successfully which takes data from the original gdb as a reader, adding some transformers for manipulation and then finally loading the results into the target gdb as a writer.While the loading and translations were successful, but I have noticed that field aliases that were created through ArcGIS pro previously in the destination geodatabase were dropped out.What is the reason behind this ????
Hi! I have encountered the following error when using Feature Writer transformer (dynamic workspace) writing a Microsoft SQL Server Spatial table. 2025-08-06 16:11:20| 148.0| 0.0|ERROR |Microsoft SQL Server Spatial Writer: Query failed, possibly due to a malformed statement. Query Text `CREATE TABLE [Infrastructure].[Fire_Hydrants_Audit] ([FH_ID] bigint, [Work_Required] bit, [Paint_Post] bit, [New_Post] bit, [Paint_Surround] bit, [Clear_Vegetation] bit, [Post_Reflector] bit, [Inspection_Date] datetime2, [Inspected_By] varchar_max, [Works_Completed] bit, [MI_PRINX] integer, [SP_GEOMETRY] geometry)'. Provider error `(2715) Column, parameter, or variable #9: Cannot find data type varchar_max.'Any thoughts how to resolve this? Thanks!
I am working on a lot of the DWG we got from a contractor and I have to deal with it because our forest is using a different projection and the units are different. However, I have no troube with write to a new DWG with the correct projection and units.The only one probem I have here is the Annotation which is different between the FME Data Inspector and ArcGIS Pro I have here. The Annotation scale is way big and all over that I cannot read in ArcGIS Pro.Is there a work around to fix the problem ?I am in Colorado and work for a forest service. I have two screenshot that will be helpful This picture is in FME : and this is in ArcGIS Pro Can anyone out there that have had similiar issues or a problem solved in the past ? Thanks !
What controls the order in which tags are written in the OSM XML writer? I have a set of attributes that are ordered alphabetically in the writer. The attributes are even ‘ordered’ on the features (which shouldn’t matter?). As you can see 'smoothness’ was assigned as the second tag, when I would have expected ‘highway’ to be the second tag.Inspecting the written dataViewing the XML file in Notepad++Attributes are listed alphabetically on the OSM XML writer.
Hello ! I have a DWG that has a different type of feature that I cannot convert to ArcGIS Pro because it does not recongize it or unable to keep it preserve the line..This is an oiginial DWG I have here : After I save them to a new DWG with set to ESPG 26913. I got this It looks like a feature change for line from an oroginal to a new one above the picures here… Is there a way for me to preserve the lines from change it ? Thanks
Hi,I am trying to read from a publicly available WMS service (https://environment.data.gov.uk/spatialdata/nafra2-risk-of-flooding-from-surface-water/wms), layerrofsw_4band.I have connected to the service in FME Form using a reader and bounding box for my area of interest. The reader runs, reporting success, but returns only a single line entry and a white dotted square in the preview.Adding the layer to ArcPro works fine and data can be viewed as expected.I believe the issue is due to scale thresholding applied to the service by the provider. No features are returned unless the map scale is less than 1:50k. My bounding box is much bigger.This forum post is the closest to my problem, Problems reading WMS layers? | Community, but doesn't suggest a solution.In the reader it does not seem possible to set the scale to operate at.Would the workflow required to access the features be something like:Split my area of interest into a grid, where each square is <1:50k. Somehow call the WMS ser
Hello,I'm scraping data using an HTTPCaller.One of the attributes contains GeoJSON data:{"type":"FeatureCollection","features":[{"type":"Feature","properties":{},"geometry":{"coordinates":[[[5.96266096723135, 51.9996241913007],[5.96267141231219, 51.9996290142943],[5.96315710713663, 51.999175649922],[5.96290120337337, 51.9991708268575],[5.96266096723135, 51.9996241913007]]],"type":"Polygon"}}]}I'd like to visualize these polygons in the Data Inspector but I don't know how to convert this data into an actual polygon.What transformers do I need?Thanks
Which Fme Transformer will enable me write an Excel Output Data to accept Large Numbers (e.g. No1 below) No1 4111101101005601100102002 No2 Instead of this Scientific Notation of Enconded Number (e.g. No 2 below) 4.1111011010056E+24
Hello Folks,I have been presented with an interesting issue.I have a CSV which consist of data with multiple headers and related data for those headers. #header 1 and valuesobservationId,broid,_response_body_new,_http_status_codeid_01682157639,GLD000000036023,"""BRO-ID"",""bronhouder"",,""kwaliteitsregime"",""datum eerste meting"",""datum recentste meting""GLD000000036023"",""50200097"",,""IMBRO"",""(2005-11-27, JJJJ-MM-DD)"",""(2025-04-10, JJJJ-MM-DD)"",,,,,#header 2 and values""put BRO-ID"",""put buisnummer"",,""monitoringnet BRO-ID"",,GMW000000074173"",""2"",,,,,,,,,#header 3 and valuesobservatie ID"",""start observatieperiode"",""eind observatieperiode"",""observatietype"",""mate beoordeling"",""observatieproces ID""id_OMO_95135"",""(2024-07-18, JJJJ-MM-DD)"",""(2025-04-10, JJJJ-MM-DD)"",""reguliereMeting"",""volledigBeoordeeld"",""id_OP_95135"",,,,,#header 4 and values""tijdstip meting"",""waterstand"",""status kwaliteitscontrole"",""censuurreden"",""censuurlimietwaarde"",""inter
Hi everyone,I’m pretty new to FME and I’m using FME Workbench 2024.2 to move data from my sde gdb schema to an Esri Parks and Grounds solution fgdb schema. I’m having trouble with the SchemaMapper and moving my domains(attribute values) to the fgdb’s schema. Currently they are not mapping. Previous SchemaMapper parameter settings moved the source attribute value over to the target attribute, but kept the same source attribute value (MULTI-FEATURE STRUCTURE should’ve changed to Jungle Gym but instead it stayed as MULTI-FEATURE STRUCTURE). Can anyone help provide more instruction on how to get the source attribute values to move to the target attribute name and change to the target attribute value?Here’s the .xlsx I’m referencing Here’s my SchemaMapper Parameters
I have an ArcGIS Online hosted feature layer containing point features that have attachments enabled. Could someone help me with some advice for how to use the ArcGIS Online feature reader that will allow me to access the features and their associated attachments (if there are any-not all features have an attachment)? It is easy enough to get the features, but I can't see a way to access the attachments. Thank you!
Hi, I am using a bufferer and a dissolver transformer to generate a buffer polygon from an aggregated set of 500+ geometries. The Inspector is showing the generated geometry but the Oracle Spatial writer is unable write the geom into the spatial table. I am getting the error "Bad geometry detected in the following feature; Geometry could not be encoded for Oracle". I have added a GeometryValidator after the Dissolver transformer. The generated geom comes through the PASSED output but still the error remains. FME Desktop 2013 is used. Regards, Ananda
I’ve got a weird problem where an Excel reader is reading an entire file correctly, except for one column where it is only getting part of the data. When I decode the XML of the Excel file (change extension to .zip and expand), I can look at sheet1.xml and I see the following data:<c s="12" t="inlineStr" r="AK10"> <is> <r> <rPr> <b val="0"></b> <i val="0"></i> <strike val="0"></strike> <u val="none"></u> <sz val="10"></sz> <color theme="1"></color> <rFont val="Courier New"></rFont> </rPr> <t xml:space="preserve"> </t> </r> <r> <rPr> <b val="0"></b> <i val="0"></i> <strike val="0"></strike>
I’m using FME 2021.WAL is possible pour SQLite since 2010, Geopackage is based on SQLite. I didn’t find any way to activate WAL on a Geopackage FeatureWriter in order to avoid lock problems.How can I use WAL on Geopackage ? Is it available in later release ?
Hello, I am using FME Form 2025 and looking to write shapefiles/ geodbs dynamically to an ArcSDE Geodb.My issue is that where my source data has the data type VARCHAR2 it is written into Oracle as NVARCHAR2.According to our database manager our preference is VARCHAR2 due to: “VARCHAR stores each character using a single byte, NVARCHAR columns typically consume twice as much storage space as equivalent VARCHAR columns.”I have tried multiple options of resetting the data types and writing out either using automatic attribute definition or dynamic (using the readers schema), but in any case the final table stores NVARCHAR2.Is it possible to change the data type from within FME?Many Thanks!
Hi all, how do I easiest update change the field type in a GDB?Esri Introduced the BigInteger, which is giving me a lot of issues. It dosn’t work in all applications, and I can’t even do a relate or join on it. I need to get it into a integer. For some reason the data we get delivered now on a weekly basis has all the number fields in BigInteger.I need it to find the BigInteger Fields, and change the type, without loosing data. The data also fits an normal integer.Any thoughts would be much appreciated. Thanks
Hi, I'm having an issue with a Microsoft Access Reader. I have a script that reads a query from Access. This query is a subquery of two other queries. Until now, the script has always worked, but now the query reader doesn't show anything.
Hi, taking my first steps in the FME REST API and webhooks, and struggling on passing coordinates. I published a simple workspace to FME server using the Geometry Pïcker as only parameter, the drawn polygon is noted in GeoJson, like:{"type":"Polygon","coordinates":[[[3.732869,51.016178],[3.733537,51.016688],[3.734896,51.015998],[3.734086,51.015473],[3.732869,51.016178]]]} I created a webhook from this workspace, the URL preview shows the special characters should be encoded, like:https://FMEserver/workspace.fmw?DrawnPolygon=%7B%22type%22%3A%22Polygon%22%2C%22coordinates%22%3A%5B%5B%5B3.732869%2C51.016178%5D%2C%5B3.733537%2C51.016688%5D%2C%5B3.734896%2C51.015998%5D%2C%5B3.734086%2C51.015473%5D%2C%5B3.732869%2C51.016178%5D%5D%5D%7D&opt_showresult=false&opt_servicemode=sync but, when I GET-request through this URL, the workspace fails:55 2021-12-7 17:05:35 | A JSON syntax error was found at line 1, column 256 2021-12-7 17:05:35 | Unexpected character: 't'. One of the following ch
Hello FME Community,I need to divide a line FC into 100 m segments. I can reach that with the IterativeSnippet transformer, but I have an issue with the leftovers; I don't want to divide the leftovers. In another way, I need to keep the leftover to be joined or merged with the last segment to avoid generating segments with 0. X values or other small values like 1 or 2 meters.Is there any possible way to reach this in FME?
Hi, I’m struggling to tag a set of features with an ID, input data looks like the left case in this image:What I want is shown on the right. My input has a line of data with the ID, and it’s implied each record after that has that ID, until a record resets the ID for the subsequent features. Here’s a very similar example but differs from mine in that my ID is on a separate line: It seems like a Python caller might work, but I’m not very handy with Python & FME. Any suggestions welcome. Thanks in advance!
I am trying to do a very basic read/write of an annotation feature class from one file geodatabase to another. In my case, I’m first running a PythonCaller transformer to remove any and all annotation feature classes in the target file geodatabase, then I use a FeatureReader to read the annotation feature class from the source file GDB, and then run a FeatureWriter to write the annotation FC to the target geodatabase with “Insert” and “Create if Needed” options selected for the table, which I assume is creating a new annotation feature class in the target FGDB.Regardless of minor tweaks I make to both the FeatureReader and FeatureWriter transformers, FME Flow keeps writing these as individual features instead of bulk features. There are ~450k annotation features in the feature class, so running this by writing individual features takes over an hour, which will not work for our scenario.Interestingly, the first time I ran this in an earlier workspace, FME Flow used the bulk feature sett
Hi all,Trying to set up workspaces in Form that read files directly from my ACC project using a web connection. However, my project isn’t appearing under my Hub? Appreciate this is vague but any suggestions would be great! Update - there seems to be two environments - one linked to autodesk EU and one linked to autodesk UK - not sure if this is impactful! 2nd update - one (UK) environment i can install the FME app on Autodesk but on the EU one i dont have this option - will the project not appear if the Autodesk FME app is not installed? Thanks
Hello...I've created a HTML report using HTMLReportGenerator/HTML Writer and am trying to write this report to a pdf but have not been successful. I've tried connecting both a pdf FeatureWriter and a PDF Writer to the HTMLReportGenerator output and do get a pdf file created but it's blank. Thanks.
I've run into this issue multiple times now, and it's quite serious. My SQL table writer was set to automatic and selected TINYINT as the datatype. However, one of the values I attempted to write was 5000, which exceeds the valid range for TINYINT. As a result, I expected 57 rows to be written, but only 51 actually made it into the database. Because the system only throws a warning (and buries it in a long list of logs), this kind of data loss can easily go unnoticed unless you're scanning through potentially hundreds of warnings. The warning I wish to flag or somehow cause the workbench to fail if it occurs:2025-07-17 14:15:40| 0.5| 0.0|WARN |Microsoft SQL Server Non-Spatial Writer: Failed to parse Unsigned TinyInt' from attribute value 5000' for column `How many kilolitres (kL) of liquid waste was generated?' Silent data loss is extremely dangerous in data pipelines. How can I flag this better. I am quite surprised FME doesn’t do this by default. I am sure this has impacted many peop