Using readers and writers to extract and load data.
Recently active
Dear All, I'm looking for tools to write ENHANCED COMPRESSED RASTER GRAPHIC (ECRG, MIL-PRF-32283) and High Resolution Elevation(HRE, NGA.IP.0002_1.0 HRE) files. I have searched the FME reader/writer list, and these two formats are not on the list. ECRG and HRE files are physically formatted within a National Imagery Transmission Format 2.1 (NITF 2.1). Is it possible to use NITF writer to export ECRG and HRE?
Hi, I have a problem. I just created a line out of multiple points of an x,y,z text file with the LineBuilder tool. The problem is that the points name are lost. After the LineBuilder I use a Chopper to split the line into segments. Now I want to add a new attribute to the line segments, which has the initial names of the points. Because due to the LineBuilder the names are lost and are everywhere the same. How can I do that?
Hi Community! I was wondering if anyone had an idea of why I am getting different values for polygonal areas when calculated in FME using AreaCalculator vs the SHAPE_Area attribute of an ESRI feature class?The geometry I am working with enters the workbench with a defined projected coordinate system (DUB-DTLM) from a dwg file and the feature dataset in which the destination feature class resides is also in DUB-DTLM.The discrepancies are minor (at the 3rd decimal place in sqm) but nonetheless have the potential to cause issues.Interestingly, when the features are interrogated in Map3D, they show the same area as is calculated in FME.Any explanation (or even hint!) as to the cause of the difference would be much appreciated.
Hi, Is there a way to divide records into equal parts based on the value of an attribute? In concrete terms, I want to divide 400 areas into 3 pieces, each of which is the same size.Thx
Hi. reading LYRX (“layer files”) from ArcGIS Pro failes when the layer file include Grouped Layers. It works just fine if the LYRX file does not include Group Layers.Thea Layer File/LYRX is made with ArcGIS Pro 3.2.2 where the LYRX file is in JSON format.
Hello.I’m trying to convert and IFC file into CityGML 3 file using the ifc-to-citygml3 FME Workspace, but when I tried to Run it, it shows this error.ISO10303-21: The input data contains a syntax error at the beginning of the file. The file should start with 'ISO-10303-21'. Ensure the file is in an ASCII character system, with no byte order marker.Unexpected character: #ISO10303-21: Invalid file format, unable to continue reading Can anyone help me fix this issue?
Hi All,I’m working on an automation that needs to identify those lines that follow the geometry from another layer. The following screenshot explains what I need to do: Red line follows a river (not exactly the same geometry but pretty close) and need to identify those red lines that follows the blue centerline….I was thinking maybe I need to calculate the percentage of overlap between red and blue?There’s other locations where the red line only overlaps the blue lines for a little section so I can ignore those, see belowAny idea how to approach this?
Hi, I am new to FME so might be making a rookie mistake. But I am trying to update AGOL from a GDB shapefile but it won’t update in AGOL. I have managed to get everything to work and it shows the updates but its not sending the data to AGOL. What am i missing here?
I have a .csv file with x, y, z coordinates. From these points, I want to create a 3D line. Currently, I have the issue that the z coordinates are not being transferred onto the line when I create a line from the points. Does anyone have an idea of how I can proceed?
I had a FME scenario running to read the feature service and related tables and write to an excel file. I have the excel writer setup to “Fanout” the dataset which used to drop each table from the feature service into its own sheet within excel. I went back to run the FME scenario and when I check the excel outputs some of the tables are missing. Prior to running the scenario I check to make sure all the tables are checked and that the reader is seeing all of the tables, which it is. I check “select all” and run the scenario but when I check excel I get 6 of 9 tables. I have double check every setting and even started a new FME template and recreated the reader/writer but I still don’t get all the tables in the excel output.Can anyone help me out? Thank you
Hi Everyone..I was able to find a workspace from community this template attached and did few changes to it and it is working as expected with sample template provided in workspace to create a GDB with domains , fieldnames and field alias. 1) This workspace consider single default words in domainlist provided in excel only like Domain1 - Attached Sample_1_Workspace template - works with 2023 version.This workspace consider single altered words domainlist like alphabets(A,B,C….) in Attached Sample_2_Workspace_template - works with 2023 version This workspace consider 2 words in domain list like FME form in attached sample_3workspace_template -doesnt work and workspace fails.. If there are any special characters or space it doesnt work like : FME Form or FME_Form. I have attached error log and all sample data files with with each workspace.. Any Experts Kindly support : How can i resolve this with text as FME Form or FME_Form (with a space or special characters. Thanks
Greetings, I’m trying to use an ETL to convert RVT files (2023) into File Geodatabase multi patch, however, the following model produces the right objects, but in the wrong location, even though when reading the RVT file directly in ArcGIS Pro, the building falls in the right place. Any clue?
Good morning,I would like to use FME processing to "periodically" update the values of certain Utility Network attributes.This concerns the updating of data which potentially can be versioned, but I am only considering here the updating of "descriptive" (simple) attributes which are not involved in asset group assettype distribution rules and which have no impact on connectivity rulesDo you have experience of the best methodology to use and perhaps illustrate this with an example Workbench?THANKS
I need to extract TAB or Shape file from S3 and read data from it including schema.I have discovered in this articlehttps://community.safe.com/data-7/how-to-extract-the-actual-shapefile-from-featurereader-geometry-and-attributes-14548?tid=14548&fid=7that FeatureReader apparently can’t read all attributes that are in the file, until I expose them. But what is I don’t know the list of all attributes? I don’t know what exactly will be uploaded by other people to S3 bucket, I just need to read the file. Could you help, please, to identify the correct settings of FeatureReader or another way to extract data?
In the JSON transformer documentation, there is a sub-section on JSON Query, which states: JSON Property ExpressionsA property expression is a structure expression as described above, followed by a . (dot) operator and a property name. Currently, the only supported properties are type and size. The type property returns the type of the JSON value referred to by the JSON structure expression. For example, if the outermost JSON element is an array, and the first element of the array is a string, then the expression json[0].type would have a value of string. The size property, which can only be applied to an array, returns the number of elements in the array. For the life of me, I cannot find any other documentation on this and am unable to get it working. I tried a similar example to the one described above ("columns" is an array) but I get the following error: The JSON query 'json["columns"].size' cannot be used to produce features. String expressions and pro
I have an asbuilt with a table that has all the locations/names of the structures. The table layer name is “text” and when i bring in the drawing, the text layer is empty. Im sure its how i have my parameters set up so a little guidance on how to read this would be great.
I am trying to upload ifc data through PostGIS Writer and while doing so, I want to generate and store the time of upload as well. However, it gives the following error: “Value of attribute 'begin_lifespan_version' could not be converted to type 'timestamptz'. Feature will be logged and skipped.” can someone help? I am a beginner in FME as well.
Morning, I am trying to transpose some data from a survey, I want to sort of Pair up the Postcode and the Question Number, then have columns of Responses with counts. Ive attached images and a fme workbench of the original data and the output I want. I have 36 questions, so want to know if there is a way to do this using a list? So I dont have to repeat this 36 times, I am not understanding how to do lists!I want to output the postcode as a column, then have a question number column. So each postcode will be repeated depending on the number of questions e.g.Question No PostcodeQuestion 1 M19 4NYQuestion 2 M19 4NYQuestion 1 M4 7ATQuestion 2 M4 7AT Then I want the next columns to be counts of the answersQuestion No Postcode Strongly Agree Agree Neither Disagree Strongly DisagreeQuestion 1 M19 4NY 2 3 1 0 2Question 2 M19 4NY 5
I am working with MongoDB trying to upsert nested MongoDB documents. The JSON format would be something like:{“name”: “XXX”,“tables” : [ {“name”: “XXXX”,“num_rows” : 3423,“fields”: [ {“name”: “XXX”, “type”: “yyyy”} , …. ]}, ….] I have no problems when I use a JSON string attribute inserting a new document with Document Source”: Json Attribute” and Insert operation.But, I do need to UPDATE existing features.In this case, the nested dcouments (tables in the json above) are created as plain strings. Which is a real inconvenience in my use-case.{“name”: “XXX”,“tables” : [ “{“name”: “XXXX”,“num_rows” : 3423,“fields”: [ {“name”: “XXX”, “type”: “yyyy”} , …. ]} “ , ….]Valid datatypes do not currently include arrays (of objects) Is there any alternative or workarounds?
Hello, we have a bunch of workspaces reading in from an SDE, all is fine in 2022 FME but after the upgrade to 2023 we can no longer read features that sit inside a feature dataset using the SDE reader. Features outside a feature dataset are fine. We have just discovered that a FeatureReader transformer will read them so maybe this is a bug in 2023?
I have an error message: ArcGIS Online Feature Service Writer: Encountered an unexpected error. The error code from the server was '400' and the message was: 'Cannot perform operation. Invalid operation parameters.'. Details: ''deletes' parameter is invalid, Input string was not in a correct format.' ARCGISONLINEFEATURES writer: An error has occurred. Check the logfile above for detailsI have checked the log file but honestly I am not sure what I am looking for. Attached is the logfile and my AGOL service format.Thanks
I am writing a geopackage file in FME but when I try to use it in ArcGIS Pro I get this error message. Any idea what could be wrong?“Failed to add data ...main.GNG.anlaggningsomrade. Invalid parameter value passed to function[no such table: main.GDB_Items}”FME Workbench 2022.2.2ArcGIS Pro 3.2
This must be very basic but I discover FME and I couldn’t find how to do yet. I would like to find the value from the next row in the table to use in a transformer later. For example: I would like to fill in the column C with just the informations from the column B. Can I do that in the TextEditor by saying something like “colB” +1 or “colB” NextValue?
I am starting to work with reading and writing OData. I can see there is an OData reader but no writer. Writing seems to be possible using the HTTP caller. Is there a particular reason why there is no OData writer? Are there plans for an OData writer? Just want to make sure we are building the process correctly.
Hello FME enthousiasts, I've been building a simple workspace for a collegue to get some parcel data from a public WFS. When I run the process it all seems to work (i get the desired parcel written to a File Geodatabase). But it keeps giving a single WFS error in the log, but the error apparently doesn't stop it from running:<WFS> GetFeature URL: `https://service.pdok.nl:443/kadaster/kadastralekaart/wfs/v5_0?SERVICE=WFS&VERSION=2.0.0&REQUEST=GetFeature&TYPENAMES=kadastralekaart%3APerceel&FILTER=%3CFilter%3E%3CAnd%3E%3CPropertyIsEqualTo%3E%3CPropertyName%3EAKRKadastraleGemeenteCodeWaarde%3C%2FPropertyName%3E%3CLiteral%3ERNN01%3C%2FLiteral%3E%3C%2FPropertyIsEqualTo%3E%3CPropertyIsEqualTo%3E%3CPropertyName%3Esectie%3C%2FPropertyName%3E%3CLiteral%3EK%3C%2FLiteral%3E%3C%2FPropertyIsEqualTo%3E%3CPropertyIsEqualTo%3E%3CPropertyName%3Eperceelnummer%3C%2FPropertyName%3E%3CLiteral%3E36%3C%2FLiteral%3E%3C%2FPropertyIsEqualTo%3E%3C%2FAnd%3E%3C%2FFilter%3E&OUTPUTFORMAT=app