Using readers and writers to extract and load data.
Recently active
I'm trying to overwrite a date/time field with two columns from an excel file. I'd like to use attribute manager to concatenate the two columns into (Date) MM/dd/yyyy and (Time) HH:mm:ss AM/PM however I'm getting null values. The datetimeconverter led to an error saying my format wasn't FME standard. Any help is appreciated, thank you.
Hello, Im searching for a solution to give records a group value based on multiple values statements. Data needs to be grouped on a Vehicle in time asc.So far this is not the problem.The grouping also needs to Start with a value Status = "Start”and all the other records after Start.The grouping needs to be closed after Status End comes as a record.It looks like a range or a ranking. If someone has some idea thanks. Kind regards, Nick
Hello!I am importing data from Aerodrome data (gdb) to AMDB. Aerodrome has reflectors on the edges of taxyway. What should these reflectors be stored as in the AMDB?Maybe AerodromeSurfaceLighting or some kind of Marking or AerodromeSign or something else? The Reflectors
Hi, Ive noted that CouchDB has been deprecated. Of course, this is the exact thing I need right now :( Is there any alternative way to access this database using the latest (2024) version of FME?
I’m using the ESRI ArcGIS Online Feature Service Writer to update a layer in AGOL. I have it configured as per the screenshot below.After it runs, the layer in AGOL is visible when zoomed all the way out!So, I then republish the layer in ArcGIS Pro and it fixes the layer so that it now disappears when zoomed out (I could also do this directly in AGOL).I then change the FME writer to ‘Use Existing’ (and not ‘Truncate Existing’) and re-run the translation.This time it works without affecting the AGOL layer visibility.So I change the FME writer back to ‘Truncate Existing’ (and not ‘Use Existing’) and re-run the translation.It breaks the AGOL layer visibility again!I plan to use something like this to update many layers, and I cannot have them all visible when zoomed out. It would be a complete mess.Am I doing something wrong? How can I update the data (including deleting features) without affecting the AGOL layer’s visibility?(The issue occurs for both 'Insert' and 'Upsert'. I’m using
Hello,Is it possible to write new fields in ArcGIS Portal Feature Service with a writer ?I’m getting that message : ArcGIS Portal Feature Service Writer: Attribute 'NAME' on feature type 'Roads' does not match any field on the corresponding layer/table. The attribute will be ignored I can’t believe I have to create those fields with ArcGIS Pro, publish the layer and than run my workbench. Update:OK I just found out that I need my fields to be in lowercase to make it work.But for some reasons some field type are not working.Is there any existing list of all the constraints we need to follow for the fields in Portal? That would save me time! Thanks!
I have a script that pulls numerous datasets together, formats them into a consistent set of attributes and then writes them to .TAB files.I’m having difficulty with date field (STARTD) in the final output because although appearing to be correct in the .TAB files, ArcPy is not able to detect the dates in the .TAB files and instead shows the data as odd characters. Please see the image below for more information. Has anyone seen this before or aware of how to fix the issue? I’m not sure if there is a setting in my FME script that may need to be amended.
Hello,i need to process excel files, currently by means of FME Form 2023.1, perspectively using FME Flow. These files, however, can differ in columns available. See attachments. The files are processed individually, only one file at a time.If i run the process with file “tk_template_v0.0.xlsx” I want the featurereader to display only the columns, containing in this file. If I run “tk_template_v0.1.xlsx”, which has got 3 more columns, i want these columns to be available in the process as well.I would like to run the script with these files without clicking on the “Feature Types to Read” button any time I process a new file! The sheet name always have the name “Tabelle1”.Unfortunately I do not find a set of parameter that results in the desired output.The existing posts have not yet enlighten me! Any ideas?
We have a reader plugin (c++) that should be able to set aggregated/ multiple geometry to an IFMEFeature.For example:We have only several IFMEGeometry objects. These IFMEGeometry objects should be set to an IFMEFeature. So that we have finally an IFMEFeature that consists of several different geometry objects/ parts. IFMEFeatureIFMEGeometry_Part_1 IFMEGeometry_Part_2 …. IFMEGeometry_Part_nfme_type = fme_areafme_geometry = fme_aggregatefme_feature_type = DepthArea How can we solve this?
Hi,I have thousand of Excel files I need to read but all of them have different starting attributes line. Sometimes line 15 or 16 or 17.(not me who developed that method of working….)The attributes are all the same for all the files.Any idea how I could have the Excel Reader to detect the starting line?Thanks !
Hi, I’m looknig for a way to colorize polygons based on attribute value for writing to HTML and further use in data streaming service with workspace app. Each polygon have attributes with unique name and color.I want to apply these colors to based on the values in the “name” attribute. I know it’s possible to replace text in the “html_content” using the string replacer but how can I make use of my existing attributes when adding eg. a javaScript function? I guess I need to populate the feature properties dynamically from name attribute:However my edits seem to be omitted when written to final html…Any examples/ideas on this
Hello Forum, I need to convert a tab file to geojson, which is ordinarily a simple task. However I am getting this error message…“MITAB Reader: Unsupported table type 'NativeX' in file #######################. This type of .TAB file cannot be read by this library.”Note that the # symbols are masking the UNC path and file name.Does anyone know a way around this? Thanks,Stuart
Hey. Hey. I have a problem with GeoJson. GeoJson automatically writes the geometry and I would need to write an extra "layer" block to this geometry block, see attachment layer. I tried to create a template on json templater see fmwt, but it doesn't work. The idea of this template was that I would define the structure as json including the "layer" block and then write it as text with all parameters as geoJson, but I don't know if this is a good way to go. Would you recommend me any other options? I also have the schemas available, but I'm not sure on which transformer and in what combination with other transformers to use them to achieve the result. Thank you very much
Hi all, I did not found the way to remove the M dimension from a shapefile to include it into a postgis geometry defined as linestringZ. Do you know the transforer to be used ? Thanks, Pierre
Hello all,I have succeeded in building a workspace that Reads from Oracle and Writes a fileGDB that includes metadata for the feature layer in the fileGDB. I used an XMLTemplater to achieve this.I am successful when I use the Writer Esri Geodatabase (File Geodb)However, I would prefer to use the Writer Esri Geodatabase (File Geodb Open API)But when I substitute this Writer, it fails to include the metadata for the feature layer.Is there some setting that I am missing?Or is this functionality just missing from the Open API Writer?
I´m in need to calculate the shortest distance in 3d between a set of basepoints and a line.Something similar to a Neighborfinder in 3d mode.Do any of you know a way to do this?
Hello, i have an api which i need to read on a daily basis.I use an httpcaller, this is what i get.{ "values" : [ { "id" : "66d9f33fa4766fe73ac59fb9", "start_time" : "2024-09-05T20:06:55+02:00", "end_time" : "2024-09-05T20:07:54+02:00", "vehicle" : { "id" : "xxxxx", "country_code" : "BE", "id_type" : "licenseplate" }, "price" : { "amount" : 0, "vat" : 0 }, "right_type" : { "code" : "PAID_PARKING" }, "area" : { "code" : "xxxx", "area_manager_id" : "611e58c434e393575bd3a064" }, "registration_time" : "2024-09-05T20:06:55.593+02:00", "registered_by_organization" : { "code" : "xxxxx", "name" : "xxxxx" }, "external_user_reference" : "31358053", "channel" : { "medium" : "api" }, "tariff" : { "id" : "653ba7cd9c4bdbc
I’m working through a test case to pull a table data from one of our MS SQL databases into Google BigQuery. I’ve downloaded and installed the BigQuery package from FME Hub and setup the needed Clientid and secret to have it connect to our Google Cloud project. It tests successfully in the services setup, and if I use the GoogleBigQueryConnector, I’m able to select our cloud project and dataset for reading, so I know the connectivity part of it is working. The issue is trying to write something to BigQuery.If I go to create a writer and choose “Google BigQuery” as the format, the Format selection stays red, like it’s an invalid selection. What am I missing?Unable to select Google BigQuery as a Writer format
I have a giant spreadsheet that many people have added notes or comments to by right-clicking on the cell and saying "new comment" or "new note". Is there a way for fme to figure out which cells have comments?
Hi, I created a shapefile with line segments (roads). This shapefile has to be loaded into a postgis database and the person who has to do that sends me that she gets this error ERROR: Column has M dimension but geometry does notCONTEXT: COPY tmp_shp_crab_wegsegment, line 1, column geom: "01050000208A7A00000100000001020000000700000000F3BE9F41600A4180690B0048FD0941005FDD2623600A41008F7F97..."I did some searching on the forum and found some things like the Measure remover, and I also set the output dimension to 2D in the writer but she says she still gets it. Does anyone know what else it could be due to? Thx!Nathalie
Hi everyone! So I have some LAS files that I would like to filter. The flow is as follows:Everything seems to be working, but when I read the processed las-files into my program that I need to use, I can’t get it to work. The original files do work, so it’s something that happens along the way. Any ideas?
I’m trying to read this wfs-service https://avoin.metsakeskus.fi/rajapinnat/v1/gridcell/wfs or alternatively https://avoin.metsakeskus.fi/rajapinnat/v1/gridcell/ows with FeatureReader and FME returns following error: 2024-09-11 10:32:43| 0.0| 0.0|ERROR |<ows:ExceptionReport xmlns:xs="http://www.w3.org/2001/XMLSchema=" xmlns:ows="http://www.opengis.net/ows=" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance=" version="1.0.0=" xsi:schemaLocation="http://www.opengis.net/ows https://avoin.metsakeskus.fi/rajapinnat/schemas/ows/1.0.0/owsExceptionReport.xsd="><ows:Exception exceptionCode="InvalidParameterValue=" locator="namespace="><ows:ExceptionText>Unknown namespace [v1]</ows:ExceptionText></ows:Exception></ows:ExceptionReport>2024-09-11 10:32:43| 0.0| 0.0|ERROR |Received error report: ExceptionReport2024-09-11 10:32:43| 0.0| 0.0|ERROR |The XML Module halted on error, see the logfile for details2024-09-11 10:32:43| 0.0| 0.0|ERROR |A fatal error has oc
Hi guys i been working on a “easy translator” type of app on Flow and really struggling to get it read shapefiles in a zipped file. Error message below.. have no idea why it add a “_0” after “.zip”.. can this be the reason it failed? Shapefile Reader: 'C:\Users\SVCAWS~1.SC\AppData\Local\Temp\fmeengines\AWSGISFME01_Dynamic_Engine1\TempFS_1725628283291_20936\dsGENERIC_1_0\Inputtt.zip_0' is not a valid Shapefile and cannot be read Thank guys!
I have a fileGDB with a single feature class, and that feature class has metadata.How do I export that metadata to an XML file?I am using FME Desktop (FME Form) 2022.1
Hello, I have recently upgraded FME Form 2024.1. I tried to run a project, but I immediately got the following error message: “FME failed to restore the process locale to UTF-8. A non-UTF-8 process locale may cause undefined behavior.” Is there any quic fix for this issue?