Using readers and writers to extract and load data.
Recently active
Hey. Hey. I have a problem with GeoJson. GeoJson automatically writes the geometry and I would need to write an extra "layer" block to this geometry block, see attachment layer. I tried to create a template on json templater see fmwt, but it doesn't work. The idea of this template was that I would define the structure as json including the "layer" block and then write it as text with all parameters as geoJson, but I don't know if this is a good way to go. Would you recommend me any other options? I also have the schemas available, but I'm not sure on which transformer and in what combination with other transformers to use them to achieve the result. Thank you very much
Hi all, I did not found the way to remove the M dimension from a shapefile to include it into a postgis geometry defined as linestringZ. Do you know the transforer to be used ? Thanks, Pierre
Hello all,I have succeeded in building a workspace that Reads from Oracle and Writes a fileGDB that includes metadata for the feature layer in the fileGDB. I used an XMLTemplater to achieve this.I am successful when I use the Writer Esri Geodatabase (File Geodb)However, I would prefer to use the Writer Esri Geodatabase (File Geodb Open API)But when I substitute this Writer, it fails to include the metadata for the feature layer.Is there some setting that I am missing?Or is this functionality just missing from the Open API Writer?
I´m in need to calculate the shortest distance in 3d between a set of basepoints and a line.Something similar to a Neighborfinder in 3d mode.Do any of you know a way to do this?
Hello, i have an api which i need to read on a daily basis.I use an httpcaller, this is what i get.{ "values" : [ { "id" : "66d9f33fa4766fe73ac59fb9", "start_time" : "2024-09-05T20:06:55+02:00", "end_time" : "2024-09-05T20:07:54+02:00", "vehicle" : { "id" : "xxxxx", "country_code" : "BE", "id_type" : "licenseplate" }, "price" : { "amount" : 0, "vat" : 0 }, "right_type" : { "code" : "PAID_PARKING" }, "area" : { "code" : "xxxx", "area_manager_id" : "611e58c434e393575bd3a064" }, "registration_time" : "2024-09-05T20:06:55.593+02:00", "registered_by_organization" : { "code" : "xxxxx", "name" : "xxxxx" }, "external_user_reference" : "31358053", "channel" : { "medium" : "api" }, "tariff" : { "id" : "653ba7cd9c4bdbc
I’m working through a test case to pull a table data from one of our MS SQL databases into Google BigQuery. I’ve downloaded and installed the BigQuery package from FME Hub and setup the needed Clientid and secret to have it connect to our Google Cloud project. It tests successfully in the services setup, and if I use the GoogleBigQueryConnector, I’m able to select our cloud project and dataset for reading, so I know the connectivity part of it is working. The issue is trying to write something to BigQuery.If I go to create a writer and choose “Google BigQuery” as the format, the Format selection stays red, like it’s an invalid selection. What am I missing?Unable to select Google BigQuery as a Writer format
I have a giant spreadsheet that many people have added notes or comments to by right-clicking on the cell and saying "new comment" or "new note". Is there a way for fme to figure out which cells have comments?
Hi, I created a shapefile with line segments (roads). This shapefile has to be loaded into a postgis database and the person who has to do that sends me that she gets this error ERROR: Column has M dimension but geometry does notCONTEXT: COPY tmp_shp_crab_wegsegment, line 1, column geom: "01050000208A7A00000100000001020000000700000000F3BE9F41600A4180690B0048FD0941005FDD2623600A41008F7F97..."I did some searching on the forum and found some things like the Measure remover, and I also set the output dimension to 2D in the writer but she says she still gets it. Does anyone know what else it could be due to? Thx!Nathalie
Hi everyone! So I have some LAS files that I would like to filter. The flow is as follows:Everything seems to be working, but when I read the processed las-files into my program that I need to use, I can’t get it to work. The original files do work, so it’s something that happens along the way. Any ideas?
I’m trying to read this wfs-service https://avoin.metsakeskus.fi/rajapinnat/v1/gridcell/wfs or alternatively https://avoin.metsakeskus.fi/rajapinnat/v1/gridcell/ows with FeatureReader and FME returns following error: 2024-09-11 10:32:43| 0.0| 0.0|ERROR |<ows:ExceptionReport xmlns:xs="http://www.w3.org/2001/XMLSchema=" xmlns:ows="http://www.opengis.net/ows=" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance=" version="1.0.0=" xsi:schemaLocation="http://www.opengis.net/ows https://avoin.metsakeskus.fi/rajapinnat/schemas/ows/1.0.0/owsExceptionReport.xsd="><ows:Exception exceptionCode="InvalidParameterValue=" locator="namespace="><ows:ExceptionText>Unknown namespace [v1]</ows:ExceptionText></ows:Exception></ows:ExceptionReport>2024-09-11 10:32:43| 0.0| 0.0|ERROR |Received error report: ExceptionReport2024-09-11 10:32:43| 0.0| 0.0|ERROR |The XML Module halted on error, see the logfile for details2024-09-11 10:32:43| 0.0| 0.0|ERROR |A fatal error has oc
Hi guys i been working on a “easy translator” type of app on Flow and really struggling to get it read shapefiles in a zipped file. Error message below.. have no idea why it add a “_0” after “.zip”.. can this be the reason it failed? Shapefile Reader: 'C:\Users\SVCAWS~1.SC\AppData\Local\Temp\fmeengines\AWSGISFME01_Dynamic_Engine1\TempFS_1725628283291_20936\dsGENERIC_1_0\Inputtt.zip_0' is not a valid Shapefile and cannot be read Thank guys!
I have a fileGDB with a single feature class, and that feature class has metadata.How do I export that metadata to an XML file?I am using FME Desktop (FME Form) 2022.1
Hello, I have recently upgraded FME Form 2024.1. I tried to run a project, but I immediately got the following error message: “FME failed to restore the process locale to UTF-8. A non-UTF-8 process locale may cause undefined behavior.” Is there any quic fix for this issue?
Hi, Is it possible to rollback all the inserts been made to database through multiple writers(Oracle/Esri) if one of the writers fail?
Hello guys,i am a little desperate in my attempt to write data from our oracle spatial database to AIXM gml. I already watched the Overcoming the Complexities of AIXM with Model Based Data Integration - FME by Safe Software webinar and also read this artical https://support.safe.com/hc/en-us/articles/25407686750477-AIXM-4-5-and-5-1-Reading-Writing-and-Validation-EU-Airports-Demo. discussing the matter. I even downloaded the demo workspaces to try to figure out why exactly mine is not working but without any result yet. I will attach my workspace , a log-file of a successful translation and the resulting gml file to this post and i hope that someone can make out the issues.Dont wonder about the Geometry-Extracter and Geometry-Replacer transformer i use in the workspace, i have already tried it without them and thought they could help, but also with no result.Thank you guys for reading this and helping me out in advance, it is very much appreciated!
HelloCould not able to write “Esri Geodatabase (File Geodb Open API)” facing Error Geodatabase Error (-2147219884): this so frustrating form last 2 days i am suffering from this issue.
Team: I have been developing some processes in fme server 2018 and have an issue that I am not sure how to troubleshoot. The work bench is pretty simple, read access, sort some things, a couple of joins and then push the data into a clean database that has the same schema as the source data via a feature writer instead of an access writer in the workbench—this forces me to use a 2 step approach as I have some SQL executors port processing.The feature writer works in desktop but not on server. Initially, I thought it was a permissions issue, but then I broke the process—to a 2-step approach—each process worked fine independent of each other. The log below contains the information related to the issue that I had with the first approach—handling everything in 1 process. I was basically pushing records to a couple of clean preexisting tables. I don’t have a project number for support, I will be happy to talk to any of you later tonight to see if we can solve this to make sure its not a p
Hi guys,im working on a data loading workbench for our sql sde database. when applying change detection before writting into database, is there a way it can be dynamic and detect changes in group? Like original dataset a comparing to update dataset a, and b to b with key and compare field listed in a sheet? Thanks guys!
Hi All, I am trying to reproject some .e57 files containing LiDAR scans and oriented imagery collected with a terrestrial scanner. Reprojecting the point cloud is straightforward, but I am having some trouble with the imagery.I can see in the Feature Information window that the image locations seems to be stored in the e57_translation_x, y, and z Geometry Traits (Geometry->Raster->Geometry Traits), here’s a screenshot from Data Inspector:I’m working from a local coordinate system, hence the low translation values.My goal (I think) is to extract these translation values, reproject them in the same way I’m reprojecting the point cloud, and then write the new values back in to these traits, but I’m not sure how to access these trait values, and was wondering if anyone had experience with this. Thanks for looking!
Hello everyone,I'm looking for a way to check if the ending character of a string attribute is an uppercase letter, and if so, convert it to lowercase. For example:Foo1K → Foo1k BAR4 → BAR4 BAZ → BAzWhat's the best way to accomplish this in FME? Are there any specific transformers or approaches that I should use to achieve this result?
Hello there, How can I read a tsv file in FME? Do we need to use csv format only:? Thanks,Siva
I have a shapefile that can’t be read by FME Workbench 2024.1.1 or 2022.2.3. The copied log is attached.The “Speed Zones” shapefile comes from https://opendata.transport.nsw.gov.au/dataset/speed-zones where you have to login and download the "Speed Zones data" as a ZIP file. Once unzipped you get the standard 4 files.When I load the shapefile into QGIS, it shows the following properties: 434MB MultiLineString 442,943 features EPSG:3308 - GDA94 / NSW Lambert Fields: Type Text (string) 200 length Status Text (string) 200 length Direction Text (string) 200 length Speed Text (string) 200 lengthThe only issue I can see is that there is no unique identifier field but I didn’t think that was an issue for FME. Any suggestions on how to read this file into FME?ThanksDoug
Hi,I have an NDVI raster and need to clip it with many polygons. After that, I need to calculate the standard deviation for each piece of the raster (clipped by the polygons), and in the end, I need to correctly assign the deviation value to the attributes of the corresponding polygon. Thank´s
Not a question, but just an issue I thought worth sharing. When converting my data to a geodatabase, I kept getting the following error message: "Geodatabase Error (-2147219884): The Field already exists". Not a very helpful error message and googling this didn't help much.It turned out that my sewer pipe input file had a field named 'shape', and geodatabases don't like that! Using the AttributeRenamer to change the field to 'shape1', everything then went tickety-boo!
Is there any way to read dynamically any excel file and that the header are simply the column name A, B, C, D...Through a Reader I can read any Excel file but the problem is that it always takes the first row as the header.Thank you!