Using readers and writers to extract and load data.
Recently active
I am trying to read data from a large PostGIS database. Because the database is so large I am using the featurereader and the initiator as a spatialfilter. However, I discovered that not all the data from the PostGIS database is loaded. The PostGIS database contains tables with multiple geometry types. For example there is one table called "wall" containing both polyline and polygon geometries.It seems like the featurereader uses the first encountered geometry type from a feature and ignores all other types. In my case it only loads polyline geometries from the wall table.Is there a way to also load the other geometries with the featurereader? Or another way to load a large PostGIS database while using a spatialfilter where I do not have this problem?
Ok, so on rare occasions it appears that a certain feature class gets corrupted in a file gdb. The data is still there but you can't edit or add new data to the table. What we do is manually delete the feature class from the gdb, then load a blank feature class template of the same name into that gdb, then add the data back.What I would like FME to do is read the data from the feature class, delete said feature class from gdb, add blank template of feature class from another gdb, then insert the attributes from the original gdb into it. Is this possible?Read attribute values from PIPELINE feature class in GDB 1Delete PIPELINE feature class in GDB1Add PIPELINE feature class from GDB 2 into GDB 1Set values of PIPELINE in the newly created feature class of GDB 1Thank you,Chris
Hi All, I’m trying to download images in a folder from Google drive and then convert those geotagged images to points with having the images as attachment to the point feature class, something similar to GeoTagged Photos to Point tool in Arcmap. I started my workbench by using the Google drive connector then photo coordinate extractor and vertex creator, but my workbench stuck in google drive connector all my records keep rejected if I choose to download them as a folder while it's working fine if I choose to download them as attribute.I could have the images folder in my machine when I run the workbench but it's not allowed me to continue the whole process.Any ideas on how could I achieve this? Thanks,Rawan
Hello, I have a workbench I'm having a difficult time with. As you can see in the image below, I have a shapefile being joined with a table from another database. I have confirmed with data inspector that before the join it has 524 Features, but after the join, even when I do a full join (the one pictured is an inner join). it only returns around half of the geographic features. I was wondering if anyone had any tips, or if I'm missing a Transformer I should be using?
We are trying to connect to our ArcGIS Portal using the portal reader. We are receiving the error "The Server does not appear to be an ArcGIS Portal instance.This really does not make any sense because there definitely is a Portal Instance there that is used by 100's of people in our company.I found some of the other threads but none of the solutions solved our problem (such as adding 7443, etc)I also tried all the variations of login methods.I am hoping someone else has had this problem and solved it or if it is just a bug with FME?I tried it with FME Desktop 2018 and 2019 and our Portal is 10.6
Hello,I could use some help with accessing custom IFC properties (and their values) in the FME workbench (version 2018.1.0.0). I am working on a transformation from an IFC file to PostGIS. The IFC file contains custom properties for some classes (e.g. IfcBuilding and IfcSpace). I can see those custom properties and their values when I inspect the IFC file with an IFC viewer. I can also see the values of the custom properties when I open the IFC file in the FME Data Inspector when I set the "Data Model" parameter of the reader to "Hierarchical". Only in that case I can't tell which IFC class instance the value belongs to. From reading related question and answers I have understood that in order to expose custom IFC properties I would need to add a Attribute Exposer transformer. I tried several settings for the IFC reader parameters, and I have tried specifying additional attributes in the AttributesExposer, in the format <name of the IFC property set>.<
Hi, I would like to use the featurereader to read from elasticsearch, however I am looking for a parameter, in the elasticsearch reader there is a type and JSON query field where is this in the featurereader? Ultimately I need to pass some parameters into the JSON query which is why I need access in the feature reader.Many Thanks
I have a bunch of large files to SFTP into the fme server. In order to not deplete the space on the local disk, I am moving them to S3 after they complete. How can I ensure the files are complete before using a directory watcher to move the files to s3? I am running my own fme server, not cloud version.
Hello,I am transforming Ordnance Survey MasterMap data into an ESRI Geodatabase. Where I require assistance is with the cartographic text (labelling) layer. This layer provides labeling information including font, colour, rotation and placement. I can't use these attributes directly in ArcMap or ArcGIS Pro which leads to labels overlapping and looking generally messy. I have found that writing these attributes to the relevant format attributes in the geodatbase writer work well but it is increadibly slow and discoraged by Safe. I am seeking advice or an alternative.Many ThanksDavid
I have v 2019.0 installed and dont see it , is it a separate install? where can i get the download for it?
Hi I have a table with about 5 million rows. I need to populate an attribute in the table using an external HTTP service, which expects a json parameter built using attributes from same table. The response is also in json formatExpected input json:[{"id":0,"x":320000,"y":290000}{"id":1,"x":345000,"y":310000}{"id":2,"x":410000,"y":300000}] Expected Output:[{"id":0,"z":45.0009}{"id":1,"x":12.236633}{"id":2,"z":24.9987}]Any suggestion what would be the best way to do this using FME?
Hi,Is there a sensible way to update part of a large raster held in a Geopackage? I have a large (100GB) raster of the whole of UK in a Geopackage. When a new tile is released by Ordnance Survey I want to insert it into the large Raster. At the moment I can't see any way other than to read the whole of the large raster, then mosaic the new tile, then write the whole raster out to Geopackage again. Just writing the new tile to the Geopackage deletes the existing data, leaving me with just the new tile. Unless I'm not seeing an 'update' parameter.If I do have to read everything, mosaic, then write, is there a 'most' efficient way of doing that?Thanks in advance.Chris
Is it always necessary to have PNI or another Smallworld application running with FME?
I am trying to get the file name along with a coordinate from our FieldSmart redline note XML files. They are not a traditional XML document. I am able to get 12 rows from the attached XML file but I want the 12 rows to be 12 attributes. How can I do this?
Hello.I am generating a report in excel using a template in FME. Which looks like a below-attached image. I need the same Fields getting populated in my excel output. The template does consider the formula. I also tried to add formulas in the Destination Excel file and get the report auto-generated, but the file gets completely inserted and I am not able to retain those formulae which I have in Sheet 2. Any help in this regard is highly appreciated.
Hello,I am Tolga, and I try to create 3D IMDF file for indoor mapping. In my project, i have a 3D revit model, and i want to use this model for facility management. For facility management, it can be better if it has indoor mapping. For this purpose, i started researching IMDF, but there is no document about creating 3D IMDF. My question is how can i create a 3D IMDF file using revit? Is that possible? If any document exist in this topic, can you share this with me?Thanks for all,Tolga YÜCEL
It gives the error: Python Exception <FMEWSException>: Type: 3, Number: 1, Message: Failed to get authorization header.The workbench has been working in 2018 version
As you can see below, I have a simple DWG to Shapefile workbench going. But every time I need to add a new CAD layer to be read, I need to add a new reader, so I end up with multiple readers reading the same DWG as seen below: How do I make it so I can simply add a new CAD layer to be read from the same DWG without having to stack up multiple reduntant readers like this each containing a couple of layers from the same drawing? Is there a setting that will allow me to alter it like I can with writers for example, as seen below?
I have SQL Server non-spatial reader that pulls data from a view. We have updated the view to add several fields in SQL Server but the reader does not read the new fields (see attached). Any ideas?Thanks,--gary
Hello,I'm working with over a hundred huge non overlapping geotiff's (512 Mb each) where the band 0 value represents the height. I also have some polygons, which sometimes overlap multiple geotiffs. I would like to compute the maximum height from the geotiffs within that polygon and I would like to replace that part of the geotiff with this maximum height.I managed to compute the maximum height so I created a shapefile with the polygons and the maximum height as an attribute and I also managed to create a Geotiff for eacht polygon with the maximum height as the band value.Now I would like to get the last part of the job done: replace parts the original Geotiff whith the new geotiffs. I'm not sure how this could be done so any help is appreciated. Arno
Hello,I try to understand a weird behavior with ExcelWriter in one of my workspaces.I achieved to reproduce the behavior in a much much simpler version of my workspace :My destination file has 2 sheets with named ranged on each :Behavior :When I run the workspace and the TEST/test writer is executed, everything's fine (=> NewData are written to Sheet/NamedRange and appended to TEST/test as there is no truncate of named range for this one).When I run the workspace and the TEST/test writer is NOT executed (if the link is from <Unfiltered> for example), the NewData are written to Sheet/NamedRanged but I loose the headers : The comments are still there, though... Note : If i have two writers instead of one with two feature types, everything's fine. Any idea ? A zip with workspace and xlsx files :
Good morning I'm trying to extract text from a simple jpg image using Tesseractcaller When i run Tesseract-OCR (version 3.05.02 64bit) on my PC (Windows 10) from Windows Powershell to extract the data from the .jpg, it works fine If I run the attached workspace in FME, the text export to .csv only gives the first line ie hello there but not the second line. I get no output for the line option I found another post about the Tesseract transformer, https://knowledge.safe.com/questions/80141/how-can-i-get-the-tesseractcaller-to-output-to-the.html, and have made the suggested change, but this didn't seem to work Any suggestions as to how i can resolve this? Simon Hume
Hello, I am working on revamping a workspace that is used as an open data platform to export all available data into 5 different formats (Geopackage, FGDB, DWG, CSV, SHP). Each dataset (ie. cadastral, development, engineeering etc.) have varying featureclasses that need to be exported into one zipped folder. Currently my set up has one writer per dataset per format (10 datasets, 50 writers).Is there some way to loop through the formats on a single writer, while writing out into a zipped folder per format? Thanks!
We're getting a generic "Package access failed" message in the log when we try to publish a workspace with the Apache Kafka package. Any assistance would be much appreciated.
We are interested in creating an Aurora for PostgreSQL Spatial DB. However, it is not clear if FME has a Reader/Writer. Do you, or would we use the normal RDS PostGIS/PostgreSQL reader/writer?