Using readers and writers to extract and load data.
Recently active
Hi, I would like to use the featurereader to read from elasticsearch, however I am looking for a parameter, in the elasticsearch reader there is a type and JSON query field where is this in the featurereader? Ultimately I need to pass some parameters into the JSON query which is why I need access in the feature reader.Many Thanks
I have a bunch of large files to SFTP into the fme server. In order to not deplete the space on the local disk, I am moving them to S3 after they complete. How can I ensure the files are complete before using a directory watcher to move the files to s3? I am running my own fme server, not cloud version.
Hello,I am transforming Ordnance Survey MasterMap data into an ESRI Geodatabase. Where I require assistance is with the cartographic text (labelling) layer. This layer provides labeling information including font, colour, rotation and placement. I can't use these attributes directly in ArcMap or ArcGIS Pro which leads to labels overlapping and looking generally messy. I have found that writing these attributes to the relevant format attributes in the geodatbase writer work well but it is increadibly slow and discoraged by Safe. I am seeking advice or an alternative.Many ThanksDavid
I have v 2019.0 installed and dont see it , is it a separate install? where can i get the download for it?
Hi I have a table with about 5 million rows. I need to populate an attribute in the table using an external HTTP service, which expects a json parameter built using attributes from same table. The response is also in json formatExpected input json:[{"id":0,"x":320000,"y":290000}{"id":1,"x":345000,"y":310000}{"id":2,"x":410000,"y":300000}] Expected Output:[{"id":0,"z":45.0009}{"id":1,"x":12.236633}{"id":2,"z":24.9987}]Any suggestion what would be the best way to do this using FME?
Hi,Is there a sensible way to update part of a large raster held in a Geopackage? I have a large (100GB) raster of the whole of UK in a Geopackage. When a new tile is released by Ordnance Survey I want to insert it into the large Raster. At the moment I can't see any way other than to read the whole of the large raster, then mosaic the new tile, then write the whole raster out to Geopackage again. Just writing the new tile to the Geopackage deletes the existing data, leaving me with just the new tile. Unless I'm not seeing an 'update' parameter.If I do have to read everything, mosaic, then write, is there a 'most' efficient way of doing that?Thanks in advance.Chris
Is it always necessary to have PNI or another Smallworld application running with FME?
I am trying to get the file name along with a coordinate from our FieldSmart redline note XML files. They are not a traditional XML document. I am able to get 12 rows from the attached XML file but I want the 12 rows to be 12 attributes. How can I do this?
Hello.I am generating a report in excel using a template in FME. Which looks like a below-attached image. I need the same Fields getting populated in my excel output. The template does consider the formula. I also tried to add formulas in the Destination Excel file and get the report auto-generated, but the file gets completely inserted and I am not able to retain those formulae which I have in Sheet 2. Any help in this regard is highly appreciated.
Hello,I am Tolga, and I try to create 3D IMDF file for indoor mapping. In my project, i have a 3D revit model, and i want to use this model for facility management. For facility management, it can be better if it has indoor mapping. For this purpose, i started researching IMDF, but there is no document about creating 3D IMDF. My question is how can i create a 3D IMDF file using revit? Is that possible? If any document exist in this topic, can you share this with me?Thanks for all,Tolga YÜCEL
It gives the error: Python Exception <FMEWSException>: Type: 3, Number: 1, Message: Failed to get authorization header.The workbench has been working in 2018 version
As you can see below, I have a simple DWG to Shapefile workbench going. But every time I need to add a new CAD layer to be read, I need to add a new reader, so I end up with multiple readers reading the same DWG as seen below: How do I make it so I can simply add a new CAD layer to be read from the same DWG without having to stack up multiple reduntant readers like this each containing a couple of layers from the same drawing? Is there a setting that will allow me to alter it like I can with writers for example, as seen below?
I have SQL Server non-spatial reader that pulls data from a view. We have updated the view to add several fields in SQL Server but the reader does not read the new fields (see attached). Any ideas?Thanks,--gary
Hello,I'm working with over a hundred huge non overlapping geotiff's (512 Mb each) where the band 0 value represents the height. I also have some polygons, which sometimes overlap multiple geotiffs. I would like to compute the maximum height from the geotiffs within that polygon and I would like to replace that part of the geotiff with this maximum height.I managed to compute the maximum height so I created a shapefile with the polygons and the maximum height as an attribute and I also managed to create a Geotiff for eacht polygon with the maximum height as the band value.Now I would like to get the last part of the job done: replace parts the original Geotiff whith the new geotiffs. I'm not sure how this could be done so any help is appreciated. Arno
Hello,I try to understand a weird behavior with ExcelWriter in one of my workspaces.I achieved to reproduce the behavior in a much much simpler version of my workspace :My destination file has 2 sheets with named ranged on each :Behavior :When I run the workspace and the TEST/test writer is executed, everything's fine (=> NewData are written to Sheet/NamedRange and appended to TEST/test as there is no truncate of named range for this one).When I run the workspace and the TEST/test writer is NOT executed (if the link is from <Unfiltered> for example), the NewData are written to Sheet/NamedRanged but I loose the headers : The comments are still there, though... Note : If i have two writers instead of one with two feature types, everything's fine. Any idea ? A zip with workspace and xlsx files :
Good morning I'm trying to extract text from a simple jpg image using Tesseractcaller When i run Tesseract-OCR (version 3.05.02 64bit) on my PC (Windows 10) from Windows Powershell to extract the data from the .jpg, it works fine If I run the attached workspace in FME, the text export to .csv only gives the first line ie hello there but not the second line. I get no output for the line option I found another post about the Tesseract transformer, https://knowledge.safe.com/questions/80141/how-can-i-get-the-tesseractcaller-to-output-to-the.html, and have made the suggested change, but this didn't seem to work Any suggestions as to how i can resolve this? Simon Hume
Hello, I am working on revamping a workspace that is used as an open data platform to export all available data into 5 different formats (Geopackage, FGDB, DWG, CSV, SHP). Each dataset (ie. cadastral, development, engineeering etc.) have varying featureclasses that need to be exported into one zipped folder. Currently my set up has one writer per dataset per format (10 datasets, 50 writers).Is there some way to loop through the formats on a single writer, while writing out into a zipped folder per format? Thanks!
We're getting a generic "Package access failed" message in the log when we try to publish a workspace with the Apache Kafka package. Any assistance would be much appreciated.
We are interested in creating an Aurora for PostgreSQL Spatial DB. However, it is not clear if FME has a Reader/Writer. Do you, or would we use the normal RDS PostGIS/PostgreSQL reader/writer?
Hi Partners, The tutorial series Tutorial: Push data from the database to an application in real-time has been updated in anticipation of the Google Fusion Tables deprecation in December. The tutorial now features FME Server Apps to trigger the databases. With this new change, the series has been renamed Tutorial: Update a Database Using an FME Server App.
Hi, I want to translate some KML to GPX. Never done with this types of files so I am using quick translator. I am getting some results but i need to get a timestamp for my points. How can I get this? In my KML data time stamp is located in Name and Snippet section (Picture 1). GPX that I need to get is GPX that i get from quick translation is:
Has anyone worked with the *.zda-format? I have some files that should contain some drill hole data but struggle to figure out which software produced these files and which software can read them. They are approx 0,5MB large.When you unzip the *.zda you get these files. and the *.dat files are And the data in the *.dat-files are like this - not sure how to decipher these. Any help appreciated!
I am looking for an example to write CityGML-cityfurniture with FME-Desktop. I've created a 3D-modell of a sign within FME which I now want to export as citygml-cityfurniture. While creating it I've assigned different apperances to parts of the sign (sign=white, text on sign=black) and aggregated all faces to that sign. Looks great, if I export it to 3D-PDF. But exporting it to citygml-cityfurniture lacks the colors of the sign. I am not quiet sure, if I doing it right. After aggregating I am using the transformers as shown in the attached jpg-file. Any suggestions or a workbench that creates cityfurniture the write way would be nice. :)
HelloI try to write Polyline-Geometry from ESRI Personal Geodatabase to PostGIS (Version 2.5) with geometry typ CompoundCurve. With PathBuilder I am successful to build Paths with Segments with only IFMELine or mixed IFMELine/IFMEArc and to import them.But I am not able to write Paths with only Arcs to PostGIS. The import fails with following message:Error executing SQL command ('INSERT INTO ... Geometry type (CircularString) does not match column type (CompoundCurve) Any Ideas? Thank you.
I have a model in .FBX format and I want to convert it to .GLTF format. When I do this in FME under generate workspace, I can go straight from ,fbx to .gltf. However, the final .gltf model loses some texture. In my case, the vehicle structure is there but details such as the windows are all missing. Would appreciate some advice. Thank you.