Using readers and writers to extract and load data.
Recently active
I have created a workbench that includes a DatabaseJoiner transformer that I want to pass a specific file too that will change each day (basically the file has the days date as its filename). However if I do this, I then cannot join on a field as the transformer reads the Dataset as a text string.I did try an alternative to this using FeatureReaders (excel and generic) and passing them the dataset, however that has its own problems identifying the data fields.What might be the best way to avoid these issues?
Hello everyoneIs it possible to get FME to check the last refresh date of a materialized view in Oracle, so we could then get it to send out notification if any haven't been refreshed in a certain period?
Hi everyone,Does anyone know how to convert DEM/DTM gray8 tif to rgb32 tif with the desired elevation color scheme by using FME Desktop?Gray8RGB32I know a lot of online GIS software may do it on the fly...but I am using MapGuide which seems allowing me to change the color scheme of my gray8 dem tif.Thanks a lot,Reno
Version 2018 of FME supports LAZ 1.1, 1.2, 1.3 but not LAZ 1.4 that was released on https://laszip.org/
I would like to change the name of my data download zip (FME_xxxxxxx.zip) to something else. Is it possible to change this on the FME cloud instance?So how or where can i edit the file layout configuration file that can manage [AUTO_FILE_PREFIX <file_prefix> \\]?If searched for it but could only find solution that needed the terminal on a FME Server that was not FME Cloud.FME Engines Filename: fmeEngineConfig.txt Location: <FMEServerDir>\\Server\\ Purpose: Configure the FME Engines, including subsections, pre and post commands, and success and failure responses. For details, see Configuration File Layout.Info i foundhttps://knowledge.safe.com/questions/3809/zip-file-name-fmeserver-download.html http://docs.safe.com/fme/2018.1/html/FME_Server_Documentation/Content/ReferenceManual/config_file_layout.htm http://docs.safe.com/fme/2018.1/html/FME_Server_Documentation/Content/ReferenceManual/fme_server_config_files.htm https://knowledge.safe.com/questions/31991/create-a-custom
A JSON file stored PNG images in byte[] text format. How do I convert them into PNG?
I have created a prototype workspace to create a 3D minecraft world by combining the 2D surface feature data from an orienteering map and a Lidar point cloud for the topography.Here is what the source map looks like And here is the resultant minecraft world -This workspace generated a Minecraft map of our local intermediate school which I have just created an orienteering map for. I have tried the workspace out on other urban orienteering maps (including one with lakes and tramways) and it worked pretty well, but it probably needs a bit more work for forest Orienteering maps.There is still work to do on this template. I would welcome comments and contributions on how to improve it. All features are not yet modelled. More clipping needs to be done for overlapping features. Z data needs to be built into railways. But I'd call it a good start (from a GIS beginner), and it potentially opens up a world of "virtual orienteering"!I have uploaded an example template here --> h
We have SDE connected with an Oracle backend databaseThe proposal is to use FME Oracle Non-spatial reader, FME for update required tabular data and FME to write the record with updated tabular via FME Oracle Non-spatial writer. Geometry will never change just updating tabular dataYes, I could use FME SDE Reader but when I looking a 400,000 spatial with tabular records, it's slowQUESTION, will this damage the spatial record?
Hello,I need to read 124 SDE GDSs to access and report a table that is common to all of them 'Tracts'.I tried the information in the following URL, but it is not working: https://knowledge.safe.com/articles/20203/how-to-read-all-feature-classes-from-multiple-esri.htmlAny help would be appreciated.Brian
Hello: I have multiple csv files that have the same number of attributes but some of the attributes have different spellings for the same attributes. Instead of adding multiple csv readers and eventually loading them into one (1) table in Oracle after some subsequent transformations, is there a way to bring the multiple files together and give the attributes the same name for the like fields?Below is a sample of what the file(s) would look like:
Hi there,I've taken some tips form this thread on how to generate a PNG from my WMS layer:https://knowledge.safe.com/questions/69989/requesting-wmswfs-and-saving-as-image-in-a-file.htmlIt works pretty good but it generates a PNG containing my entire WMS layer, where I just need a specific area based on a polygon I have. I've tried using the clipper but then the PNG writer generates no output (I'm guessing the clipper is only vector based) and I'm not sure what other transformers I can use to clip my WMS data. Rasters in general is a pretty new area for me in FME.Any advice will be greatly appreciated!
Using FME Desktop 2017.1.0.0 (20170731 - Build 17539 - WIN64) reading an Excel xlsx file on Windows fails and returns the following error:...|ERROR |Excel Reader: Could not open file '...\input.xlsx', file is too large. Try switching to 64-bit FME, or exporting the Excel file to CSV. If the file is exported to CSV, formulas and formatting will be lost...The file is 47KB, has 2 sheets with a couple of rows and columns. The data is imported with a Query from 2 csv files, what might cause the problem.Converting to CSV is not an option as this is part of an repetitive automatized process.Copy pasting the data to a new excel document / saving the file as xls solved the problem. But I would like to keep the source data original as I want to integrate this in FME server / external application.I did discuss this issue earlier with @Mark2AtSafe on StackExchange when the forum was down, but wanted to register the topic at the right place.
I am trying to convert MS SQL server database to Oracle and all of the table and columns are lowercase and being converted with double quotes around them. Is there a way in FME to prevent this?
hello thereat the end of a transformation process, we have an attribute name msg_ar we want to write as text into a PDF file , I used the PDF formatter and the PDF styler but no success Please any idea Thanks
I tried Safe suggestions to set both Workbench and its tool > FME option to the ArcGIS Pro python version but still get the following python error message. Please help. Thanks.Loaded module 'GeometryValidationFactory' from file 'E:\\Program Files\\FME\\plugins/GeometryValidationFactory.dll'FME API version of module 'GeometryValidationFactory' matches current internal version (3.8 20180209)Loaded module 'PythonFactory' from file 'E:\\Program Files\\FME\\plugins/PythonFactory.dll'FME API version of module 'PythonFactory' matches current internal version (3.8 20180209)The ArcGIS Python 3.6 interpreter could not be found. Please ensure the proper ArcGIS is installed with an architecture matching FME's(PythonFactory): A Python installation could not be detected. PythonFactory could not initializeA Python installation could not be detected. PythonFactory could not initializeClosing the Geodatabase readerA fatal error has occurred. Chec
How can I define a simple Oracle spacial reader and writer containing some Oracle SDO_GEOMETRY fields. The fields are not shown among the other attributes. I just want to copy them, no conversion etc.
My workspace contains 3 writers and they are all included in the "Include Writers in Download" option when publishing my workspace to FME Server. I expect all the files written by the 3 writers to be included by the file written by the FILECOPY Writer isn't. What is happening?
I am using FME 2017 and would like to carry out a relatively simple geoprocessing task. I have DEM TIF tiles and DOM TIF tiles in 2 different directories which both have the same names and the same extents. I would like to subtract the DEM from the DOM for each tile and save the new tile in a 3rd directory named "NORMALIZED".So my process is simply the following:1. Iterate through Directory "DOM" and for each filename find and subtract the same file in directory "DEM". 2. Save the result in Directory "NORMALIZED" How would I achieve this?
FME 2018.0.1.0 64-bit (18310).I'm using FeatureJoiner to merge data coming from several ArcSDE layers (left) and 2 layers from 2 different File Geodatabases (right). ALL the source layers are British National Grid (27700), but the coordinate system parameter in the Readers was <not set>. The translation failed at the FeatureJoiner with the message "Rejecting input feature(s) with coordinate system 'OSGB-GPS-2015' that do not match the first feature coordinate system '_OSGB-GPS-2015_0'".If I set the coordinate system to "OSGB-GPS-2015" on all the Readers, the translation works with this warning: "NOT changing coordinate system of reader identified by keyword `GEODATABASE_SDE_1' from `OSGB-GPS-2015' to `_OSGB-GPS-2015_0' -- mapping file setting of `OSGB-GPS-2015' overrides coordinate system `_OSGB-GPS-2015_0' read from file"Is there any real difference in OSGB-GPS-2015 and _OSGB-GPS-2015_0? Or is FeatureJoiner
I get a Point Cloud from Multicopter Surveying (Photogrammetry), stored in E57 File. This Point Cloud should be clipped to an Area of Interest, stored in Revit Model. So I exported the Model with the Revit Exporter to '*.rvz' and IFC4. I read the Geometry from IfcBeam. After this I create the Hull of the Geometry (2D) and send it to the Clipper. When I inspect the geometry with the FME Inspector it looks correct. After the clip-operation the point cloud is cutted wrong on to the lower right corner.I tested also the geometry extraction with SurfaceReplacer in combination with 2D Forcer, same problem... To test the correct position of the two parts I inspect it.Workspace looks like this (rotater and offsetter beacuse there is a bad georeference):Should I use other transformers for the Point Cloud clip-operation? Any ideas?Thank you!
is there any special setting we have to do on the wfs reader in order to expose certain attributes and also read the original attribute name instead of the alias the wfs was generated from arc server
Hi,Trying to figure out how to add an empty line (commas are fine) into a file at specific locationshere is an example i need:10-1110011-1220012-1310013-14400Any thoughts?Regards
Hi, i'm pretty new to FME. I'm using:FME Workbench 2018 (FME(R) 2018.0.1.0 (20180518 - Build 18310 - WIN64)FME CloudOracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit ProductionWhat I'm trying to do is this:I've build a local workbench in FME. This workbench connects to an Oracle database and exports data (Oracle Spatial) to an Esri Shapefile. It works.I published the workbench to my FME Cloud server/instance.I'd like to run and schedule the workbench from FME CloudHowever the next error shows when I'm trying to run the workbench from FME Cloud: ORA-12154: TNS:could not resolve the connect identifier specifiedWhy does the connection works locally but refuses to work from FME Cloud?Can you point me in the right direction? Thanx. Greetings Erwin
I have a KML file containing a large set of lines/paths, I want to regionate the data and have it only display when it's zoomed in at around 16-20 miles screen scale in google earth if that makes sense.
we use wfs service as reader but unfortunately some attributes not appear . we will build query filter based on these attributes .