Using readers and writers to extract and load data.
Recently active
Hello,I need to read 124 SDE GDSs to access and report a table that is common to all of them 'Tracts'.I tried the information in the following URL, but it is not working: https://knowledge.safe.com/articles/20203/how-to-read-all-feature-classes-from-multiple-esri.htmlAny help would be appreciated.Brian
Hello: I have multiple csv files that have the same number of attributes but some of the attributes have different spellings for the same attributes. Instead of adding multiple csv readers and eventually loading them into one (1) table in Oracle after some subsequent transformations, is there a way to bring the multiple files together and give the attributes the same name for the like fields?Below is a sample of what the file(s) would look like:
Hi there,I've taken some tips form this thread on how to generate a PNG from my WMS layer:https://knowledge.safe.com/questions/69989/requesting-wmswfs-and-saving-as-image-in-a-file.htmlIt works pretty good but it generates a PNG containing my entire WMS layer, where I just need a specific area based on a polygon I have. I've tried using the clipper but then the PNG writer generates no output (I'm guessing the clipper is only vector based) and I'm not sure what other transformers I can use to clip my WMS data. Rasters in general is a pretty new area for me in FME.Any advice will be greatly appreciated!
Using FME Desktop 2017.1.0.0 (20170731 - Build 17539 - WIN64) reading an Excel xlsx file on Windows fails and returns the following error:...|ERROR |Excel Reader: Could not open file '...\input.xlsx', file is too large. Try switching to 64-bit FME, or exporting the Excel file to CSV. If the file is exported to CSV, formulas and formatting will be lost...The file is 47KB, has 2 sheets with a couple of rows and columns. The data is imported with a Query from 2 csv files, what might cause the problem.Converting to CSV is not an option as this is part of an repetitive automatized process.Copy pasting the data to a new excel document / saving the file as xls solved the problem. But I would like to keep the source data original as I want to integrate this in FME server / external application.I did discuss this issue earlier with @Mark2AtSafe on StackExchange when the forum was down, but wanted to register the topic at the right place.
I am trying to convert MS SQL server database to Oracle and all of the table and columns are lowercase and being converted with double quotes around them. Is there a way in FME to prevent this?
hello thereat the end of a transformation process, we have an attribute name msg_ar we want to write as text into a PDF file , I used the PDF formatter and the PDF styler but no success Please any idea Thanks
I tried Safe suggestions to set both Workbench and its tool > FME option to the ArcGIS Pro python version but still get the following python error message. Please help. Thanks.Loaded module 'GeometryValidationFactory' from file 'E:\\Program Files\\FME\\plugins/GeometryValidationFactory.dll'FME API version of module 'GeometryValidationFactory' matches current internal version (3.8 20180209)Loaded module 'PythonFactory' from file 'E:\\Program Files\\FME\\plugins/PythonFactory.dll'FME API version of module 'PythonFactory' matches current internal version (3.8 20180209)The ArcGIS Python 3.6 interpreter could not be found. Please ensure the proper ArcGIS is installed with an architecture matching FME's(PythonFactory): A Python installation could not be detected. PythonFactory could not initializeA Python installation could not be detected. PythonFactory could not initializeClosing the Geodatabase readerA fatal error has occurred. Chec
How can I define a simple Oracle spacial reader and writer containing some Oracle SDO_GEOMETRY fields. The fields are not shown among the other attributes. I just want to copy them, no conversion etc.
My workspace contains 3 writers and they are all included in the "Include Writers in Download" option when publishing my workspace to FME Server. I expect all the files written by the 3 writers to be included by the file written by the FILECOPY Writer isn't. What is happening?
I am using FME 2017 and would like to carry out a relatively simple geoprocessing task. I have DEM TIF tiles and DOM TIF tiles in 2 different directories which both have the same names and the same extents. I would like to subtract the DEM from the DOM for each tile and save the new tile in a 3rd directory named "NORMALIZED".So my process is simply the following:1. Iterate through Directory "DOM" and for each filename find and subtract the same file in directory "DEM". 2. Save the result in Directory "NORMALIZED" How would I achieve this?
FME 2018.0.1.0 64-bit (18310).I'm using FeatureJoiner to merge data coming from several ArcSDE layers (left) and 2 layers from 2 different File Geodatabases (right). ALL the source layers are British National Grid (27700), but the coordinate system parameter in the Readers was <not set>. The translation failed at the FeatureJoiner with the message "Rejecting input feature(s) with coordinate system 'OSGB-GPS-2015' that do not match the first feature coordinate system '_OSGB-GPS-2015_0'".If I set the coordinate system to "OSGB-GPS-2015" on all the Readers, the translation works with this warning: "NOT changing coordinate system of reader identified by keyword `GEODATABASE_SDE_1' from `OSGB-GPS-2015' to `_OSGB-GPS-2015_0' -- mapping file setting of `OSGB-GPS-2015' overrides coordinate system `_OSGB-GPS-2015_0' read from file"Is there any real difference in OSGB-GPS-2015 and _OSGB-GPS-2015_0? Or is FeatureJoiner
I get a Point Cloud from Multicopter Surveying (Photogrammetry), stored in E57 File. This Point Cloud should be clipped to an Area of Interest, stored in Revit Model. So I exported the Model with the Revit Exporter to '*.rvz' and IFC4. I read the Geometry from IfcBeam. After this I create the Hull of the Geometry (2D) and send it to the Clipper. When I inspect the geometry with the FME Inspector it looks correct. After the clip-operation the point cloud is cutted wrong on to the lower right corner.I tested also the geometry extraction with SurfaceReplacer in combination with 2D Forcer, same problem... To test the correct position of the two parts I inspect it.Workspace looks like this (rotater and offsetter beacuse there is a bad georeference):Should I use other transformers for the Point Cloud clip-operation? Any ideas?Thank you!
is there any special setting we have to do on the wfs reader in order to expose certain attributes and also read the original attribute name instead of the alias the wfs was generated from arc server
Hi,Trying to figure out how to add an empty line (commas are fine) into a file at specific locationshere is an example i need:10-1110011-1220012-1310013-14400Any thoughts?Regards
Hi, i'm pretty new to FME. I'm using:FME Workbench 2018 (FME(R) 2018.0.1.0 (20180518 - Build 18310 - WIN64)FME CloudOracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit ProductionWhat I'm trying to do is this:I've build a local workbench in FME. This workbench connects to an Oracle database and exports data (Oracle Spatial) to an Esri Shapefile. It works.I published the workbench to my FME Cloud server/instance.I'd like to run and schedule the workbench from FME CloudHowever the next error shows when I'm trying to run the workbench from FME Cloud: ORA-12154: TNS:could not resolve the connect identifier specifiedWhy does the connection works locally but refuses to work from FME Cloud?Can you point me in the right direction? Thanx. Greetings Erwin
I have a KML file containing a large set of lines/paths, I want to regionate the data and have it only display when it's zoomed in at around 16-20 miles screen scale in google earth if that makes sense.
we use wfs service as reader but unfortunately some attributes not appear . we will build query filter based on these attributes .
Wonder if there is a direct way to use a reader or feature reader to read a zipped up fgdb stored on google drive. One options is to use google drive connector to download the fgdb to the local drive. Thanks!
Hi,I am using FME 2017.1 and would like to expose the Microstation DGN V8 attribute called 'Group' circled below in the screen shot (Attribute value is 'D' in this case).I have exposed all the 'Format Attributes' in the DGN Reader and looked through the Reader parameters but cannot find this attribute anywhere.Does anyone know how to do this?Thanks,
Hello FMEers, I have been asked to present to a group of Information Management Specialists on the safe software suite of products. In particular they are interested in how FME compares with the SSIS. SSIS is another ETL tool used within the Microsoft SQL Server environment. Having never used SSIS this is a tall order as my default for any ETL processing has been FME. Is there anybody out there that can give me a few advantages and disadvantages of FME compared to other ETL tools in particular SSIS. Any sort of information will help. Thanks in advance. Cheers, Evan Goodwin
I have a set of building obj and then located them according to their coordinates but observed a problem related to darkness of objs. I need to change material attributes. Which function does it provide the need in FME.My FME Workspace: 1. FME Output:2. obj2gltf Output:
Hello community,I'm storing some shapefiles in a MSSQL Server database. How can I get the SQL script FME used to create the database and populate it from the shapefile ?Thank you
You shouldn't notice anything but lots has changed under the hood.Encryption, private and public… New in FME 2017 is how encryption is used with the database connection file where your connection information is stored.We now encrypt for public access as well as private access. In the past anyone with FME installed could read the connection file as FME contained a global encryption key to access the database connection file. This didn’t give them access to see passwords but they could use the connection information in FME.Now, public access to the connection file is controlled by giving FME access to a public key file. By default this public key is stored in the same location as the database connection file so we do recommend moving that to a secondary location where FME can be pointed to in order to access it. This ensures that if someone locates the connection file they won’t have the key file so they can’t decrypt the information.In regular FME use, any user with the database con
Hi,I cannot write a Sketchup file.I have FME(R) 2018.0.1.1 (20180615 - Build 18312 - WIN64)And the log says:Reprojector: Using transformation `SWEREF99_to_WGS84,Forward(Geocentric,EPSG:1879)' when reprojecting from SWEREF-99-13-30 to SKP_COORDSYS_0Failed to write Sketchup file to 'C:\\Temp//LAS.skp'A fatal error has occurred. Check the logfile above for details... Last line repeated 2 times ...Translation FAILED with 2 error(s) and 0 warning(s) (2505 feature(s) output)FME Session Duration: 3.8 seconds. (CPU: 3.2s user, 0.5s system)END - ProcessID: 236, peak process memory usage: 117140 kB, current process memory usage: 93852 kBA fatal error has occurred. Check the logfile above for detailsProgram TerminatingTranslation FAILED.What to do? Best regards,Jonas
Hi everybody,i have to import smal jpg-files (400-500 kb) with geometry into a postgis bytea column. the process is very slow. for example the time to import 40 images takes 10 minutes. the import with pglobeditor takes 2 seconds. Please help what could be the cause.,