Skip to main content

Data

Using readers and writers to extract and load data.

  • 6,973 Posts
  • 25,687 Replies
6973 Posts
H
hallkbrdz
asked in Data
Oracle reader table name exposed as attribute?

How can I expose the "table name" parameter in the dialog box of the Oracle reader as an attribute I can use in a writer (to force it lowercase)?

640
andreaatsafe
Safer
S
sandio
asked in Data
Why can't I translate ArcGIS 10.5 layers into MapInfo using FME 64 bit?

I would like to try translating an ArcGIS layer file generated in ArcGIS 10.5 (32bit version) into MapInfo format using FME 64bit version however, the option is greyed out and the only reason I can relate this to is that the ArcGIS I am running is 32bit? Is there a way around this or should I try downloaded the FME 64bit version. I currently only have a trial license because I want to work out if this works before we buy a license. Regards Sandi

30
andreaatsafe
Safer
renosungis
Contributor
renosungisContributor
asked in Data
LiDAR Cloud Point (.las) to DEM Raster With Spectrum Colors Based On Elevation Values

Hello, Is there a way to convert LiDAR Cloud Point (.las) to DEM Raster With Spectrum Colors Based On Elevation Values? I see the following post (https://knowledge.safe.com/articles/1345/creating-a-raster-from-a-point-cloud.html), but just hope the expert may show me how to colorize the raster image with Spectrum Color like following image: Thanks a lot, Reno

523
takashi
Influencer
mr_fme
Enthusiast
mr_fmeEnthusiast
asked in Data
Merge Polygons

I need to create a single shapefile file involving the 3 polygons like the one in the image below, how can I do it?

20670
danilo_fme
Evangelist
garrettcronin
garrettcronin
asked in Data
Microsoft SharePoint Alerting

Hi All, I have a customer who has enquired if FME Server can be used to validate document templates within SharePoint and be alerted when a new document is uploaded. I don't have the customers full list of requirement but in advance of the meeting I was wondering has anyone done anything like this before in SharePoint?

40
helmoet
dbryantgeo
Contributor
dbryantgeoContributor
asked in Data
Set Database Joiner parameter dynamically

I have created a workbench that includes a DatabaseJoiner transformer that I want to pass a specific file too that will change each day (basically the file has the days date as its filename). However if I do this, I then cannot join on a field as the transformer reads the Dataset as a text string. I did try an alternative to this using FeatureReaders (excel and generic) and passing them the dataset, however that has its own problems identifying the data fields. What might be the best way to avoid these issues?

230
dbryantgeo
Contributor
B
briggsaj
asked in Data
Check last refresh date of Oracle Materialized Views

Hello everyone Is it possible to get FME to check the last refresh date of a materialized view in Oracle, so we could then get it to send out notification if any haven't been refreshed in a certain period?

9762
B
renosungis
Contributor
renosungisContributor
asked in Data
How To Transform DEM/DTM Gray8 TIF To RGB32 TIF With Color Based On Gray8 Value (elevation)

Hi everyone, Does anyone know how to convert DEM/DTM gray8 tif to rgb32 tif with the desired elevation color scheme by using FME Desktop? Gray8 RGB32 I know a lot of online GIS software may do it on the fly...but I am using MapGuide which seems allowing me to change the color scheme of my gray8 dem tif. Thanks a lot, Reno

1346
renosungis
Contributor
mriedo
Participant
mriedoParticipant
asked in Data
LAZ 1.4 is not yet supported ... when will it be ? ... LAZ 1.4 was released in march on https://laszip.org/

Version 2018 of FME supports LAZ 1.1, 1.2, 1.3 but not LAZ 1.4 that was released on https://laszip.org/

100
xiaomengatsafe
Safer
jeroen
Contributor
jeroenContributor
asked in Data
Create custom data download zip name for FME Cloud

I would like to change the name of my data download zip (FME_xxxxxxx.zip) to something else. Is it possible to change this on the FME cloud instance? So how or where can i edit the file layout configuration file that can manage [AUTO_FILE_PREFIX <file_prefix> \\]? If searched for it but could only find solution that needed the terminal on a FME Server that was not FME Cloud. FME Engines Filename: fmeEngineConfig.txt Location: <FMEServerDir>\\Server\\ Purpose: Configure the FME Engines, including subsections, pre and post commands, and success and failure responses. For details, see Configuration File Layout.Info i found https://knowledge.safe.com/questions/3809/zip-file-name-fmeserver-download.html http://docs.safe.com/fme/2018.1/html/FME_Server_Documentation/Content/ReferenceManual/config_file_layout.htm http://docs.safe.com/fme/2018.1/html/FME_Server_Documentation/Content/ReferenceManual/fme_server_config_files.htm https://knowledge.safe.com/questions/31991/create-a-custom-download-l

562
stewartatsafe
Safer
G
gishub
asked in Data
How to write byte[] in json to PNG image

A JSON file stored PNG images in byte[] text format. How do I convert them into PNG?

1580
jochgem
Contributor
M
markfrater
asked in Data
Creating Minecraft worlds from orienteering Maps

I have created a prototype workspace to create a 3D minecraft world by combining the 2D surface feature data from an orienteering map and a Lidar point cloud for the topography. Here is what the source map looks like And here is the resultant minecraft world - This workspace generated a Minecraft map of our local intermediate school which I have just created an orienteering map for. I have tried the workspace out on other urban orienteering maps (including one with lakes and tramways) and it worked pretty well, but it probably needs a bit more work for forest Orienteering maps. There is still work to do on this template. I would welcome comments and contributions on how to improve it. All features are not yet modelled. More clipping needs to be done for overlapping features. Z data needs to be built into railways. But I'd call it a good start (from a GIS beginner), and it potentially opens up a world of "virtual orienteering"! I have uploaded an example template here --> https://hub.sa

380
M
hlouie
Contributor
hlouieContributor
asked in Data
Damage to SDE spatial record with Oracle Non-Spatial Writer???

We have SDE connected with an Oracle backend database The proposal is to use FME Oracle Non-spatial reader, FME for update required tabular data and FME to write the record with updated tabular via FME Oracle Non-spatial writer. Geometry will never change just updating tabular data Yes, I could use FME SDE Reader but when I looking a 400,000 spatial with tabular records, it's slow QUESTION, will this damage the spatial record?

71
david_r
Celebrity
dbklingdom
Contributor
dbklingdomContributor
asked in Data
read multiple sde connect file

Hello, I need to read 124 SDE GDSs to access and report a table that is common to all of them 'Tracts'. I tried the information in the following URL, but it is not working: https://knowledge.safe.com/articles/20203/how-to-read-all-feature-classes-from-multiple-esri.html Any help would be appreciated. Brian

400
dbklingdom
Contributor
B
bcrowley10
asked in Data
Merge CSV with Different Attribute Names

Hello: I have multiple csv files that have the same number of attributes but some of the attributes have different spellings for the same attributes. Instead of adding multiple csv readers and eventually loading them into one (1) table in Oracle after some subsequent transformations, is there a way to bring the multiple files together and give the attributes the same name for the like fields? Below is a sample of what the file(s) would look like:

100
B
R
robbie_botha
asked in Data
Clipping WMS layer via polygon and writing it out as an image

Hi there, I've taken some tips form this thread on how to generate a PNG from my WMS layer: https://knowledge.safe.com/questions/69989/requesting-wmswfs-and-saving-as-image-in-a-file.html It works pretty good but it generates a PNG containing my entire WMS layer, where I just need a specific area based on a polygon I have. I've tried using the clipper but then the PNG writer generates no output (I'm guessing the clipper is only vector based) and I'm not sure what other transformers I can use to clip my WMS data. Rasters in general is a pretty new area for me in FME. Any advice will be greatly appreciated!

9130
R
nielsgerrits
VIP
nielsgerrits
asked in Data
Excel reader: Could not open file, file is too large...

Using FME Desktop 2017.1.0.0 (20170731 - Build 17539 - WIN64) reading an Excel xlsx file on Windows fails and returns the following error: ...|ERROR |Excel Reader: Could not open file '...\input.xlsx', file is too large. Try switching to 64-bit FME, or exporting the Excel file to CSV. If the file is exported to CSV, formulas and formatting will be lost... The file is 47KB, has 2 sheets with a couple of rows and columns. The data is imported with a Query from 2 csv files, what might cause the problem.Converting to CSV is not an option as this is part of an repetitive automatized process.Copy pasting the data to a new excel document / saving the file as xls solved the problem. But I would like to keep the source data original as I want to integrate this in FME server / external application.I did discuss this issue earlier with @Mark2AtSafe on StackExchange when the forum was down, but wanted to register the topic at the right place.

740
P
S
svwellman
asked in Data
Microsoft to Oracle, table and columns created with "double quotes"

I am trying to convert MS SQL server database to Oracle and all of the table and columns are lowercase and being converted with double quotes around them. Is there a way in FME to prevent this?

90
erik_jan
Contributor
boubcher
Contributor
boubcherContributor
asked in Data
write text into PDF

hello there at the end of a transformation process, we have an attribute name msg_ar we want to write as text into a PDF file , I used the PDF formatter and the PDF styler but no success Please any idea Thanks

1970
W
jhu_20
Contributor
jhu_20Contributor
asked in Data
The ArcGIS Python 3.6 interpreter could not be found

I tried Safe suggestions to set both Workbench and its tool > FME option to the ArcGIS Pro python version but still get the following python error message. Please help. Thanks. Loaded module 'GeometryValidationFactory' from file 'E:\\Program Files\\FME\\plugins/GeometryValidationFactory.dll' FME API version of module 'GeometryValidationFactory' matches current internal version (3.8 20180209) Loaded module 'PythonFactory' from file 'E:\\Program Files\\FME\\plugins/PythonFactory.dll' FME API version of module 'PythonFactory' matches current internal version (3.8 20180209) The ArcGIS Python 3.6 interpreter could not be found. Please ensure the proper ArcGIS is installed with an architecture matching FME's (PythonFactory): A Python installation could not be detected. PythonFactory could not initialize A Python installation could not be detected. PythonFactory could not initialize Closing the Geodatabase reader A fatal error has occurred. Check the logfile above for details Translation FAIL

150
debbiatsafe
Safer
F
fritspoulsen12
asked in Data
Attribute for SDO_GEOMETRY field type

How can I define a simple Oracle spacial reader and writer containing some Oracle SDO_GEOMETRY fields. The fields are not shown among the other attributes. I just want to copy them, no conversion etc.

1610
F
fmelizard
Contributor
fmelizardContributor
asked in Data
Why can't filecopy writer output be included in the DataDownload zip file?

My workspace contains 3 writers and they are all included in the "Include Writers in Download" option when publishing my workspace to FME Server. I expect all the files written by the 3 writers to be included by the file written by the FILECOPY Writer isn't. What is happening?

220
sigtill
Supporter
R
robertdbuckley
asked in Data
How to use the feature extents as an environment variable for processing?

I am using FME 2017 and would like to carry out a relatively simple geoprocessing task. I have DEM TIF tiles and DOM TIF tiles in 2 different directories which both have the same names and the same extents. I would like to subtract the DEM from the DOM for each tile and save the new tile in a 3rd directory named "NORMALIZED". So my process is simply the following: 1. Iterate through Directory "DOM" and for each filename find and subtract the same file in directory "DEM". 2. Save the result in Directory "NORMALIZED" How would I achieve this?

50
daveatsafe
Safer
tim_wood
Contributor
tim_woodContributor
asked in Data
FeatureJoiner and differences between OSGB 2015 coordinate systems (ArcSDE and File GeoDatabase)

FME 2018.0.1.0 64-bit (18310). I'm using FeatureJoiner to merge data coming from several ArcSDE layers (left) and 2 layers from 2 different File Geodatabases (right). ALL the source layers are British National Grid (27700), but the coordinate system parameter in the Readers was <not set>. The translation failed at the FeatureJoiner with the message "Rejecting input feature(s) with coordinate system 'OSGB-GPS-2015' that do not match the first feature coordinate system '_OSGB-GPS-2015_0'". If I set the coordinate system to "OSGB-GPS-2015" on all the Readers, the translation works with this warning: "NOT changing coordinate system of reader identified by keyword `GEODATABASE_SDE_1' from `OSGB-GPS-2015' to `_OSGB-GPS-2015_0' -- mapping file setting of `OSGB-GPS-2015' overrides coordinate system `_OSGB-GPS-2015_0' read from file" Is there any real difference in OSGB-GPS-2015 and _OSGB-GPS-2015_0? Or is FeatureJoiner just getting upset because the coordinate system name is not identical? Sho

2250
tim_wood
Contributor
M
matze94
asked in Data
I want to Clip my Point Cloud with Revit Geometry

I get a Point Cloud from Multicopter Surveying (Photogrammetry), stored in E57 File. This Point Cloud should be clipped to an Area of Interest, stored in Revit Model. So I exported the Model with the Revit Exporter to '*.rvz' and IFC4. I read the Geometry from IfcBeam. After this I create the Hull of the Geometry (2D) and send it to the Clipper. When I inspect the geometry with the FME Inspector it looks correct. After the clip-operation the point cloud is cutted wrong on to the lower right corner. I tested also the geometry extraction with SurfaceReplacer in combination with 2D Forcer, same problem... To test the correct position of the two parts I inspect it. Workspace looks like this (rotater and offsetter beacuse there is a bad georeference): Should I use other transformers for the Point Cloud clip-operation? Any ideas? Thank you!

550
M

Helpful Members This Week

Badge Winners

Show all badges

Popular Tags

Community Stats

31,148
Posts
118,077
Replies
38,765
Members

Latest FME

Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.