Using readers and writers to extract and load data.
Recently active
I am trying to create separate worksheets using individual Excel writers. I have 40 total. The workbench runs fine, but when I go to open the Excel file I get an Excel error stating "We found a problem with some content. Do you want to recover as much as we can". If I click yes, the file will open, but I lose all of my formatting. All 40 sheets are there, but no formatting on any of them. If I disable the writers for 5 of the sheets, I will not get the Excel error and all of my formatting will be on the 35 sheets. I've tried disabling different writers and combinations of writers, so it's not an individual writer issue. If I try to do 36 sheets or more, I get the same error.
It would be good to have a glossary of terms from a database perspective. FME appears to be good at etl in a non spatial world (or at lest that's my priority at present).There are hundreds of readers/transformers/writers and it appears you can use many to achieve a similar result. Finding the best r/t/w is tricky then not knowing the FME terminology adds to the "interest".Thanks.
Hello everybody,I´m trying to find way, how to write geometry in AIXM in situation, where I have to merge 4 tables to gain geometry. Concretely - I have prepared dataset to write into AIXM format, Vertical Structures feature type. But according to AIXM model settings, I have write geometry into Geometry:ElevatedPoint object, not directly to VerticalStructure object.I checked also the FME demo here: https://knowledge.safe.com/articles/1312/aixm-xml-and-gml-formats-eu-airports-demo.html, but there only one simple relationship between AirportHeliport object and ElevatedPoint. Meanwhile in VerticalStructure issue, I have to trace more objects to write geometry, check here: http://aixm.aero/sites/aixm.aero/files/imce/AIXM511HTML/AIXM/Diagram_VerticalStructures.html?menu=openFrom VerticalStructure feature I have to go to VerticalStructurePart Object, then through VerticalStructurePartGeometry Choice and after then I´m finnaly able to reach Geometry: ElevatedPoint object.Does anybody have ide
Updated:It looks like geometry comparisons are working, but there is a slight difference for how coordinates are stored in AGOL compared to FGDB's; coordinates were off by only a few micrometers. I've had luck using the CoordinateRounder tool and setting the precision to 3 decimal places. Also, instead of using FeatureMerger, I've found that the inputs and outputs of UpdateDetector is a lot more intuitive. The graphic below shows the results as 6 updated features (2 features with attributes modified, 4 with geometry edits), 8 deleted features, 16 new inserted features, and 248 features that were unchanged.------Original Question:------I am trying to update features from a FileGeodatabase (FGDB) to a hosted ArcGIS Online Feature Layer. I'm using @LauraAtSafe tutorial on "How do I write updates to an existing ArcGIS Online feature service?" and I've hit a snag. My results are not showing edited features, and all be the new and deleted features are saying the
I have been given a sample OBJ file by a customer. It fails to load in the object inspector - which just shows a bounding box. In a workbench I get a series of messages like this:Loaded module 'OBJ' from file 'C:\\Program Files\\FME\\plugins/obj/obj.dll'FME API version of module 'OBJ' matches current internal version (3.8 20170315)OBJ Reader: Reverse Face Order: 'No'OBJ Reader: Reading in Variable FeatureType modeOBJ Reader: Opening Dataset: 'C:\\AH_drive\\OneDrive - ESRI (UK) Ltd\\Workspace\\Glasgow3D\\CityModel\\Apr2018\\Carlton_Place_65-67_OBJ_01MAY18.obj'OBJ Reader: Token Unsupported: 'Ni' - IgnoredOBJ Reader: continue reading with next good featureOBJ Reader: Token Unsupported: 'Tf' - IgnoredOBJ Reader: continue reading with next good featureOBJ Reader: Token Unsupported: 'illum' - IgnoredOBJ Reader: continue reading with next good featureOBJ Reader: Token Unsupported: 'Ke' - IgnoredOBJ Reader: continue readin
Hi There, I am working on an issue where our FME workspace, reads data from a database and generates a shapefile. The issue that I am having is that if there are no new records, the shapefile doesn’t get generated but it keeps the last run that had any data. This is creating problem with next step of the process. I am trying to figure out a way so that FME generates a shapefile even if there is no new data (empty shapefile). Appreciate any help. Thanks Jay
Have used a feature merger to merge several excel lists together and want to output them to a single excel worksheet. I've got it working fine except when I run a sorter before the writer, and sort numerically off of one of my numeric fields, the writer will add and additional page to the excel file and put information from one list on the actual intended sheet and information from the other on the additional sheet (if I use an inspector and view the list in Data Inspector it's perfect). If I sort on the exact same field, but do it alphabetically, it puts everything on the single sheet I specify (but of course is not sorted the way I'd like). Any ideas?
Hi,I have a file written with some gml description of geometries. One of these description contains <gml: arcbycenterpoint > definition. I tried to import this file in QGIS 3 directly. But it doesn't work. It seems that the <gml : arcbycenterpoint > is not supported but i'm not sure with this point.I would like to know how to draw my geometries in QGIS 3.Should i have to translate my file in an other format ?It's an AIXM 5 format.Thanks
Hi,I have two workstreams in my workspace:Check data integrity, culminating in any errors appearing out of the NotMatched port of a Matcher.Writes the data out.The two workstreams are separate from eachother.Is there a way to prevent the writer from executing if features appear in the NotMatched port of the other workstream?At present, I disable the writer and run the workspace repeatedly (correcting errors in the NotMatched port) until the data is ready to be written. Not very efficient... Would appreciate any help!
There is messy code when I open a shapefile created by arcgisdesktop, but it shows well in arcgisdesktop. I don't know why. I hope someone can help me to solves this problem , thanks a lot.Here is the testfile.
I only need certain records to have hyperlinks. See attached image, (created with arc2earth). I'm trying to create the same popup with a workbench, see attached.noaa-rncs-shape-kml.fmw
I'm trying to connect to Oracle cloud for the human resources and financial management services. So far, I am not having any luck. Has anyone been able to set up these connections? If we could connect to the existing EiS reports that would be a fine work around but as far as I can tell we can not have the EiS reports automatically load into a FTP site where we could grab them. We are currently using FME 2017 but are fine upgrading if a new version is needed. Any advice or help wold be greatly appreciated.
hello, I need to convert IFC to OBJ, but I had some trouble when converting. Firstly, IFC has many features, but the OBJ converted just has a feature(geometry?). In the process of transformation, merge all the geometries into one. I don't want to merge. Secondly, the transparency properties of the material in the MTL file are all 1(In other words, OBJ is transparent).It's really terrible. Finally,I want to export the attribute table from IFC.Is there any way to solve it?Any advice would be appreciated!Thanks!
Hi Can someone advise me what the easiest method there is to select only certain records from an excel spreadsheet, based on one column?I have a simple excel spreadsheet listing bin deliveries to addresses as individual cases from our CRM system. One of the columns is whether the case is Open or ClosedOne of my FME workspaces is configured to map all these into SHP format, which i've succesfully doneThe other workspace now needs to also map these, but only where the case is Open.I've tried the Attribute based Transformers, but can't get the correct outputAny help much appreciatedthanksSimon Hume
Hello I am using a WFS reader to extract data, is there any way we could query the WFS to retrieve only specific featuresThanks
My workflow right now is set up to do some calculations on a property boundary then be able to show that property on an aerial image. Where I'm getting stuck is to be able to find a way to set the scale (zoom level) of the google static map so the polygon is centered and at an appropriate zoom level. I'm using the 'google static map fetcher' transformer and have everything working to be able to center the polygon within the google map, just want to find a way to set a scale level to have it adjust to the different size polygons.
Hi, I have a lot of profiles measured as xyz data (points) in RD coordinate system. It's an Excel with all the profiles, each profile has it's own name (1,2,3, etc). Is there a way to convert each profile to a separate .jpg/png file in FME?
Hi, I have set up an Esri Geodatabase on HANA 2 using ArcGIS Pro and loaded data in it using Pro. I then tried to establish a reader connection to this geodatabase from FME 2018 using a connection file created in ArcGIS Pro.The system I am trying this from has ArcGIS Desktop 10.6, ArcGIS Pro 2.1.3 and FME 2018.0.1 installed (b18310, 64-bit). The HANA jdbc driver has been installed propoerlyThe error I am getting is: 'Could not open Enterprise Geodatabase. The error number from ArcObjects is: -2147155361. The error message from ArcObjects is: Connections to HANA to geodatabase in SAP HANA are only supported from ArcGIS Pro and ArcGIS Server sites.I can think of 2 possible reasons:1. The 'Esri Geodatabase (ArcSDE Geodb)' format doesn't support HANA-based Geodatabases (yet?). If so, is this on the FME roadmap?2. FME is trying to establish the connection using the 32-bit ArcGIS 10.6 libraries rather than 64-bit ArcGIS Pro libraries. The reference to ArcObjects in the error
Hi,I am having an issue converting data from an ESRI SDE connection to KML file in FME due to 1.3m shift from the same conversion in ArcMap.My SDE data is NAD 83, UTM Zone 10N (WKID: 26910). I have no issues connecting to the SDE, I get the same 1.3m shift using a Writer or a FeatureWriter. I do get a warning of:NOT changing coordinate system of reader identified by keyword `GEODATABASE_SDE_1' from `EPSG:26910' to `_UTM83-10_0' -- mapping file setting of `EPSG:26910' overrides coordinate system `_UTM83-10_0' read from fileIf I put the SDE coordinate system of "UTM83-10", I still get the same error. Once exported, regardless of which coordinate system i use, the 1.3m shift is still present in the kml. I have exported from the SDE into both a file geodatabase and shapefiles and repeated the same process and I get the same results. If I re-import the KML into FME to a shapefile and compare to the original in ArcMap, there is no shift. If I import the same kml
Does FME have a reader for AIG format rasters?
I've created a spatialite database using FME. It includes layers with polygons, lines, points and tables (no geometry). However, FME 2017 does not seem to offer an option to indicate geometry type. Therefore, the geometry_type table and column is not filled correctly thus layers are not visible in QGIS. After adjusting the table manually the layers become visible. Does anyone know how to solve the problem within FME?
Anyone who knows the solution to this? We are doing a refresh from ESRI ArcGIS SDE to ArcGIS Online and this is the error that was encountered. How to avoid this? Most of the time I encounter this error, only sometimes that the process becomes successful. ArcGIS Online Feature Service Writer: Encountered an unexpected error. The error code from the server was '504' and the message was: 'Your request has timed out
Hello I am getting error: FMEServerJobSubmitter(ServerJobSubmissionFactory): Could not initialize connection to server "<server/LoadBalancer name>". FME Server error: `Communication Error: Failover node detected client request. Request rejected to redirect to active node.' , Please advise.
I am looking to write to a postgres hstore column and seeing if their is a way to use a postgres writer with its 1000 transactions at a time to write to postgres table with a hstore column over using a 1 at a time sql-executor? I have 5 attributes to go into the hstore.
I need to create a workflow in FME Workbench. It should contain following steps:1. Given Point Cloud (.las-format)2. Export as a 3D Model in IFC3. Create a GeodatabaseSo in the end I want my point cloud to be a model that I can import to ArcGIS Pro. Is that possible or is there any other/better solution solving my problem? I am thankful for any comment.