Using readers and writers to extract and load data.
Recently active
Hi everyone,I am stuck with the FeatureReader and I manage to read a table out of the database when I keep the WHERE clause empty, however when I fill in the WHERE clause based on the user choice of a choice list saved in a parameter "NAAM_BUURT" and I want to match it with the column also called "NAAMBUURT" I don't get an output. I just get schema data, while I also indicate that I want data features. Does anyone might know what I might be doing wrong? By th way I am using FME Desktop 2022.2.1.
Hello! FME Novice here, running Workbench 2021.1.3.1I'm trying to update a multipoint feature class in AGOL using FME, but am receiving the following error: <class 'fmeobjects.FMEPoint'> cannot be converted to esriGeometryMultipointI tried using Aggregator to ensure the points are multipoint but receive this error when I try this method: 0.0|ERROR |<class 'fmeobjects.FMEAggregate'> cannot be converted to esriGeometryMultipoint 0.0|ERROR |ARCGISONLINEFEATURES writer: A fatal error has occurred. Check the logfile above for details Can FME handle multipoint updates for ArcGIS Online? It has no problem with polylines, so I was hopeful on multipoints. Any advice is welcome and appreciated. Thank you in advance!
Relatively recently we've acquired FME Server and are in the process of converting workbenches we had run previously via task scheduler. We have quite a few already and I am interested in suggestions (or articles) that anyone has on how to best document or organize the workspaces. There might need to end up being some trial and error regardless, but I would like to avoid some pitfalls on the front-end if possible. The most relevant search result I found was this, but doesn't seem to apply directly to what I'm looking for: https://community.safe.com/s/bridea/a0r4Q00000HbsC7QAJ/best-practices-document-for-fme-server Thank you!
Hello! It is possible to add a CGXML file into ArcGIS Desktop via data interoperability? Also the CGXML file can be converted to a shapefile via import? I can also add or send a cgxml file if needed. Thank you!
Hi, I have a host feature layer on Portal 10.8.1 and want to use a date where query. Documentation from ESRI point to being able to use Intervals in the query but when I try to use in the Portal Feature Service reader the server returns a 400 error. https://www.esri.com/arcgis-blog/products/api-rest/data-management/querying-feature-services-date-time-queries/ It appears you can only use a proportion of a day in the FME query. The help page FME desktop points you to from ESRI isn't exactly that informative. https://doc.arcgis.com/en/arcgis-online/reference/sql-agol.htm Is this a Portal versus AGOL difference? This works:"created_date" >= CURRENT_TIMESTAMP() - 0.015 This doesn't:"created_date" >= CURRENT_TIMESTAMP - INTERVAL '15' MINUTE If anyone can point me to a definitive page with the documentation for where datetime queries for hosted Portal feature layers.... 😀 Thanks,Peter
I have a CSV with coordinates. I've put a vertex creator in the workspace and outputting it to an ArcGIS Online feature service. I can successfully write out into ArcGIS Online, however when I open up the feature service in AGOL and Pro, I can't see the points. Yes, I've checked the transparency and visibility range. When I open up the attribute table all the data is there. When I select all, it shows the points are there. Only when selected though. Why is this?
I want to read sevaral excel file that are inside a zip file.An excel file has the worksheest Data 1, Dat2, ... Data n and the number of worksheet varies from one file to another.For a given zipfile, I first read the schema feature using a featureReader to get the list of sheetname.Then, using a second featureReader, I read the attribute with the worksheet The problem that I'm facing now is that when I enter manuall the values filename and filepath used within the first FeatureReader, I'm able to get the reseults that I wanted. However, when I tried to read all the zip file with a python caller, the program stop and the only error that I have is ERROR RUNNING TRANSLATION.Storing feature(s) to FME feature store file `C:\Users\...\inspector.ffs'Storing feature(s) to FME feature store file `C:\Users\...\inspector.fsc'Error running translation.Creating reader for format: Microsoft ExcelTrying to find a DYNAMIC plugin for reader named `XLSXR'FME API version of module 'XLSXR' matches cur
I have followed the tutorials available and also tried following other questions on the forum on this topic. Workspace template with data cache included.
Unable to get the Web Service to Authenticate (redirect url)BTW, we are no longer allowed to use our personal accounts for Auth, therefore we have Service Account files we use. Therefore, unable to create a Web conn either. Only way I can create a writer is to select Service Account file and define the table myself. Then I preface the writer with a PythonCaller to get the creds.When defining a NUMERIC in the writer, does not allow me to specify width/precision. Any updates to this writer planned soon?
Hi, I have a workspace I am wanting to upgrade from FME 2019.2.3.2 to 2022.2. It creates geopackages that could be read in either QGIS 3.22 (late 2021 release) or ArcGIS Pro 2.6.10. We just tested and they also open in ArcGIS Pro 2.9.5 (Oct 2022 release).Upon upgrading (with or without changing the feature writer to specifically use the new OGC Geopackage writer format) ArcGIS Pro can no longer read the output. QGIS can read it fine.Whilst I presume this is likely an esri compatibility issue, what I am wondering is what the underlying SQLite version is, and what the Geopackage version is - I could not find this in the documentation of the writer (easily - forgive me if I have missed something)?I then have something to check against the esri compatibility as they list out the versions supported. Cheers John
Hi, I have a dataset in .dbf format, with 885 rows. When I read the file in FME it reads the 885 rows, but when I use the DuplicateFilter it tells me I have 330 unique rows and the rest are duplicates. But actually all these 885 rows are unique, I can see that when I look at the file using ArcGIS Pro, and my colleague have looked at the file in another text-application. So it seems FME keeps the total number correct, 885, but changes some unique numbers so they are duplicates somehow. In AGP:In FME: How can this happen? I have tried reading the file both using the "normal" .dbf-writer, as well zipping the file and using Creator > ParameterFetcher > FeatureReader > FeatureReader > AttributeExposer.
Hi all, I have an WFS from a vendor that contains several polygons and associated attribute information. When I attempt to read via the OGC WFS reader, I encounter an error: <WFS> An error occurred while reading a GetFeature response, to ignore the error and avoid losing the previously read features, set the WFS "Ignore GetFeature Error" parameter. Total features downloaded: '0'As instructed, I've attempted to modify this setting, but continue to receive this error even when I've set to ignore. I've tried several iteration of different settings in the reader to attempt to resolve to no avail. I have noticed that if I enable the option to Disable XML Namespace Processing that I no longer receive the error, but I still do not get any returns -- perhaps there is some other setting I should investigate? I'm certain that this is specific to the reader as I am able to view returns from this WFS URL via httpCaller, Postman, and as a ArcGIS Online serv
Hi all, Not sure if someone could help me with this doubt.I'm trying to convert from SHP to MAPINFO a polygonal layer. I fill the Advance property from the Writer to be used the File Version = '300'. Once finished the conversion I see the file has taken '800'. Other layers maintain '300'. Not sure why some layers stick to the fixed '300' value that I give and others no.I'm using 2022.1 FME Desktop version. Thanks,J.
Hi, Is there a transformer within FME that could format CSV into plain text with formatting, see the attachment? The original file can also be in another format, for example excel. If someone can think of another writer that will facilitate the solution of the problem, it can be. file original - source datafile required - required data Thank you
I'm looking for a workaround to a small bug in FME that currently exists (Safe already know about the issue).I need to write some values into a spreadsheet, from which a formula calculates a result. I then need to read back the result in another process. However, it seems that the result is only available to FME if you open the Excel sheet manually and save the spreadsheet and then close it again. If you try to write the values and then read the result straight back without opening the spreadsheet you don't get back the calculated value. This is therefore no good as it makes an automated process difficult.You can see the issue demonstrated here.Does anyone have any magic workarounds to force a commit or a save in the spreadsheet behind the scenes, without the user having to intervene?
Hi. Can FME workbench read a .gws file? I only found this linkhttps://community.safe.com/s/article/fme-and-intergraph-geomedia-compatibilityThanks
We use file geodatabase replicas to edit our enterprise SDE geodatabase. Edits made to these file geodatabases by FME are not recognized as "changes" when these replicas are synchronized to the master.Has anyone found a way to solve this?I see a post from Mark Stoakes (about 5 years ago) where he explains that FME cannot make entries in the change tables maintained in the replica - which definitely makes sense.Just wondering if anyone has possibly solved this?
Its possible to write the TAGs but in MicroStation the tags do not work.I use FME 2016Thx for help.
Customer has a working migration chain on FME 2021.2.5 and we would like to upgrade to 2022.2. At first, I started extracting data using FeatureReader from our source (Oracle Spatial), but I have strange warning message in the log and not all data all extracted from the source. Warning message in the log relates to entries in ALL_SDO_GEOM_METADATA which are all set correctly – I would mention once more that data reading from Oracle using same workbench in 2021.2.5. is working. Here is the warning message: Execution of statement `SELECT table_name, column_name, (SELECT COUNT(*) from TABLE(META.diminfo)) dcount, SRID FROM ALL_SDO_GEOM_METADATA META WHERE ALL_SDO_GEOM_METADATA.owner = '<SOURCE_SCHEMA>''did not succeed; error was `ORA-00904: "ALL_SDO_GEOM_METADATA"."<OWNER>": invalid identifier'. (serverType=`ORACLE8i', serverName=`SERVER_NAME', userName=`<FME_READER>', password=`***', dbname=`') If I try to execute
IfcPresentationLayerAssignment is the entity where autocad layer information is stored in my ifc model. I can see that it is included in the ifc-file by reading it as plain text. However I can't seem to expose that entity in FME. I have tried different combinations of AttributeExposer, GeometryPropertyExtractor and listexploder. Is there anyway to expose that attribute and its values in FME?
Hi all, I'm manually fixing broken photogrammetric models of buildings (common errors like holes in overlit white walls etc.) and then I want to convert these fixed OBJ models to SLPK. I use this workflow: OBJ Reader – merge mesh parts: yes, move to coordinate system: yes, coordinate system: EPSG:5514 (Czech/JTSK.Krovak),Offsetter (to move it to correct geolocation) – X Offset: -747078.00223783311, Y Offset: -1054893.7301940639, Z Offset: 289.74612628016621,Esri Indexed 3D Scene Layer Writer – coordinate system: EPSG:5514 (Czech/JTSK.Krovak), geometry: i3s_terrain_mesh....but no file is created. I guess the problem is probably that the models are really big (over 0.5 GB)? Thanks for your help,Michal
I have a template dwg with a property set attached to lines and polylines. When I write a dwg and use that template is it then possible to fille the property set from FME?
I am trying to convert speciality maps for use in avionics software. I have converted the mbtiles to CADRG, and they import and display in the computer software, falconview properly. However I import them into the aircraft they display all black. The only thing I can tell is the CADRG has been exported with. 217 color tables bet pallet, with the last table being 0,0,0 which I think is causing the display to be all black. many ideas with resolving this issue? Thanks.
I'm encountering an issue reading NetCDF files I got from here:https://dap.ceda.ac.uk/badc/cmip6/data/CMIP6/CMIP/AS-RCEC/TaiESM1/historical/r1i1p1f1/day/pr/gn/latest/ When attempting to use a ListSearcher to search the "netcdf_coordinate_variable" list for an element with axis = T, I get no matches, even though its the first element.I also get no results using a ListExploder and a Tester to test the axis attribute.In fact the only attribute from the list that will match is "name". Looking at the list there are 2 elements, and the second element only has a "name" attribute and no others.I could see why this might trip up the ListSearcher, but I don't understand why the ListExploder + Tester method also fails to match? This is with FME 2022.1.2 on MacOS. I've attached a workspace (data linked above) and a screen shot showing the list has an element with an axis value of "T".
Hi,I want to find local low point in the point cloud. It is to bring out possible locations for water accumulation. Does anyone know a solution to this problem?