Using readers and writers to extract and load data.
Recently active
I have been investigating replacing my use of SQLite Spatial (GDAL) with the new (FME 2022) SpatiaLite Native format.Previously I used to be able to start a workspace with a SQL Creator with a statement like:SELECT id, column, geometryFROM table With a script like that, the old SQLite Spatial (GDAL) format SQLCreator would read the geometry correctly from a database created by a SQLite Spatial writer. However, I can't get the same to work with a SpatiaLite Native SQLCreator selecting from a database created by a SpatiaLite Native writer. Instead of reading the geometry of each feature, it reads a blank string attribute called geometry.Is selecting a geometry with a SQL statement no longer supported? I can probably replace this sort of use with Readers, but would prefer to not.Thanks.
HiSituationWe have a quite simple FME Workbench, loading CSV data from an URL, and writing it's data to a MSSQL database. The workbench works fine, writes all data and terminates with "Translation was successful". ProblemSometimes (actually mostly) the workbench doesn't stop right after it logs "Translation was successful", as it's supposed to do. Everything's done, all records have been inserted, but the workbench keeps running. Sometimes it takes 5min or 10min, sometimes it takes days until the workbench stops.The screenshot shows the situation. In this case it was a time lag of 5 min. FactsFME 2018.1MSSQL 2016; it's on the same machineWith PostgreSQL or Oracle we never experienced the same issue Any ideas or hints?Regards, Tobias
I need to run approx 10K zipped LAS ASPRS files and generate an xyz file with 5 m grid using ground values. Looking for a workflow to do this.
Hi all, I've been tasked with trying to connect to a Sharepoint list and have the appropriate security (read-only) applied to the sites and file/lists. When I try to read in the Sharepoint URL with FME, I am presented with errors, be it for Web Auth, Basic, NTLM or Kerberos. I've attached screenshots of the errors. Any help is appreciated. I do also have another URL which is formatted as "https://<site>.sharepoint.com/sites/<subsite>/_api/web/lists" which I have tried as well, but to no avail
I have a sql server table that I do not own but have full permission on.I can setup a GEODATABASE_SDE Reader and read it no problem the table qualifier is "abc\\username" When I try to setup a writer for it the Table Qualifier gets set to _abc_username_ When I try to write to it I get an error message statingGeodatabase Writer: Feature Class or Table '_abc_username_.table_nm' must exist when Table Handling is set to 'Use Existing' Unfortunately using FME2018.
I have a writer that creates a CSV file to a folder on my computer. How do I write this CSV file to AGOL (ArcGIS Online account)? I already understand how to write data to an AGOL Feature Service. I need to create a CSV file to my AGOL account. I plan to update this CSV file every night (via the Task Scheduler) and share it with others. I'm using FME Desktop (not FME Server). Thanks.
I'm a bit surprised I haven't found this answered already - maybe I'm just not seeing it. When using the ArcGIS Online Feature Service writer - is it possible to define the layer ids, or layer order that will be used when creating a new feature service? I want to help ensure that the new layer ids match previous ids. Since the writer can't add new layers to an existing service, I need to delete the existing service first. Do I need to ensure the different layers are passed to the writer in the preferred order? Thanks!
Hi, I have two LAS files of same area. One is the classified data and another is unclassiffied data. I want to copy the classification from the classigied LiDAR data to Unclassified LiDAR data. Any help is greatly appreciated. Regards, Krishna
In the documentation I see that Appearances are planned for a future release. Just wondering if this is already on a timeline somewhere: https://docs.safe.com/fme/html/FME_Desktop_Documentation/FME_ReadersWriters/cityjson/quick_facts_cityjson.htm @deanatsafe - perhaps you're the one to ask?
I`m trying to make a strange raster, due to a specific software demanding exactly that format. It seems to be a GeoTIFF with 1 rasterband (UINT8) that has palettes with 3 values (RGB). See below for more information. I have managed to create the 1 channel TIF with the correct value, however I struggle to add the palette, and add the correct value for each palette to each pixel. Since FME can read the file correctly, I assume it can also create such a file, however I am stuck after examining all the RasterPalette* Transformers. Any raster-wizards out there?
I successfully can read/write Esri Arc SDE (Geodatabase) with FME 2021.2.6 64-Bit and ArcGIS 10.8.2 + Esri BG Geoprocessing installed. So far so good. If however ArcGIS Server 10.9.1 is also installed in the same enviroment, problems arise and an error message appears, that "BG Geoprocessing is missing" and needs to be installed. What is the issue here ? How can it be solved ?It seems only uninstalling ArcGIS Server 10.9.1 solves the problem, but I need ArcGIS Server for other reasons/applications. B.T.W.: ArcGIS Server 10.9.1 is the corresponding version to ArcGIS 10.8.2, in case you wonder about the version mix ;-) Thanks for any clue about this Michael
Also When I am trying to use Civil 3D and CAD Entities. I am getting reader error "BADNEWS: BADNEWS: No geometry mapping entry found for 'autocad_wipeout' in metafile 'C:\\Program Files\\FME_2022_1\\metafile\\CIVIL3D.fmf'. Please visit http://www.safe.com/support"
Hi! Im having a struggle to merge the "objec data" to the "block" or the actuall autocad_ellipse. When i zoom to line 1 it contains no geomtery, how can i add the object data to the ellipse (line3)?
Hi,I have a service account that I use for connecting to our company's AWS, this works successfully for S3 and SQS and DynamoDB on a windows server. However using the same workspace, same AWS account on my laptop I get the certificate error:PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target- I've upgraded to 2021.2.6 as suggested in other posts.- I've confirmed it is not a certificate issue on my laptop because SQS and S3 are working (this didn't work before I installed the certificates).- I've confirmed it is not an issue with my AWS account permissions because I can run the workspace on the windows servers. Any ideas what the issue could be? How does the DynamoDB reader work, is it looking somewhere different for the certificates? What is the HTTP request it makes behind the scenes so I can test with other applications? Thank-you!Kathy
We are in change our FME-Desktops to a new machine. Same WindowsUser, same Version -> our SQL Server Database Connection is not working on the new Server.By defining a database connection (Windows authentication) the Error below appears. Microsoft SQL Server Non-Spatial Reader: Trying to connect using Microsoft OLE DB Driver for SQL Server...Microsoft SQL Server Non-Spatial Reader: Failed to connect using Microsoft OLE DB Driver for SQL Server. Provider error '(-2147467259) TCP Provider: The wait operation timed out.'. Connection string 'Provider=MSOLEDBSQL;DataTypeCompatibility=80;Data Source=XXXX\\sql1;Initial Catalog=XXXX;Integrated Security=SSPI'Failed to open readerUniversalReader -- readSchema resulted in 0 schema features being returned
I have an AGOL reader that I read many attributes from. This works great but, I also need to read the latitude and longitude for each record. I've done searches and read documentation but can't find the answer. Can someone help me? I've attached the Parameters tab from my AGOL Reader if that's relevant. Thanks.
i have different data and i would like to have all data in one view at FME inspector to show all of them together .How could i achieve that ? Thanks in advanced .FME 2021
Im hoping im posting this in the right category.. Im trying to connect to ArcGIS online portal using these instructions: https://community.safe.com/s/article/How-to-create-an-FME-Web-Connection-for-Esri-ArcGIS-Portal-Feature-Service-OAuth-2-0 Everyhing is filled in correctly but when trying to authenticate I get a window called Web Service Authentication that stays grey. What could be happening here?
Ok, reach way back into those 30 year old neurons and long un-electrified bits: is there anything in FME today that can read PAMAP GIS data files? I have a stash of Pamap data from the 1990s to convert to a modern format such as GeoPKG or shapefiles and geoTIFF. Pamap and Safe are both BC born and raised, have overlapping time spans, and were heavily involved with BC government spatial data operations. Surely there was some interaction? Perhaps there's a SAIF v1 or FME v0.3b or in the archives somewhere that can be resurrected for this single task? (This is personal project and not associated with my day job at Yukon government. My personal google account is mistakenly tied to my work credentials on the Safe Community site. Please use maphew@gmail.com if not following up via this forum. Thanks.)
Hey All, I am trialing FME currently to see if this software is going to be able to simplify my life, and it is looking good so far! One thing I am hoping to do is a very simple "Download all attachments from AGOL feature layer".I have seen dozens of posts on this site about various processes involving AGOL features and generating reports etc with the attachments, but they are a little advanced for me at the moment. I am hoping someone can provide me with a simple workspace that I provide my AGOL feature layer, then provide an output folder location, and FME will download all attachments for me.I have had a few cracks at this but I cannot work out the attachment part, the attributes are all I can get at this stage.Can someone show me a screenshot or something showing the simplest solution to carry out this task? I got to this point but it doesn't write anything to the output folder:
Hi, I have a workspace to apply for a cutting permit that takes 3 cutblocks and aggregates them into one feature based on cutting permit and then output that directly to the HarvestApplicationWithCP output. This looks ok when the writer is redirected to the inspector, but the XML is incomplete, it only has one of the cutblocks in the HarvestApplicationWithCP portion of the XML.
Is there some special reader for Bentley AXSYS drawings format that would parse nested objects in XML and joined with the drawing?
Hello, When I inspect/read a OBJ file, the associated MTL file is not used (aka my objects are not textured). My OBJ and MTL files are both generated by Blender and their format seems correct. Thanks.
I had a WFS reader with a search envelope that is downloading point features. The search envelope used to work in a previous version of Desktop.I'm now getting the error:Unknown coordinate system '' specified. Nothing else changed. The data is read in as EPSG:4326 and the search envelope is the same. Any ideas?
I am encountering issues when reading text from a DGN where the text is in Microstation native fonts (e.g. igds_font = 0). I am generating PDF files from the DGN's and I need the text to look the same in the PDF as it does in Microstation. Currently, I am seeing variations in text font, as well as special character inconsistencies (e.g. degree symbols are read as ^ ). Is there a way to read Microstation fonts in FME? I have access to the font library .rsc files - can I utilize them somehow within FME?Thank you!Courtney