Using readers and writers to extract and load data.
Recently active
Hello: I'm experiencing very slow read speeds from one (1) Access database table that only has approx. 114K records in it. This is also a local copy of the database (.mdb) file (did so to rule out network latency). Is there some trick to increase the read speed for Access?
Through the ArcGIS Pro ArcPy, I have used the "ExportXMLWorkspaceDocument_management" method to loop through multiple geodatabases and export the metadata of individual feature classes. now I would like to transform those into more readable excel files. The xml files are structured according to ISO19139 standard. Any tip would be appreciated, even an entirely different workflow.
My target ESRI File Geodatabase (FGDB) is following UPDM 2019 data model. By that, we have few feature classes which contain many subtypes. Many feature class attributes have defined default values on the level of the FCL subtype (AssetGroup) usually in combination with domain.What I noted is that default value of the attributes not contained in the FGDB writer is not populated in the target FCL. We have huge number of attributes on the FCL level and it would be quite some work to pick up each default value and set it up in the writer. Maintaining such workbench would be also quite demanding.Can someone please tell me is it possible to get somehow the default value of the attribute automatically populated in the FGDB like when manual editing in ArcGIS Pro? I am using FME 2019.2 with ArcGIS Pro 2.4.Thanks in advance,Dušan
Is there a way to get the Modified By username/name from One Drive?
Hello I have 3 data sources or tables and I would like to make one Excel reader (for one file) with 3 worksheets, one for each data source. How to do this simply?Thanks
I'm attempting to write several features unto a google sheet via google writer. What's odd is that when the workspace is finished running, only a fraction of the records are actually on the spreadsheet. Despite the software saying all of it went through. Looking at the log, I see the following error : 'Google Sheets Writer: Server reported error code 409 (Conflict) when writing to cell A4 on worksheet 'Notes Pairing'. The worksheet may have been modified outside of FME during this translation'This error repeats 89 more times since FME is attempting to write on 90 cells.Not sure how to proceed at this point.
I have a kml file that is generated by FME that I use as a layer in Google Maps. The auto generated kml file has a lot of kml features/elements that are not required for the display, making the kml file unnecessary bulky. Is there a way to remove such features? I have done this by hand and can confirm that the kml file still displays correctly in Google Maps. I assume that the XML Updater should be used for this, but I have not been able to get the required results. I most probably did something wrong in my implementation with my limited understanding of how it is supposed to be used. Perhaps there is a way to do this with the kml transformers, which I was not able to find. Any inputs on how to resolve this would be much appreciated.As an example, say you have the following (sample) kml file where you would like to remove elements/features.<?xml version="1.0" encoding="UTF-8"?><!-- Generated by FME 2018.0.0.0 (Build 18284) --><kml xmlns:xsd="htt
I'm reading in bunch of dwg files with PathReader, then give those to DWG Reader, outputing through <Generic> port with some exposed attributes. I need to have Path to reader files, but exposed fme_dataset attribute is missing. Is there any workaround?
HelloI am using HttpCallers to populate fields in an ArcSDE database based on values from a Json feed. I have a case where incoming features (lets say feature 1) has two attributes 'References type' and 'References MessageID'."References type" would have values like "Update" or "Cancellation" and References MeesageID will have the ID of an older record that is already in the database (feature 2), and is affected by the new feature (feature 1) and the specifications in 'References Type' So I need to make a call where I after filtering out features that have values in "References Type" column looks in the database to find Feature2.ID = Feature1.References MessageID. And then populates another field in feature 2 ("References") with values from "References type" & "ID" in feature 1.I hope someone can help me how make this in FME preferably using httpCaller.
Hi SafersCan you please take a look at this post, it might be a bug:https://knowledge.safe.com/questions/107806/rename-csv-file-before-reading-in-data.htmlI was able to reproduce the behavior in FME 2019.2.2.0 (20200103 - Build 19817 - WIN64)
I have a CSV file that is downloaded from a source that I cannot edit. The CSV that is exported contains a character ("?") in its file name which results in FME (I'm using 2019.2.3) failing to read the file. Ultimately this workspace will run on FME Server and will access this CSV from an email that it receives.The filename is FILE_(?)_FILE.csv and this flags an error in FME Desktop (which I expect will be replicated on FME Server) on attempting to load the data into the workspace:CSV reader: Failed to open file 'C:\\FILE_(?)_FILE.csv' for reading. Please ensure that the file exists and you have sufficient privileges to read itIt looks like FME is incorrectly interpreting the file name string and is obviously then unable to find it.An obvious solution is to ask the end user to remove the "?" symbol from the file name before running the workspace but this is prone to error and I would much rather handle it in the FME workspace itself. Is this possible?Th
I'm having difficulties writing out the intensity of my point cloud pts after thinning them.I see the intensity in the XYZ input but can't see how to write it out.
Hello,I tested the solution proposed here to convert shp to dwg : https://knowledge.safe.com/articles/18703/how-to-convert-shp-to-dwg-esri-shapefile-to-autoca.htmlWhen I open the dwg in CAO software, I no longer have the attributes associated with the objects.Which transformers should be used for this ?Thanks you,
Hi - Does anyone have some pointers on how to handle special characters in layer names against ArcGIS Online when using the in-built writers?e.g. I have a layer on ArcGIS Online called Layer 1 (Addressing)FME changes this to Layer 1 _Addressing_ which in-turn will cause the transformation to fail.How does one handle this without changing the layer name as it has to be be this.Thanks
Is there a way to add fields from excel into a feature service field on ArcCollector?I'm hoping to take the items of a column on excel and place them in a form for their related attribute.i.e. fill in a field on multiple forms in an ArcCollector project using excel
I am having an issues listing the contents of a google drive folder. First I receive this warning "Google Drive: SSL certificate verification failed for host 'www.googleapis.com'. HTTPS connections may not be secure. Disabling verification of SSL certificates. Message: HTTPSConnectionPool(host='www.googleapis.com', port=443): Max retries exceeded with url: /drive/v3/files/14VXm0wlvHZuW9tkS46VAWE1MYeIJpkAP?fields=id%2Cname%2CmimeType%2Csize%2CwebViewLink%2CmodifiedTime%2Cparents&prettyPrint=false (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1051)" Then the translation continues and I receive this error:"ile "C:\Program Files\FME\python\requests\models.py", line 940, in raise_for_status raise HTTPError(http_error_msg, response=self)requests.exceptions.HTTPError: 400 Client Error: Bad Request for url:" click on the url in the python error and I recieve this message"{"error
Hi all, i need read "extended elements". And in reader dgn 8i i don´t see anything to read tihis elements. also when i read this dgn, this elements appear moved respect i read this file in microstation. You could see this in the captures. what can i do to read this well.microstationRead in fme with the "dgn v8" reader
HelloI could extract the IfcRelSpaceBoundary using the Deprecated reader. However, it doesn't have any geometry. There is an attribute (Connection geometry) which refers to the instance_name of the related geometry but I can't retrieve this geometry. Is there any way to extract the geometry of IfcRelSpaceBoundary in FME? @daveatsafe
Hi all, I am trying to make a .shp from the areas with a minimum slope (DEM). The picture shows the output of the RasterSlopeCalculator (its about areas around water). I need to find a way to identify the transitional value of slope where the colour white turns to black, and then filter out the black areas. If someone has an idea, or knows if this is even possible, please let me know! :) Thanks.
In Esri ArcGIS (AGOL) feature service writer, there is an option to view written data in fme.How can I access these written features in python ?
Hi!I´m trying to load a polygon layer (buildings) from a shapefile to a Smallworld Database and I got the following error message at the end of the process:“Smallworld Translator Error: Value 5848495342526991361 out of range for field new_key”I have done this before without any problem. Can you hlp me, please?Regards.
Hi! I have an Excel file with ID numbers of different train stops, 20 of them. I wanted to find all DWG files that are in the subfolder Z\\Modell\\.*03.dwg but it takes around 1 h to run, at this point is it faster just to find them manually and run the workspace. Is there any way to improve the search time? The "root" folder is a drive, but all files are within a folder is called "4\\_CAD" so I limit the search to only the subfolders of my starting folder. Trying to make it faster my only use the subfolder I know contain the other folders and files.I was thinking maybe change it to have 2 feature writers after eachother instead, one that only searches for the correct folder then look for the files within the found folders. Change allowed path type to only folders then only files. Other suggestions?Also I figured if I have 60 subfolders, for every feature read it will look in all 60 of them 20 times over, that's probably why it takes such a long time, is there a
Hello, I am new to this software, i have a bunch of KML Files that i have been successfully been able to edit. However when i go to run the software it combines them into the same file, is there a way to have the same number of output files as input? i.e. save individually not combine them
Working in a company with a variety of software packages, I have been tasked with making an unusual MapInfo layer available as read only in QGIS. The difficulty is that a lot of the data on the MapInfo layer has been added as text direct to the map, with a variety of font colours, rather than being held in the attributes table and applied as labels.Is there a way to convert the MapInfo layer into rasta layer to view in QGIS, almost as a photo of how it would appear in MapInfo?Thank you
i want to copy the first sheet that include name and number to new excel sheet and rename it to Roads and copy the second sheet to sheet called details and i want to add another sheet ,output of fme but i got it from another excel .so at the end i want to get 3 sheets ,roads,detail,result i did static calculator for the third sheet and get my output but from another excel so i should have three sheets in result excel two from roads and one output of fmebut my output from work space ,i want to change it to blank page and write my output ,looks like the another sheets. my filesThanks for help