Using readers and writers to extract and load data.
Recently active
Hello Everyone,I am trying to write some structured data into an existing table into AZURE. The table is already created but there is no data in the tables. I have set up the connections and have the correct table name so no issue there. Also, the fields I am trying to write match the naming conventions of the AZURE table.As you can see from the screen shot below I have chose insert but I am receiving this error message ( below screenshot) 0.0|ERROR |Microsoft Azure SQL Database Non-Spatial Writer: Failed to create Azure table 'siro_stg.MAD' because no clustered index or primary key was specified. If creating a new table, go into the 'User Attribute' tab and set the 'Index' column to 'clustered', 'clustered_not_null', or 'primary_key' for a columnThe AZURE DB table has no primary key set or indexing. I was told this shouldn't matter as we are treating this as a staging area table.Not sure why this error is appearing as I'm not t
I am currently trying to take data from a specified location on one notes or share points, and out put it to both AWS and as a arc portal feature service. When trying to add the sharpoint or onedrive reader I get the attached error. I think it may be an issue with FME not having access to the OneDrive, Share point and Arc Portal. Any help would be much appreciated Error LogCreating reader for format: Esri ArcGIS Portal Feature ServiceTrying to find a PYTHON plugin for reader named `ARCGISPORTALFEATURES'Loaded Python module `arcgisonlinefeatures' from file `C:\\Program Files\\ArcGIS\\Data Interoperability for ArcGIS Pro\\python\\python37\\arcgisonlinefeatures\\__init__.pyc'Creating reader for format: Esri ArcGIS Portal Feature ServiceTrying to find a PYTHON plugin for reader named `ARCGISPORTALFEATURES'Loaded Python module `arcgisonlinefeatures' from file `C:\\Program Files\\ArcGIS\\Data Interoperability for ArcGIS Pro\\python\\python37\\arcgisonlinefeatures\\__init
Hello, I have a file geodatabase on ArcGIS portal. In need to access it's contents without downloading the file geodatabase. I tried to approach the file geodatabase with the ArcGIS Portal feature service reader but as designed the file geodatabase did not show up as a readable feature class.I am looking for a method to read the contents of the file geodatabase as if I would do normally with the file geodatabase reader. Is it even possible to read from a file geodatabase on ArcGIS portal with FME?Thanks for the help!
Good morningCan someone advise how i do the followingI have 1 excel spreadsheet (data.xlsx) and 1 empty excel spreadsheet (template.xlsc)I want to write the contents of data.xlsx to template.xlsx and output it as result.xlsxHow do i write the map the columns from data.xlsx to the template? It does automatically write correctly, but i would like to know how to specifically write one column to another before i output The contents of the data.xlsx file i've uploaded are only test, but i would like to know how to do this so i can do the task in the future using proper data thanksSimon Hume
Hi Guys,i am wondering of using of Excel styler ,if i select for my excel writer this optionOutput Field Names: No Use Attribute Names As Column Positions: Yes i can see my result only in inspector but it does not exist any excel file ,my folder is empty .so i tried to put my excel writer before excel styler so i can get my excel output in the folder . then i put again my excel writer after excel styler but i changed in parameter of excel writer as try , this option Output Field Names: yes Use Attribute Names As Column Positions: Noi found i can get my output in the folder nd everything is perfect except the first row it has field names ,i want to delete it .So why using this option as No ,i got nothing or if someone know a method to delte the first row so everything will be fine with me
Hello Team,We recently upgraded FME Server 2019, and tried create AD group user it was asking for Search Account Password which i am not very clear about it.Can somebody instruct me how to export AD group users into FME server 2019? Is there any prerequisites to do this activity? What is the process to add AD group user to FME Server.Thanks in advance.
Hi there, I need some food for thoughts to solve the specific problem in FME. I have a transformation in FME that contains attributes like incident_date, Month, a third column which contains either monthly cumulative average wastage value for the current regulatory year or historic (5 years) monthly average wastage value. I have the fourth column which states that whether the monthly average value belongs to the current regulatory year or historic 5 years. Now I want to generate the third type of monthly average wastage value called "forecasted value" in such a way that if current month is less than the end month of the current regulatory year, for instance, Today the month is February and end month of current regulatory year is March, then FME get the historic 5 years value of March and add it in the remaining value of current-year average wastage value and labeled it as "forecasted value" in the fourth column. To be honest, I am stuck and don't know how to imp
I work for the US Archives and we need to convert DWG into a format like GML or Shape. However, we have lost text, legend information and other items.Any ideas?Thanks, Brett
Hello I am getting this error when I try to connect to ArcGIS online feature reader.Can anyone help with this?ThanksNikkiError: Connect to www.arcgis.com:443 [www.arcgis.com/18.234.22.25, www.arcgis.com/54.236.87.106, www.arcgis.com/18.234.22.29] failed: Connection refused: connectError: Connect to www.arcgis.com:443 [www.arcgis.com/18.234.22.25, www.arcgis.com/54.236.87.106, www.arcgis.com/18.234.22.29] failed: Connection refused: connectError: COM.safe.fmewebservices.FMEWebServiceException: Connect to www.arcgis.com:443 [www.arcgis.com/18.234.22.25, www.arcgis.com/54.236.87.106, www.arcgis.com/18.234.22.29] failed: Connection refused: connect at COM.safe.fmewebservices.FMEHttpUtils.post(FMEHttpUtils.java:162)
Hello: I'm experiencing very slow read speeds from one (1) Access database table that only has approx. 114K records in it. This is also a local copy of the database (.mdb) file (did so to rule out network latency). Is there some trick to increase the read speed for Access?
Through the ArcGIS Pro ArcPy, I have used the "ExportXMLWorkspaceDocument_management" method to loop through multiple geodatabases and export the metadata of individual feature classes. now I would like to transform those into more readable excel files. The xml files are structured according to ISO19139 standard. Any tip would be appreciated, even an entirely different workflow.
My target ESRI File Geodatabase (FGDB) is following UPDM 2019 data model. By that, we have few feature classes which contain many subtypes. Many feature class attributes have defined default values on the level of the FCL subtype (AssetGroup) usually in combination with domain.What I noted is that default value of the attributes not contained in the FGDB writer is not populated in the target FCL. We have huge number of attributes on the FCL level and it would be quite some work to pick up each default value and set it up in the writer. Maintaining such workbench would be also quite demanding.Can someone please tell me is it possible to get somehow the default value of the attribute automatically populated in the FGDB like when manual editing in ArcGIS Pro? I am using FME 2019.2 with ArcGIS Pro 2.4.Thanks in advance,Dušan
Is there a way to get the Modified By username/name from One Drive?
Hello I have 3 data sources or tables and I would like to make one Excel reader (for one file) with 3 worksheets, one for each data source. How to do this simply?Thanks
I'm attempting to write several features unto a google sheet via google writer. What's odd is that when the workspace is finished running, only a fraction of the records are actually on the spreadsheet. Despite the software saying all of it went through. Looking at the log, I see the following error : 'Google Sheets Writer: Server reported error code 409 (Conflict) when writing to cell A4 on worksheet 'Notes Pairing'. The worksheet may have been modified outside of FME during this translation'This error repeats 89 more times since FME is attempting to write on 90 cells.Not sure how to proceed at this point.
I have a kml file that is generated by FME that I use as a layer in Google Maps. The auto generated kml file has a lot of kml features/elements that are not required for the display, making the kml file unnecessary bulky. Is there a way to remove such features? I have done this by hand and can confirm that the kml file still displays correctly in Google Maps. I assume that the XML Updater should be used for this, but I have not been able to get the required results. I most probably did something wrong in my implementation with my limited understanding of how it is supposed to be used. Perhaps there is a way to do this with the kml transformers, which I was not able to find. Any inputs on how to resolve this would be much appreciated.As an example, say you have the following (sample) kml file where you would like to remove elements/features.<?xml version="1.0" encoding="UTF-8"?><!-- Generated by FME 2018.0.0.0 (Build 18284) --><kml xmlns:xsd="htt
I'm reading in bunch of dwg files with PathReader, then give those to DWG Reader, outputing through <Generic> port with some exposed attributes. I need to have Path to reader files, but exposed fme_dataset attribute is missing. Is there any workaround?
HelloI am using HttpCallers to populate fields in an ArcSDE database based on values from a Json feed. I have a case where incoming features (lets say feature 1) has two attributes 'References type' and 'References MessageID'."References type" would have values like "Update" or "Cancellation" and References MeesageID will have the ID of an older record that is already in the database (feature 2), and is affected by the new feature (feature 1) and the specifications in 'References Type' So I need to make a call where I after filtering out features that have values in "References Type" column looks in the database to find Feature2.ID = Feature1.References MessageID. And then populates another field in feature 2 ("References") with values from "References type" & "ID" in feature 1.I hope someone can help me how make this in FME preferably using httpCaller.
Hi SafersCan you please take a look at this post, it might be a bug:https://knowledge.safe.com/questions/107806/rename-csv-file-before-reading-in-data.htmlI was able to reproduce the behavior in FME 2019.2.2.0 (20200103 - Build 19817 - WIN64)
I have a CSV file that is downloaded from a source that I cannot edit. The CSV that is exported contains a character ("?") in its file name which results in FME (I'm using 2019.2.3) failing to read the file. Ultimately this workspace will run on FME Server and will access this CSV from an email that it receives.The filename is FILE_(?)_FILE.csv and this flags an error in FME Desktop (which I expect will be replicated on FME Server) on attempting to load the data into the workspace:CSV reader: Failed to open file 'C:\\FILE_(?)_FILE.csv' for reading. Please ensure that the file exists and you have sufficient privileges to read itIt looks like FME is incorrectly interpreting the file name string and is obviously then unable to find it.An obvious solution is to ask the end user to remove the "?" symbol from the file name before running the workspace but this is prone to error and I would much rather handle it in the FME workspace itself. Is this possible?Th
I'm having difficulties writing out the intensity of my point cloud pts after thinning them.I see the intensity in the XYZ input but can't see how to write it out.
Hello,I tested the solution proposed here to convert shp to dwg : https://knowledge.safe.com/articles/18703/how-to-convert-shp-to-dwg-esri-shapefile-to-autoca.htmlWhen I open the dwg in CAO software, I no longer have the attributes associated with the objects.Which transformers should be used for this ?Thanks you,
Hi - Does anyone have some pointers on how to handle special characters in layer names against ArcGIS Online when using the in-built writers?e.g. I have a layer on ArcGIS Online called Layer 1 (Addressing)FME changes this to Layer 1 _Addressing_ which in-turn will cause the transformation to fail.How does one handle this without changing the layer name as it has to be be this.Thanks
Is there a way to add fields from excel into a feature service field on ArcCollector?I'm hoping to take the items of a column on excel and place them in a form for their related attribute.i.e. fill in a field on multiple forms in an ArcCollector project using excel
I am having an issues listing the contents of a google drive folder. First I receive this warning "Google Drive: SSL certificate verification failed for host 'www.googleapis.com'. HTTPS connections may not be secure. Disabling verification of SSL certificates. Message: HTTPSConnectionPool(host='www.googleapis.com', port=443): Max retries exceeded with url: /drive/v3/files/14VXm0wlvHZuW9tkS46VAWE1MYeIJpkAP?fields=id%2Cname%2CmimeType%2Csize%2CwebViewLink%2CmodifiedTime%2Cparents&prettyPrint=false (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1051)" Then the translation continues and I receive this error:"ile "C:\Program Files\FME\python\requests\models.py", line 940, in raise_for_status raise HTTPError(http_error_msg, response=self)requests.exceptions.HTTPError: 400 Client Error: Bad Request for url:" click on the url in the python error and I recieve this message"{"error