Using readers and writers to extract and load data.
Recently active
I am trying to find a method for reader to link between many sources to one source but i could not find . i have many readers come from the same source when i run my workbench with quick translator ,as result it gives me around 10 sources to select but 8 of them from one source , bcs i have chosen from the beginning individual Feature typesis there a method to refer only to one source files instead of 8 sources . because all of them from the same file
Hi FME gurus,For an engineer I would like to parse OSM XML data with line and polygon features. Although point features are no problem to parse, the geometry from the line and polygon features is not coming correctly along by the OSM XML reader.I can parse the OSM XML by a combination of FME transformers:However this transformation is rather slow due to the number of vertices that have to be parsed.Attached therefore an example of an OSM XML with highways. Is someone able to use the OSM XML reader with some settings, whereby the geometries of the line and polygon features are correctly parsed?
I am using Esri ArcGIS Online(AGOL) feature service to write data from a database. A flag column is to be maintained in database to check whether a feature is successfully written or not, based on that flag column we are further processing those records by another software. How do I get the OBJECTID and GLOBALID of features which are successfully written to AGOL so that I can update the flag ?
Hello Friends,I need an urgent help. Can anyone please help?I am having something like this:and i want to fill down the values something like this in excel:its like a fill down option for sample id and ID till the time it finds a new sample line in text_line data or till the time it finds a blank value in its own column and stop when next row has a value.Also attaching the excel file for your reference.Thanks
While i am trying to extract feature classes from postgres database to esri file geodatabse, i am not able to get the geometries, if i use postgres in the Format dropdown of Reader. After enabling PostGIS on the database i am not able to see any spatial objects in the tables list.. What is the correct process to read postgis enabled postgres database?
Is there any documentation on the best way to install and set-up FME in an AWS Cloud Environment?How is the licence set-up on a dynamic environment?
Hello Everyone,I am trying to write some structured data into an existing table into AZURE. The table is already created but there is no data in the tables. I have set up the connections and have the correct table name so no issue there. Also, the fields I am trying to write match the naming conventions of the AZURE table.As you can see from the screen shot below I have chose insert but I am receiving this error message ( below screenshot) 0.0|ERROR |Microsoft Azure SQL Database Non-Spatial Writer: Failed to create Azure table 'siro_stg.MAD' because no clustered index or primary key was specified. If creating a new table, go into the 'User Attribute' tab and set the 'Index' column to 'clustered', 'clustered_not_null', or 'primary_key' for a columnThe AZURE DB table has no primary key set or indexing. I was told this shouldn't matter as we are treating this as a staging area table.Not sure why this error is appearing as I'm not t
I am currently trying to take data from a specified location on one notes or share points, and out put it to both AWS and as a arc portal feature service. When trying to add the sharpoint or onedrive reader I get the attached error. I think it may be an issue with FME not having access to the OneDrive, Share point and Arc Portal. Any help would be much appreciated Error LogCreating reader for format: Esri ArcGIS Portal Feature ServiceTrying to find a PYTHON plugin for reader named `ARCGISPORTALFEATURES'Loaded Python module `arcgisonlinefeatures' from file `C:\\Program Files\\ArcGIS\\Data Interoperability for ArcGIS Pro\\python\\python37\\arcgisonlinefeatures\\__init__.pyc'Creating reader for format: Esri ArcGIS Portal Feature ServiceTrying to find a PYTHON plugin for reader named `ARCGISPORTALFEATURES'Loaded Python module `arcgisonlinefeatures' from file `C:\\Program Files\\ArcGIS\\Data Interoperability for ArcGIS Pro\\python\\python37\\arcgisonlinefeatures\\__init
Hello, I have a file geodatabase on ArcGIS portal. In need to access it's contents without downloading the file geodatabase. I tried to approach the file geodatabase with the ArcGIS Portal feature service reader but as designed the file geodatabase did not show up as a readable feature class.I am looking for a method to read the contents of the file geodatabase as if I would do normally with the file geodatabase reader. Is it even possible to read from a file geodatabase on ArcGIS portal with FME?Thanks for the help!
Good morningCan someone advise how i do the followingI have 1 excel spreadsheet (data.xlsx) and 1 empty excel spreadsheet (template.xlsc)I want to write the contents of data.xlsx to template.xlsx and output it as result.xlsxHow do i write the map the columns from data.xlsx to the template? It does automatically write correctly, but i would like to know how to specifically write one column to another before i output The contents of the data.xlsx file i've uploaded are only test, but i would like to know how to do this so i can do the task in the future using proper data thanksSimon Hume
Hi Guys,i am wondering of using of Excel styler ,if i select for my excel writer this optionOutput Field Names: No Use Attribute Names As Column Positions: Yes i can see my result only in inspector but it does not exist any excel file ,my folder is empty .so i tried to put my excel writer before excel styler so i can get my excel output in the folder . then i put again my excel writer after excel styler but i changed in parameter of excel writer as try , this option Output Field Names: yes Use Attribute Names As Column Positions: Noi found i can get my output in the folder nd everything is perfect except the first row it has field names ,i want to delete it .So why using this option as No ,i got nothing or if someone know a method to delte the first row so everything will be fine with me
Hello Team,We recently upgraded FME Server 2019, and tried create AD group user it was asking for Search Account Password which i am not very clear about it.Can somebody instruct me how to export AD group users into FME server 2019? Is there any prerequisites to do this activity? What is the process to add AD group user to FME Server.Thanks in advance.
Hi there, I need some food for thoughts to solve the specific problem in FME. I have a transformation in FME that contains attributes like incident_date, Month, a third column which contains either monthly cumulative average wastage value for the current regulatory year or historic (5 years) monthly average wastage value. I have the fourth column which states that whether the monthly average value belongs to the current regulatory year or historic 5 years. Now I want to generate the third type of monthly average wastage value called "forecasted value" in such a way that if current month is less than the end month of the current regulatory year, for instance, Today the month is February and end month of current regulatory year is March, then FME get the historic 5 years value of March and add it in the remaining value of current-year average wastage value and labeled it as "forecasted value" in the fourth column. To be honest, I am stuck and don't know how to imp
I work for the US Archives and we need to convert DWG into a format like GML or Shape. However, we have lost text, legend information and other items.Any ideas?Thanks, Brett
Hello I am getting this error when I try to connect to ArcGIS online feature reader.Can anyone help with this?ThanksNikkiError: Connect to www.arcgis.com:443 [www.arcgis.com/18.234.22.25, www.arcgis.com/54.236.87.106, www.arcgis.com/18.234.22.29] failed: Connection refused: connectError: Connect to www.arcgis.com:443 [www.arcgis.com/18.234.22.25, www.arcgis.com/54.236.87.106, www.arcgis.com/18.234.22.29] failed: Connection refused: connectError: COM.safe.fmewebservices.FMEWebServiceException: Connect to www.arcgis.com:443 [www.arcgis.com/18.234.22.25, www.arcgis.com/54.236.87.106, www.arcgis.com/18.234.22.29] failed: Connection refused: connect at COM.safe.fmewebservices.FMEHttpUtils.post(FMEHttpUtils.java:162)
Hello: I'm experiencing very slow read speeds from one (1) Access database table that only has approx. 114K records in it. This is also a local copy of the database (.mdb) file (did so to rule out network latency). Is there some trick to increase the read speed for Access?
Through the ArcGIS Pro ArcPy, I have used the "ExportXMLWorkspaceDocument_management" method to loop through multiple geodatabases and export the metadata of individual feature classes. now I would like to transform those into more readable excel files. The xml files are structured according to ISO19139 standard. Any tip would be appreciated, even an entirely different workflow.
My target ESRI File Geodatabase (FGDB) is following UPDM 2019 data model. By that, we have few feature classes which contain many subtypes. Many feature class attributes have defined default values on the level of the FCL subtype (AssetGroup) usually in combination with domain.What I noted is that default value of the attributes not contained in the FGDB writer is not populated in the target FCL. We have huge number of attributes on the FCL level and it would be quite some work to pick up each default value and set it up in the writer. Maintaining such workbench would be also quite demanding.Can someone please tell me is it possible to get somehow the default value of the attribute automatically populated in the FGDB like when manual editing in ArcGIS Pro? I am using FME 2019.2 with ArcGIS Pro 2.4.Thanks in advance,Dušan
Is there a way to get the Modified By username/name from One Drive?
Hello I have 3 data sources or tables and I would like to make one Excel reader (for one file) with 3 worksheets, one for each data source. How to do this simply?Thanks
I'm attempting to write several features unto a google sheet via google writer. What's odd is that when the workspace is finished running, only a fraction of the records are actually on the spreadsheet. Despite the software saying all of it went through. Looking at the log, I see the following error : 'Google Sheets Writer: Server reported error code 409 (Conflict) when writing to cell A4 on worksheet 'Notes Pairing'. The worksheet may have been modified outside of FME during this translation'This error repeats 89 more times since FME is attempting to write on 90 cells.Not sure how to proceed at this point.
I have a kml file that is generated by FME that I use as a layer in Google Maps. The auto generated kml file has a lot of kml features/elements that are not required for the display, making the kml file unnecessary bulky. Is there a way to remove such features? I have done this by hand and can confirm that the kml file still displays correctly in Google Maps. I assume that the XML Updater should be used for this, but I have not been able to get the required results. I most probably did something wrong in my implementation with my limited understanding of how it is supposed to be used. Perhaps there is a way to do this with the kml transformers, which I was not able to find. Any inputs on how to resolve this would be much appreciated.As an example, say you have the following (sample) kml file where you would like to remove elements/features.<?xml version="1.0" encoding="UTF-8"?><!-- Generated by FME 2018.0.0.0 (Build 18284) --><kml xmlns:xsd="htt
I'm reading in bunch of dwg files with PathReader, then give those to DWG Reader, outputing through <Generic> port with some exposed attributes. I need to have Path to reader files, but exposed fme_dataset attribute is missing. Is there any workaround?
HelloI am using HttpCallers to populate fields in an ArcSDE database based on values from a Json feed. I have a case where incoming features (lets say feature 1) has two attributes 'References type' and 'References MessageID'."References type" would have values like "Update" or "Cancellation" and References MeesageID will have the ID of an older record that is already in the database (feature 2), and is affected by the new feature (feature 1) and the specifications in 'References Type' So I need to make a call where I after filtering out features that have values in "References Type" column looks in the database to find Feature2.ID = Feature1.References MessageID. And then populates another field in feature 2 ("References") with values from "References type" & "ID" in feature 1.I hope someone can help me how make this in FME preferably using httpCaller.
Hi SafersCan you please take a look at this post, it might be a bug:https://knowledge.safe.com/questions/107806/rename-csv-file-before-reading-in-data.htmlI was able to reproduce the behavior in FME 2019.2.2.0 (20200103 - Build 19817 - WIN64)