Using readers and writers to extract and load data.
Recently active
Hi All, I am having quite the time getting some nested JSON out of an attribute. My current workflow flattens out the original JSON, then fragments out the nested meetings. I then flatten it out again to expose each attribute for each meeting. I get to a point where I now have an attribute "agendaitems" that can have different amounts of items for each meeting. This is where I am having trouble flattening it out from here. The attribute is filled as <missing> but when inspected has the items listed in the attributes as: agendaitems{0}.billagendaitems{0}.descriptionagendaitems{0}.item and so on for however many items are associated to it. Is there anyway to get these to all flatten out?
Using reader MITAB on a file written in 2006 and getting the error "Failed reading coordinate data at offset 0".Sometimes, the error doesn't stop further actions, sometimes it does.Can anyone point out the likely issue?Cheers!
Hi folkswhen i try a translation from DWG to a GIS format, i encounter that message : FATAL |Incompatible visitor version 1 in FMEOrientedArc::acceptGeometryVisitorConst. This release of FME is compatible with versions 6 to 6 I tried many ways to solve it, GeometryValidator, Orientor, but the message still remainsthe DXF file is hudge, so i can't attach to the message ...regards
Hi all I have a workspace that is managing a dynamic migration from one Oracle 11g database to Oracle 12c. The process is quite mature and has mainly be used to truncate and insert new data. We now have to extend this process to create tables if required. The writer connection is a different user (USER1) to then one where the table is being created into (USER2). USER1 has heightened privileges and is used for all maintenance tasks. Grants include 'create any table', among others. We have started to encountered exceptions when attempting to drop/create a table into the destination instance. Using Feature Writer or a writer/Feature Type, when we try to 'drop/create' or 'Create if needed', we get the following exception raised: "Cannot create table 'TABLE_FROM_FW' within schema 'USER2', when logged in user is 'USER1' ".Full log with debug here: I have tested with Oracle Spatial Object and Oracle Non-Spatial writers both withe sam
Hello everyone,I am attempting to copy a select number of files from a given directory and came across the FileCopy writer. After experimenting with it, it appears that it is copying all the files specified in the source directory whereas I would like to specify which ones it copies instead. Can anyone confirm this limitation in the writer? And of course, I would be very happy to hear any ideas and workarounds for this. I am considering using PythonCaller to accomplish this but I would like to avoid this if at all possible.
i have read lots of article about Feature Writer , but i could not get the point ,how can i get my attributes and connect it to excel writer without effect on my output ,it does not matter to show this attributes in excel file output but i want to keep it in excel writer to use it lateri have at the beginning excel file then i converted it to csv then i apply the output on excel file but i missed some attributes that i need to usemost of attribute are missing ,onle my result what i can get ,could i ask,how can i find the rest of Attributes exactly my target ,i want to name excel writer as the field name included attribute but i could not find most of attributes after Featurewriter.FME version 2018.1
I am trying to find a method for reader to link between many sources to one source but i could not find . i have many readers come from the same source when i run my workbench with quick translator ,as result it gives me around 10 sources to select but 8 of them from one source , bcs i have chosen from the beginning individual Feature typesis there a method to refer only to one source files instead of 8 sources . because all of them from the same file
Hi FME gurus,For an engineer I would like to parse OSM XML data with line and polygon features. Although point features are no problem to parse, the geometry from the line and polygon features is not coming correctly along by the OSM XML reader.I can parse the OSM XML by a combination of FME transformers:However this transformation is rather slow due to the number of vertices that have to be parsed.Attached therefore an example of an OSM XML with highways. Is someone able to use the OSM XML reader with some settings, whereby the geometries of the line and polygon features are correctly parsed?
I am using Esri ArcGIS Online(AGOL) feature service to write data from a database. A flag column is to be maintained in database to check whether a feature is successfully written or not, based on that flag column we are further processing those records by another software. How do I get the OBJECTID and GLOBALID of features which are successfully written to AGOL so that I can update the flag ?
Hello Friends,I need an urgent help. Can anyone please help?I am having something like this:and i want to fill down the values something like this in excel:its like a fill down option for sample id and ID till the time it finds a new sample line in text_line data or till the time it finds a blank value in its own column and stop when next row has a value.Also attaching the excel file for your reference.Thanks
While i am trying to extract feature classes from postgres database to esri file geodatabse, i am not able to get the geometries, if i use postgres in the Format dropdown of Reader. After enabling PostGIS on the database i am not able to see any spatial objects in the tables list.. What is the correct process to read postgis enabled postgres database?
Is there any documentation on the best way to install and set-up FME in an AWS Cloud Environment?How is the licence set-up on a dynamic environment?
Hello Everyone,I am trying to write some structured data into an existing table into AZURE. The table is already created but there is no data in the tables. I have set up the connections and have the correct table name so no issue there. Also, the fields I am trying to write match the naming conventions of the AZURE table.As you can see from the screen shot below I have chose insert but I am receiving this error message ( below screenshot) 0.0|ERROR |Microsoft Azure SQL Database Non-Spatial Writer: Failed to create Azure table 'siro_stg.MAD' because no clustered index or primary key was specified. If creating a new table, go into the 'User Attribute' tab and set the 'Index' column to 'clustered', 'clustered_not_null', or 'primary_key' for a columnThe AZURE DB table has no primary key set or indexing. I was told this shouldn't matter as we are treating this as a staging area table.Not sure why this error is appearing as I'm not t
I am currently trying to take data from a specified location on one notes or share points, and out put it to both AWS and as a arc portal feature service. When trying to add the sharpoint or onedrive reader I get the attached error. I think it may be an issue with FME not having access to the OneDrive, Share point and Arc Portal. Any help would be much appreciated Error LogCreating reader for format: Esri ArcGIS Portal Feature ServiceTrying to find a PYTHON plugin for reader named `ARCGISPORTALFEATURES'Loaded Python module `arcgisonlinefeatures' from file `C:\\Program Files\\ArcGIS\\Data Interoperability for ArcGIS Pro\\python\\python37\\arcgisonlinefeatures\\__init__.pyc'Creating reader for format: Esri ArcGIS Portal Feature ServiceTrying to find a PYTHON plugin for reader named `ARCGISPORTALFEATURES'Loaded Python module `arcgisonlinefeatures' from file `C:\\Program Files\\ArcGIS\\Data Interoperability for ArcGIS Pro\\python\\python37\\arcgisonlinefeatures\\__init
Hello, I have a file geodatabase on ArcGIS portal. In need to access it's contents without downloading the file geodatabase. I tried to approach the file geodatabase with the ArcGIS Portal feature service reader but as designed the file geodatabase did not show up as a readable feature class.I am looking for a method to read the contents of the file geodatabase as if I would do normally with the file geodatabase reader. Is it even possible to read from a file geodatabase on ArcGIS portal with FME?Thanks for the help!
Good morningCan someone advise how i do the followingI have 1 excel spreadsheet (data.xlsx) and 1 empty excel spreadsheet (template.xlsc)I want to write the contents of data.xlsx to template.xlsx and output it as result.xlsxHow do i write the map the columns from data.xlsx to the template? It does automatically write correctly, but i would like to know how to specifically write one column to another before i output The contents of the data.xlsx file i've uploaded are only test, but i would like to know how to do this so i can do the task in the future using proper data thanksSimon Hume
Hi Guys,i am wondering of using of Excel styler ,if i select for my excel writer this optionOutput Field Names: No Use Attribute Names As Column Positions: Yes i can see my result only in inspector but it does not exist any excel file ,my folder is empty .so i tried to put my excel writer before excel styler so i can get my excel output in the folder . then i put again my excel writer after excel styler but i changed in parameter of excel writer as try , this option Output Field Names: yes Use Attribute Names As Column Positions: Noi found i can get my output in the folder nd everything is perfect except the first row it has field names ,i want to delete it .So why using this option as No ,i got nothing or if someone know a method to delte the first row so everything will be fine with me
Hello Team,We recently upgraded FME Server 2019, and tried create AD group user it was asking for Search Account Password which i am not very clear about it.Can somebody instruct me how to export AD group users into FME server 2019? Is there any prerequisites to do this activity? What is the process to add AD group user to FME Server.Thanks in advance.
Hi there, I need some food for thoughts to solve the specific problem in FME. I have a transformation in FME that contains attributes like incident_date, Month, a third column which contains either monthly cumulative average wastage value for the current regulatory year or historic (5 years) monthly average wastage value. I have the fourth column which states that whether the monthly average value belongs to the current regulatory year or historic 5 years. Now I want to generate the third type of monthly average wastage value called "forecasted value" in such a way that if current month is less than the end month of the current regulatory year, for instance, Today the month is February and end month of current regulatory year is March, then FME get the historic 5 years value of March and add it in the remaining value of current-year average wastage value and labeled it as "forecasted value" in the fourth column. To be honest, I am stuck and don't know how to imp
I work for the US Archives and we need to convert DWG into a format like GML or Shape. However, we have lost text, legend information and other items.Any ideas?Thanks, Brett
Hello I am getting this error when I try to connect to ArcGIS online feature reader.Can anyone help with this?ThanksNikkiError: Connect to www.arcgis.com:443 [www.arcgis.com/18.234.22.25, www.arcgis.com/54.236.87.106, www.arcgis.com/18.234.22.29] failed: Connection refused: connectError: Connect to www.arcgis.com:443 [www.arcgis.com/18.234.22.25, www.arcgis.com/54.236.87.106, www.arcgis.com/18.234.22.29] failed: Connection refused: connectError: COM.safe.fmewebservices.FMEWebServiceException: Connect to www.arcgis.com:443 [www.arcgis.com/18.234.22.25, www.arcgis.com/54.236.87.106, www.arcgis.com/18.234.22.29] failed: Connection refused: connect at COM.safe.fmewebservices.FMEHttpUtils.post(FMEHttpUtils.java:162)
Hello: I'm experiencing very slow read speeds from one (1) Access database table that only has approx. 114K records in it. This is also a local copy of the database (.mdb) file (did so to rule out network latency). Is there some trick to increase the read speed for Access?
Through the ArcGIS Pro ArcPy, I have used the "ExportXMLWorkspaceDocument_management" method to loop through multiple geodatabases and export the metadata of individual feature classes. now I would like to transform those into more readable excel files. The xml files are structured according to ISO19139 standard. Any tip would be appreciated, even an entirely different workflow.
My target ESRI File Geodatabase (FGDB) is following UPDM 2019 data model. By that, we have few feature classes which contain many subtypes. Many feature class attributes have defined default values on the level of the FCL subtype (AssetGroup) usually in combination with domain.What I noted is that default value of the attributes not contained in the FGDB writer is not populated in the target FCL. We have huge number of attributes on the FCL level and it would be quite some work to pick up each default value and set it up in the writer. Maintaining such workbench would be also quite demanding.Can someone please tell me is it possible to get somehow the default value of the attribute automatically populated in the FGDB like when manual editing in ArcGIS Pro? I am using FME 2019.2 with ArcGIS Pro 2.4.Thanks in advance,Dušan
Is there a way to get the Modified By username/name from One Drive?