Data

The problem: I am loading conductors from oracle spacial into a file geodatabase (ultimately the output will need to be SDE). The target datasets are all populated with existing data that I am trying to add to. The source conductors are currently split into a few target feature classes by fme; Primary overhead and primary underground for now. I will need to add the secondary overhead, secondary underground, and abandoned as well in the future. This part is working well for the primaries. But I am having a hard time dealing with the relationships. Each esri conductor feature class has a number of relationships.Relationships for primary overhead.In the end I will need to deal will most if not all of the relationships. But for now, I am I just working on the PiOH_ConductorInfo and its partner PiUG_ConductorInfo relationships. This is a one to many relationship and it does not have a relationship table. The primary underground looks much the same but uses a deferent field in the conductor

Anybody have any success copying over a select group of folders using the Directory and File Pathnames to a filecopy transformer? I currently have it set up the same as described in https://knowledge.safe.com/questions/62005/copy-entire-folder-from-a-to-b-destination.html where it successfully copies ALL the folders. (path filter is currently set to *) But I would like to set a regex in the Path Filter to only grab the folders I want.example:I have 9 folders with sporadic numbering/naming and only want folders 01,02,03 & 09.01 – test02 – test03 – test group104 – test group205 – test11 - test12 - test17 - test09 - testI tried 01 - test\\n02 - test\\n . . . but I can't seem to skip to the 09 folder?Any thoughts  

Hi, I'm working with the transformer JsonTemplater to create a json file. The source is a list of attributes, for example:_list{0}.Date_list{1}.Date_list{0}.Age_list{1}.Age My Workspace translate with successful with just list of attribute:{           "Attributes" : [        for $value in fme:get-list-attribute(("_list{}.Date")            return {"Date" : $value}] }My question: How can I configure to receive more than list of attribute, in this case _list{}.Age ?  Thanks

I have an FME process connected to our GIS Portal to clip, reproject and label data for AutoCAD export. The user toggles on layers in the viewer and draws a polygon around area of interest and this is passed in my process to clip features, reproject and label if set to label in process and export a AutoCAD 3D Object Data drawing. I have been trying to resolve issue of blank object data tables for text layers and also creation of object data tables on objects not selected for export but are in my process for labeling and styling purposes.

SummaryThis post (actually it’s not a question) describes how to create SDO_GEOMETRIES when writing features with the Oracle Non-Spatial Writer, by post processing the Oracle table with SQL statements.All functionality is contained in a few simple steps inside a single workspace.This post provides both a procedure to renew an entire table each time the workspace is run, and a procedure to append features to an existing table each time the workspace is run.Finally, this post shows how to spatially enable the table by maintaining a record for the table in USER_SDO_GEOM_METADATA, and by optionally adding a spatial index to the table.I hope this is of use to someone.Preliminary RemarksIn this post the Oracle table is called TEST_GEOM, the GML field is called GML, and the SDO_GEOMETRY field is called GEOMETRY. These names can be changed as required. It is possible to put these names in Private Parameters, and use those parameters wherever a name needs to be provided (except for the field na

I have an IFC file representing a Stormwater network, and it has IFCFLOWSTORAGEDEVICE features representing nodes and IFCBUILDINGELEMENTPROXY features representing pipes.I have been able to pull out all the IFCPROPERTYSINGLEVALUE attributes for the node features thanks to daveatsafe's excellent answer here.However the pipes are a little more challenging as there seems to be some sort of aggregate standing in between the geometry and the attributes, and I can't expose the attributes in the same way. In the IFC file they are represented like this: IFCBUILDINGELEMENTPROXY('1HDtbP71IFCELEMENTASSEMBLY('3xaXAEmy159vLIFCRELAGGREGATES('2U9sLih9H1YhOYOIFCPROPERTYSINGLEVALUE('calculateIFCPROPERTYSINGLEVALUE('calculatewhereas for the nodes it was just straight in to the attributes:IFCFLOWSTORAGEDEVICE('1NHbOsZUIFCPROPERTYSINGLEVALUE('pit idIFCPROPERTYSINGLEVALUE('pit naIFCPROPERTYSINGLEVALUE('pit tyThe IFC file was created with 12D software, and to be h

Hello FME Users,i am using FME Version 2019.0.2.0 WIN 64 bit windows 10 . now days i am facing "FME EXE has stopped working" frequently mostly "WorkspaceRunner" & Workbench itself also facing do any one has solution why this is so    

Hi,I am currently trying to find a solution that might save me a bit of time. I have reader which is geodatabase which contains 10 feature classes and the writer as a SQL Server Database.I would like to directly load and create new tables in SQL Server that are identical to the feature classes with the same field types.  Here are a couple of screenshots on basic setup but obviously hoping to build on top of it. Can anyone recommend any next steps in regards to this issue or had experience in loading data into an enterprise database? 

Hi,I need to know how to read the RGB information for a vector data from Smallworld.

I'm removing duplicates from a File Geodatabase (FGDB) feature class using Sorter then DuplicateFilter, then writing the Unique features back to the same FGDB feature class.I want to write the Duplicate features to a CSV log file with the date/time of the translation in the file name so I have a CSV listing the duplicates removed each time the Workspace is run.First I tried including @Timestamp(^Y^m^d^H^M^S) in the CSV File Name in the Writer but I ended up with multiple CSVs, presumably because features were being written as they were received by the Writer. I haven't noticed this problem with FGDBs but is that because of difference in the way the FGDB Writer works?I then tried a Creator followed by a TimeStamper running parallel to the actual data processing with the output from the TimeStamper going to the CSV Writer along with the data. But what I get is two CSV files - one with no date/time stamp in the name and all the data, and another with the date/time stamp in the n

Hello,I use the standard FME Smallworld reader/writer and/or the SBS-plugin to read and write data from and to Smallworld 4.3. A lot of the read actions take a lot of time, due to the very large quantities of objects in our databases.  To make this process a lot more efficient, I want to make use of the 'WHERE Clause'- or 'Where'-function. The idea is, for example, to only read the water mains that belong to the network 'Distributie'.I first searched this site for some info/advice on how to do this correctly. I found some info and a few examples (example: WHERE Clause: [Electricity] cable where Status = "Accepted"). I also consulted the 'SPATIALBIZ Plugin Usage Guide'. In that guide I found one example of a predicate (example: "gis.hotel where type = 'Hotel'; gis.min_road where road_type = 'A-Road'"). Not really knowing which predicate format is the correct one, I tried a few different predicates ("water_supply.w

I'm trying to connect to SharePoint Online with FME 2018.0 & 2018.1 BETA and I'm getting a SAML authentication error.  It was previously working, but stopped about 3 weeks ago. My assumption is some change on the 365 tenant, but I can't identify anything that's different.  Additionally, despite the error, it's stating response message was: '200'--Microsoft SharePoint List Reader: Error authenticating via SAML. Verify that the username and password are correct, and that this is a SharePoint Online instance. Response message was: '200'This occurs if I open a blank workspace and just add a sharepoint write. I've attempted to run the latest version of both 2018.0 and 2018.1 BETA. All when attempting from FME Desktop.

Hi all,I'm working on an assignemt where I must update positional information on objects stored in Avitech's Wiz@rd. Wiz@rd communicates through AIXM5.1 and I need to write complete AIXM5.1 objects back to be imported into Wiz@rd.I receive a file containig, amongst other things, the UUID for an existing object and updated positional information. I request the existing data from Wiz@rd and receives this as a complete AIXM5.1 object. This is stored in a temporary file and read through FeatureReader to put the data into their correct attributes with which I can work. This seems to work correctly. Then I update the correct attributes with the new positinal information from my source file and write the complete object back using FeatureWriter.My problem is related to the AirportHeliport object. The source AIXM5.1 contains aixm:subCondition group(s) whithin the aixm:usage group. I see these whithin the geometry aggregate after I have read the AIXM5.1 file, but the aixm:subCondition g

I have a large, relatively complex workspace that performs a few tasks - loads data, validates bearings, distances, areas, creates subsets of the data and then creates a number of reports, PDF, HTML and XML)The PostGIS database is located externally on a separate hosted server.On my laptop the workspace takes less than 2 minutes to complete. My laptop is a pretty stock standard HP, Windows 64 Bit with 8GB RAM.I have published to FME Server Cloud and had a starter configuration established with 2 virtual cores and 4GB RAM. This configuration caused the server to melt down and the jobs just kept failing with no specific errors. I upgraded to the standard configuration with 2 virtual cores and 8GB RAM. The workspace failed after about 30 minutes and what appeared to be multiple cycles of attempting to run but still no errors in the log.Below is the memory monitoring. The job was started at 8:06, memory peaked a couple of times and then finally failed at 8:36What I am seeking is some advic

I know about the feature service in FME to create and update Feature services in ArcGIS Online, but I want to create (copy to, host), for example a Word file, in ArcGIS Online. https://doc.arcgis.com/en/arcgis-online/reference/supported-items.htm   

I have a number of tables in Oracle Spatial that need to be synced from Smallworld. The tables contain multiple geometry columns. We have a requirement for a nightly job that updates the ~80 tables, and are passing in only records that have been updated over the course of the day. In some cases there may be null geometries for some of the features (ex. in one of the two geometry columns), depending on the data changes. When using Feature Operation: Update and Table Handling: Use Existing, the translation fails with the error that one of the geometries cannot be found in the current feature: "Spatial Column 'FIBER_OPTIC_LOCATION' of type 'geometry' cannot be found in current feature."Is this the expected behaviour for performing updates to Oracle Spatial DBs with multiple geometries? Is there a way to get around this to update records that may contain multiple geometries?When inserting records and truncating the existing table, the translation completes succes

As far as I can see, SharePoint writer currently only supports Custom / Generic Lists. Are there any plans for adding the possibility to write a SharePoint calendar? Thanks in advance!

Hello all,I am seeking help to configure the JSON reader, which I am not familiar with.The JSON file is not a GeoJSON, (despite containing coordinates). Only the JSON (JavaScript Object Notation) Reader recognises it.There are two arrays containing objects. custom_markers and markers "custom_markers": [ { "rating": 3, "gallons": 0, "marker_type": "Other", "mileage": 0, "longitude": "152.690125", "latitude": "-27.976959", "price": 0, "date": "1563341193.242588", "pin_color_blue": 1, "pin_color_red": 0, "marker_description": "", "pin_color_green": 0.5019607843137255, "name": "Stop 1 " },there are about 17 custom markers and these should be rendered as point objects "markers": [ { "longitude":

I have a workspace (2018.1) that read a ArcSDE feature class into a Geojson file and then read the Geojson into MongoDB. The Geojson writer works fine in writing, but always gives an error at the end of writing regardless of the geometry type or the size of the feature class:-------------------------------------------------------------------------------------------------------Opening the GEOJSON reader with source dataset 'W:\\gis_data_admin\\Admin\\AllenG\\FME\\MongoDB\\Geojson\\IHS_INT.json'A JSON syntax error was found at line 1, column 0The JSON data is incomplete: Unexpectedly encountered the end of JSON dataA JSON syntax error was found at line 1, column 0The data does not contain any JSON text-------------------------------------------------------------------------------------------------------If I change the reader to shape files, then I don't have the above problem. So the problem seems to be related to ArcSDE feature class. On the other hand, the Geojson reader

Hello there.I'm having trouble with an Excel writer.Where the value being read in FME is completely numeric, the data value is output with an additional '.0' suffix. I've tried changing attribute data types to auto or string, and I tried choosing 'Treat as Text @' from the attribute formatting/'Edit...' button in the writer - no luck.Example...I've got the following values being written to an attribute in an Excel writer...TEST VALUE HERE 12341234567ABC1234And it is outputting the following values to Excel...TEST VALUE HERE 12341234567.0ABC1234I don't want the ".0" attached to the end of values that are fully numeric, rather I want all of the values in the attribute to be treated as a string.Perhaps this is just an issue with Excel itself. When I look at the cells with these particular values, Excel gives me a warning box that shows 'Value stored as text'; when I choose 'Convert to number' the formatting appears as expec

Hello, I just moved to fme 2019 and in this example I'm using workbench  FME(R) 2019.0.1.0 (20190506 - Build 19253 - WIN64)  I have very simple workspace: creator -> featurereader (postgis) -> gml writer   When I run it I don't even get to the breakpoint. On reader there is log:   2019-07-18 21:46:06|   7.6|  7.1|FATAL |POSTGIS reader: An error occurred. FME will attempt to provide more information on the error, but this may cause the translation to be terminated2019-07-18 21:46:06|   7.6|  0.0|INFORM|Successfully closed POSTGIS database reader2019-07-18 21:46:06|   7.7|  0.1|INFORM|Successfully closed POSTGIS database reader2019-07-18 21:46:06|   7.7|  0.0|FATAL |POSTGIS reader: stk::ex::bad_expected_access   I discovered that problem is with one row. In column of type:timestamp with time zone  value is:-infinityIn version fme 2016 I don't have that problem. I executed that workspace with fme 2016 and 2019 and here I can see the difference in fme postgis reader version:   I did 

I'm experiencing an issue writing into file geodatabases using the FILEGDB writer. The issue occurs when eitherThe geodatabase has been created by ArcGIS Pro, orAn existing geodatabase has had a feature class pasted using Pro, thenTrying to create, or drop and create, a feature classAs with many things the problem is not always consistently apparent, but occurs much more frequently than not.The issue shows itself by either not being able to drop and create an existing feature class, or by not being able to write a new one. Instead, a non spatial table is created with the schema, but no data. Deleting this sometimes seems to leave behind ghost feature classes that appear if the geodatabase is repaired, or if a feature class is pasted in that has the same name.Using the GEODATABASE_FILE writer appears to be fine (but not an option for us when publishing to FME Server), and truncating and inserting into feature classes also appears to be fine (with the FILEGDB writer).I'm using de

When I post a new question on this forum, the attachment button does not work. Clicking on the button does nothing. When I hover over it, my cursor becomes a hand symbol.I would like it to work, as sometimes I need to attach a file to clarify my question.

Greetings.I am trying to export a Sqllite (geopackage) to SQL Server.Keep getting an error despite changing the options.Reader: Writer: Error:Transactions are being used by the Geodatabase WriterAn error occurred while attempting to open the table, feature class or relationship class 'main.airports'. The error number from ArcObjects is: '-2147467263'. The error message from ArcObjects is: {}An error occurred while attempting to open the table, feature class or relationship class 'main.airports'. The error number from ArcObjects is: '-2147467263'. The error message from ArcObjects is: {}A fatal error has occurred. Check the logfile above for detailsA fatal error has occurred. Check the logfile above for detailsStored 1 feature(s) to FME feature store file `C:\\Users\\User\\AppData\\Local\\Temp\\wb-cache-geopackage2mssql_spatial-NJVZFF\\Main_airports -1 10 -1 0 89fdbd78da335154a0ddf39d89823152eee47e98.ffsupdating' Any suggestions?? Thanks,Clive

I'm trying to take an RGB raster and convert it to Gray+Alpha. I do the following:Use RasterExpressionEvaluator to calculate linear luminance from the three RGB bands into a single band with interpretation Gray8Use RasterBandAdder to add a band with interpretation Alpha8Using RasterBandPropertyExtractor and Inspector in the workspace, I see that the result have two bands with the correct interpretations. However, once the result is written using the ECW writer, all GIS tools agree that the two bands in the file does not have an interpretation (I have checked the file with QGIS and FME Data Inspector and the bands come up as "Undefined" or "UInt8).I tried swapping the ECW writer for a GeoTIFF writer and in this case the file came out with correct band interpretations. Is this a bug in the ECW writer or is there another way to set the interpretation?