Using readers and writers to extract and load data.
Recently active
HelloWhile making INSPIRE gml I get different outcomes from INSPIRE gml writer and an INSPIRE gml feature writer. Is it true or am I doing something wrong with the feature writer settings? I would like to create an INSPIRE gml and then write it to postgres. That is why I wanted to use a feature writer for creating an INSPIRE gml and then connect it to a postgres writer, but it seems INSPIRE gml feature writer does not give a proper outcome. My other solution was to create another workspace and try to use workspace runner and then write the result to postgres, I still have not managed to succeed in this. Below you can see feature writer and writer, both specified by Theme (Energyresourcevector v4.0). You can see the outcomes are different. Why is that?
My FME workspace runs a SQLExecutor which creates an user with provided username and password as attribute:CREATE USER "@Value(username)" WITH PASSWORD '@Value(password)';GRANT @Value(roles) to "@Value(username)";On containing a '#' in the password value, I'm not able to connect to a database through that created user in QGIS. Unfortunately I can't expose the password handed over in pgAdmin to check the password set by FME. After changing the password in pgAdmin to another password containing the '#' as well, the connection works. Therefore I suppose the error to be within the SQL Executor. Does FME encode that character in some way, so that the '#' is stored as other character(s)?
Hi,We are migrating our FME Server to Azure in Q1 or Q2 2020 as part of a organisation wide migration. Is the current recommendation still: 'You can deploy FME Server on Azure by performing a regular install using our available installers (https://www.safe.com/downloads/) on any Azure Virtual Machine that runs a supported operating system and meets the minimum system requirements' https://knowledge.safe.com/questions/77140/deploy-fme-server-to-azure.html @stewart.harper I see that there is a Kubernetes deployment available. Is it still in tech preview? What are the plans for 2020? Is there any change on the upgrade path? 'With regards to the FME Server Kubernetes deployment, for the tech preview, the upgrade path is not yet tested.' We currently run FME Server 2019.0 on a single server installed using the express install and IIS Application Request Routing configured (acceptance/production servers). In terms of the azure server what type of storage is recommended
How do setup DB connection to postgreSQL using private key. I have server IP, user name and RSA key.
Hello all, how do I customize a the balloonstyle so the text displays in this format shown? I want to do this a with the correct kml attributes. What attributes do I need to set? Oh and I also want thedriving directions dialog. Thanks
I am working on a process that archives data from a group of hosted feature layers in ArcGIS Online to a matching group of feature classes and tables in SDE and then deletes the archived data from the hosted feature layers. So far, so good except for one related table (an error log) whose relationship class has the same name. The FME writer fails because, apparently, it's trying to write to the relationship class instead of the table. Renaming the relationship class is a no go because I'm told other things will break if I do. How can I get FME to ignore the relationship class and go straight to the table?
Hi allI have a gml file to need to export any vector format.I used many transformer but not achieved. You can find int the attached gml sample file.Do you have any idea?Thankyou
Hi,I created a workbench to convert an excel files records to point feature class and I need to create a polygon surrounding the point depend on a field in the attribute table, So I used the Hill Accumulator to do this but each time I choose a field in a the group by option I got an error as you can see below.Please note that when I cleared the group by option the workbench is working fine and I got one polygon, so what did I miss in my workbench. Any Ideas to solve this?Cheers,Rawan
Hi, does anyone know a way to limit attributes returned from WFS. I just want to return back the unique id so I can cross check against a clone out the data.This structure works in postman but I dont see a way for it to work in the fme reader. Does something need to be added to the xml filter? http://example.com/geoserver/wfs? service=wfs& version=2.0.0& request=GetFeature& typeNames=namespace:featuretype& featureID=feature& propertyName=attribute1,attribute2 Many Thanks Oliver
Hi all, I am currently attempting to load in 1000 data sets I have in 1000 different tables. I need to do this in Microsoft SQL Server.My data sources are either in Excel or Geodatabases. The plan is to download all the data sources and put them into one location. Once I have done this, I would directly like to set up some workbenches to load the data directly.My question is what would be the most efficient way to create the SQL server tables with the Geometry using FME. Then in the future, these tables will need to be continuously updated with the data. As there are so many columns with each data set, is there a quick and easy way to create the 1000 tables without much manual input.At the moment, I have tried creating the tables individually by writing up SQL Script but is taking a lot of time to create. Any past examples I can base this on or transformers that can speed this would be great. Thank You
I am trying to write out some text to a pdf and I keep recieving the error "Unsupported font family 'Arial'. Reverting to 'Helvetica'. I receive the error regardless of which font I try to use. The Pdfstyler shows all of the fonts installed on my C:\\windows\\fonts folder, but just can't seem to access them when the workbench is running. Also, I don't even have Helvetica installed on my machine. I am using windows 7 and FME 2012. Is there a setting I need to change?
I'm trying to get ground, and vegetation from a set of laz files, but there is no output from the PointCloudLASClassifier transformer. Is there something I'm missing that should go between the reader and classifier?I'm running FME 2019.1.1.0. There aren't any parameters for the transformer, so I'm not sure what other info I can include.
The problem: I am loading conductors from oracle spacial into a file geodatabase (ultimately the output will need to be SDE). The target datasets are all populated with existing data that I am trying to add to. The source conductors are currently split into a few target feature classes by fme; Primary overhead and primary underground for now. I will need to add the secondary overhead, secondary underground, and abandoned as well in the future. This part is working well for the primaries. But I am having a hard time dealing with the relationships. Each esri conductor feature class has a number of relationships.Relationships for primary overhead.In the end I will need to deal will most if not all of the relationships. But for now, I am I just working on the PiOH_ConductorInfo and its partner PiUG_ConductorInfo relationships. This is a one to many relationship and it does not have a relationship table. The primary underground looks much the same but uses a deferent field in the conductor
Anybody have any success copying over a select group of folders using the Directory and File Pathnames to a filecopy transformer? I currently have it set up the same as described in https://knowledge.safe.com/questions/62005/copy-entire-folder-from-a-to-b-destination.html where it successfully copies ALL the folders. (path filter is currently set to *) But I would like to set a regex in the Path Filter to only grab the folders I want.example:I have 9 folders with sporadic numbering/naming and only want folders 01,02,03 & 09.01 – test02 – test03 – test group104 – test group205 – test11 - test12 - test17 - test09 - testI tried 01 - test\\n02 - test\\n . . . but I can't seem to skip to the 09 folder?Any thoughts
Hi, I'm working with the transformer JsonTemplater to create a json file. The source is a list of attributes, for example:_list{0}.Date_list{1}.Date_list{0}.Age_list{1}.Age My Workspace translate with successful with just list of attribute:{ "Attributes" : [ for $value in fme:get-list-attribute(("_list{}.Date") return {"Date" : $value}] }My question: How can I configure to receive more than list of attribute, in this case _list{}.Age ? Thanks
I have an FME process connected to our GIS Portal to clip, reproject and label data for AutoCAD export. The user toggles on layers in the viewer and draws a polygon around area of interest and this is passed in my process to clip features, reproject and label if set to label in process and export a AutoCAD 3D Object Data drawing. I have been trying to resolve issue of blank object data tables for text layers and also creation of object data tables on objects not selected for export but are in my process for labeling and styling purposes.
SummaryThis post (actually it’s not a question) describes how to create SDO_GEOMETRIES when writing features with the Oracle Non-Spatial Writer, by post processing the Oracle table with SQL statements.All functionality is contained in a few simple steps inside a single workspace.This post provides both a procedure to renew an entire table each time the workspace is run, and a procedure to append features to an existing table each time the workspace is run.Finally, this post shows how to spatially enable the table by maintaining a record for the table in USER_SDO_GEOM_METADATA, and by optionally adding a spatial index to the table.I hope this is of use to someone.Preliminary RemarksIn this post the Oracle table is called TEST_GEOM, the GML field is called GML, and the SDO_GEOMETRY field is called GEOMETRY. These names can be changed as required. It is possible to put these names in Private Parameters, and use those parameters wherever a name needs to be provided (except for the field na
I have an IFC file representing a Stormwater network, and it has IFCFLOWSTORAGEDEVICE features representing nodes and IFCBUILDINGELEMENTPROXY features representing pipes.I have been able to pull out all the IFCPROPERTYSINGLEVALUE attributes for the node features thanks to daveatsafe's excellent answer here.However the pipes are a little more challenging as there seems to be some sort of aggregate standing in between the geometry and the attributes, and I can't expose the attributes in the same way. In the IFC file they are represented like this: IFCBUILDINGELEMENTPROXY('1HDtbP71IFCELEMENTASSEMBLY('3xaXAEmy159vLIFCRELAGGREGATES('2U9sLih9H1YhOYOIFCPROPERTYSINGLEVALUE('calculateIFCPROPERTYSINGLEVALUE('calculatewhereas for the nodes it was just straight in to the attributes:IFCFLOWSTORAGEDEVICE('1NHbOsZUIFCPROPERTYSINGLEVALUE('pit idIFCPROPERTYSINGLEVALUE('pit naIFCPROPERTYSINGLEVALUE('pit tyThe IFC file was created with 12D software, and to be h
Hello FME Users,i am using FME Version 2019.0.2.0 WIN 64 bit windows 10 . now days i am facing "FME EXE has stopped working" frequently mostly "WorkspaceRunner" & Workbench itself also facing do any one has solution why this is so
Hi,I am currently trying to find a solution that might save me a bit of time. I have reader which is geodatabase which contains 10 feature classes and the writer as a SQL Server Database.I would like to directly load and create new tables in SQL Server that are identical to the feature classes with the same field types. Here are a couple of screenshots on basic setup but obviously hoping to build on top of it. Can anyone recommend any next steps in regards to this issue or had experience in loading data into an enterprise database?
Hi,I need to know how to read the RGB information for a vector data from Smallworld.
I'm removing duplicates from a File Geodatabase (FGDB) feature class using Sorter then DuplicateFilter, then writing the Unique features back to the same FGDB feature class.I want to write the Duplicate features to a CSV log file with the date/time of the translation in the file name so I have a CSV listing the duplicates removed each time the Workspace is run.First I tried including @Timestamp(^Y^m^d^H^M^S) in the CSV File Name in the Writer but I ended up with multiple CSVs, presumably because features were being written as they were received by the Writer. I haven't noticed this problem with FGDBs but is that because of difference in the way the FGDB Writer works?I then tried a Creator followed by a TimeStamper running parallel to the actual data processing with the output from the TimeStamper going to the CSV Writer along with the data. But what I get is two CSV files - one with no date/time stamp in the name and all the data, and another with the date/time stamp in the n
Hello,I use the standard FME Smallworld reader/writer and/or the SBS-plugin to read and write data from and to Smallworld 4.3. A lot of the read actions take a lot of time, due to the very large quantities of objects in our databases. To make this process a lot more efficient, I want to make use of the 'WHERE Clause'- or 'Where'-function. The idea is, for example, to only read the water mains that belong to the network 'Distributie'.I first searched this site for some info/advice on how to do this correctly. I found some info and a few examples (example: WHERE Clause: [Electricity] cable where Status = "Accepted"). I also consulted the 'SPATIALBIZ Plugin Usage Guide'. In that guide I found one example of a predicate (example: "gis.hotel where type = 'Hotel'; gis.min_road where road_type = 'A-Road'"). Not really knowing which predicate format is the correct one, I tried a few different predicates ("water_supply.w
I'm trying to connect to SharePoint Online with FME 2018.0 & 2018.1 BETA and I'm getting a SAML authentication error. It was previously working, but stopped about 3 weeks ago. My assumption is some change on the 365 tenant, but I can't identify anything that's different. Additionally, despite the error, it's stating response message was: '200'--Microsoft SharePoint List Reader: Error authenticating via SAML. Verify that the username and password are correct, and that this is a SharePoint Online instance. Response message was: '200'This occurs if I open a blank workspace and just add a sharepoint write. I've attempted to run the latest version of both 2018.0 and 2018.1 BETA. All when attempting from FME Desktop.
Hi all,I'm working on an assignemt where I must update positional information on objects stored in Avitech's Wiz@rd. Wiz@rd communicates through AIXM5.1 and I need to write complete AIXM5.1 objects back to be imported into Wiz@rd.I receive a file containig, amongst other things, the UUID for an existing object and updated positional information. I request the existing data from Wiz@rd and receives this as a complete AIXM5.1 object. This is stored in a temporary file and read through FeatureReader to put the data into their correct attributes with which I can work. This seems to work correctly. Then I update the correct attributes with the new positinal information from my source file and write the complete object back using FeatureWriter.My problem is related to the AirportHeliport object. The source AIXM5.1 contains aixm:subCondition group(s) whithin the aixm:usage group. I see these whithin the geometry aggregate after I have read the AIXM5.1 file, but the aixm:subCondition g