Using readers and writers to extract and load data.
Recently active
Hello, This will be similar to my previous question but it is more structured now and I have more examples.I am working on the DGN to cityGML conversion and have issues converting building roof polygons that contain roof superstructures, i.e where there are one or more higher or lower elements going out from the main roof planes – and where some roof polygons are donuts in the input Microstation DGN and need to be donuts in the output cityGML (blue polygons that are donuts in input DGN must to be Donut polygons in the output cityGML).My input is 3D building models in Microstation DGN format that contains correct roof modelling, i.e. correct donut polygons for superstructures. However, while converting the DGN into cityGML in FME I found two issues: (1) DGN reading does not support 3D Donuts, i.e. 3D Grouped Holes and (2) DonutBuilder transformer – does not fully support 3D data, i.e. no option to build Donut polygons from polygons “that are on same surface”.(1) Issue in FME reading DGN
This is my first attempt to simply read from a SQL Server view and write to an existing non-spatial table. The process runs and reports success and 31 records added to destination table but, on checking the destination table, they are not there. Is there a commit of the transaction that's not happening or something?Log reports "Stored 31 feature(s) to FME feature store file `C:\\Users\\gisadmin\\Documents\\FME\\Workspaces\\UpdatePFEditorsTracking_log.ffs'"Is this FFS the only place the records were added?
Hello! I am trying to write from an Oracle database to an Informix (Version 12.10.FC10AEE) database. I was using an AIX server last week and I was able to write the database. My it group spun down that server and we are now using a linux server. I am able to connect but I am having trouble writing anything. If I am using the built in writer (non-spatial) I get the following error: "Error connecting to databaseDatabase Generated Error Information:Database Error Message: [Microsoft][ODBC Driver Manager] Data source name not found and no default driver specifiedDatabase SQL Statement Text: SQL State: IM002Variable Information: IBM Informix Non-Spatial Writer: Failed to connect to database"If I am using JDBC (non-spatial) I get this error: "JDBC Writer: Failed to create table 'GIS.B$PRI_COND_UG_N'. Error: Only a DBA can create, drop, grant, or revoke for another user.JDBC Writer: Table 'GIS.B$PRI_COND_UG_N' does not existCOM.safe.fme.TableDoesntExistExceptio
Hi,I can read the following JSON data from a file using the JSONFeature Reader and then attach a ListExploder to the list attribute named professionals-involved-in-the-discussion{}. This creates a row for each professional in the data. Perfect.However, in reality this JSON is coming from an attribute named json_data (not a file). If I use a JSONFlattener transformer attached to the json_data attribute, I need to manually create the attributes to expose. I have created a professionals-involved-in-the-discussion attribute, but it is not accepeted by the ListExploder?Any help would be appreciated as I guess I am missing something simple.Many thanks. { "outcomes": ["testA"], "party-id": 132956, "start-date": "2017-06-21T12:38:00", "activity-id": 10279532, "assigned-to": 103576, "completed-by": 103576, "created-date": "2017-06-21T12:38:24.937000", "authorised-by": 39583, &q
Error: Invalid content at [11,58]: cvc-datatype-valid.1.2.1: '5da6322c-9e7b-4e35-a604-e931d7f40072' is not a valid value for 'NCName' Error: Invalid content at [11,58]: cvc-attribute.3: The value '5da6322c-9e7b-4e35-a604-e931d7f40072' of attribute 'gml:id' on element 'tran:Road' is not valid with respect to its type, 'ID'Solution: If am editing the gml file line containing gml_id:5da6322c-9e7b-4e35-a604-e931d7f40072 to gml_id: "any_name"_5da6322c-9e7b-4e35-a604-e931d7f40072. Then it is not showing error. Features will be validated and successfully imported.How to rectify this other than editing manually.Please help. Thanks
I have an attribute of a feature called RTN_NOTES. It contains free text stored in an xml structure as below.I need to merge the values of the <Run> element entries in to a single output text attribute(varchar). I have tried to use the XMLFlattener feature, but this seems to only return the contents of the 1st <Run> entry. Any help would be appreciated. Thanks, Michael (FME Newbie)<Section xmlns="http://schemas.microsoft.com/winfx/2006/xaml/presentation"> <Paragraph> <Run FontWeight="Normal" xml:space="preserve">I visited Joe Bloggs to discuss how he feels things are going.</Run> </Paragraph> <Paragraph> <Run FontWeight="Normal" xml:space="preserve">Joe is worried about his situation.</Run> </Paragraph> <Paragraph> <Run FontWeight="Normal" xml:space="preserve">I have suggested a follow up meeting.</Run> </Paragraph></Section>
When I run the statement 'select st_srid(geom) as epsg from my.table' on the psql command prompt, it correctly returns 31468 When I do the same in the SQLExecutor transformer, in returns 0.Doing the same exercise with 'select count(*) as my_counter', the results are identical.What is wrong here? The docs?
I have an application storing PDF's that are uploaded to it in a varbinary field, I would like to reverse this process with FME and extract that data and write the PDF out. So far I haven't been able to get that to work. Any suggestions?
Hi, I am trying to automate a process whereby I download data from my sql server enterprise geodatabase in both spatial and non-spatial format. Currently I have implemented one fme workbench (.fmw) which belongs one ESRI (ArcSDE) reader , which contains all the spatial and non-spatial table list as input parameter, along with I have following published parameters for input: a. Dest_Format (GML, KML, Shape, ESRI-JSON, SQLite, CSV)b. DEST_COORDSYS: DHDN, WGS, Tranverse, ...)c. Email Adress:(for sending the data download link)I am strugling currently with downloading as csv format, and it is creating csv file without column names, and storing also the fme_feature_type information. All the tables downloaded as spatial format is working well. Pelase give me a way thus I can download the csv and other non-spatial format perfectly.Can anyone help me? @takashi Many many thanks.
When im trying to transform citygml data to ogckml, the FME data inspector does not view the data correctly in 3d view. Instead of separate individual 3D buildings, the data is just a long thin "stick". Data looks correct when viewing with google earth and with FME data inspector in 2D view. Why is this happening?Also when trying to convert that kml to wavefront object, the object file comes out as a long stick also.It seems like every kml file containing 3D data is showing up as along thin stick in fme data inspector when viewed in 3d
In every red point I'm trying to create a line, parallel to the blue line. So far I used a linebuilder to create a profile line. Then I created a point at the intersection of the blue line and profile line. Next I would like to know the direction of the blue line at the intersection point. Anyone tips?
INSPIRE GML WriterFME Desktop 2017 1.2.1 build 17725 Sample: GovernmentalServices.xsd > ContactType in BaseTypes2.xsdAre the attributes of feature types that refer to other xsd-files by <element ref =”…”> not resolved as user attributes? For example: GovernmentalService.xsd with <element ref = "base2: Contact" /> on schema BaseTypes2.xsd. The attributes of the ContactType are missing as writer user parameters.
My workflow requires reading .zip files, containing multiple XML’s containing the data I require.The .zip file name is a concatenation of the following information:VariableProcessname1_VariableProcessname2_TransactionID_Date_Variable.zipAt this stage I have only been successful reading in multiple files using the direct file path followed by *.zip to reference all files. However the folders which store the .zip files have thousands of items, and for this particular process I need to only use the .zip files which are of a set date range – ie. the last two days. I have tried (unsuccessfully) the following methods to read the files I need:1. Use the StringConcatenator transformer to create an attribute to insert in file path. I get the following error. 2. Create a user parameter, however again I have only been successful using wildcard as the file name. I am thinking some python code (possibly in conjunction with a file path reader) may be the best solution? If someone is able to provid
I cant open a Version 3 ECW in FME Data Viewer. Error comes up and says I need new version of ECW SDK. I am using Desktop 2016 , and have downloaded the new SDK Version 5.1 from Intergraph. How do I leverage this in FME?
In Oracle, you can assign a default tablespace to an owner (schema). We are moving all our spatial databases to PostGIS where a schema cannot have a default tablespace. Instead you have to specify the tablespace to use with the create table syntax.With FME desktop, how can I specify what tablespace I want all these cloned tables to go into without first somehow creating empty tables myself and then appending to them?
Hi there,I currently use FME to mantain open datasets which are hosted on a Socrata-based platform, utilising FME's Socrata Writer. One of the limitations I've found with this Writer is that it only supports tabular data. I'd like to automate the update of our spatial data, which are published as shapefiles in a compressed .zip format. Are there any pre-existing Workbenches which interact with the Socrata API in such a way that I can automate the upload-replace process with these shapefiles? I believe that Socrata has developed their own DataSync Java application which performs this action, but if I can automate this process within FME it would be preferred.Many thanks!
Hello, I am trying to extract the attributes from Excel to Shape file. I have a large shape with certain attributes, and I would like to join them by some conditions. For example in this case, there are two attributes that are same as the names of the cells in Excel. If those values are the same, I would like to join the rest of attributes. I am trying to do this with feature merger. Xls is supplier and Shape is Requestor in my case, but I am not getting those extra attributes that I want to get. Can somebody please help me with a hint? Best regards, Dejan
I keep getting this when trying to write to an ESRI FGDB: "Unable to remove existing dataset at location `.......' for writer `GEODATABASE_FILE_1'.Any suggestions?
Hello everybody,I have a building in 2d and i use a 3dforcer to create an 3d building (walls collums doors rooms...) but i want to write it to postgis. when i use the datainspector to look at the postgis data i can't see anythingHow can i store the 3d object in postgis?
I am running FME 2018 and attempting to convert a Geotiff into a format that I can load onto my S3 bucket and read using the ArcGIS javascript API. some of the formats in FME i tried to convert to failed with no success. ESRI 3D indexed Layer and cesium 3D tiles.any suggestions? thank you
Hi, I'm looking to set up a FME workbench which will take multiple .dwg files in a specific folder and convert them to individual pdf's. This won't be a one-off process with the idea being to be able to add new .dwg files to the folder and to convert them to pdf as and when required. Can anyone suggest the best way of doing this please? many thanks
I need to update an arcmap sde feature but just one column. I use feature merger to join the data I am planning to use to update the SDE. However, I have found featuremerger to be really hit and miss, often it won't join all the features that should be.The main issue I am having is after feature merger there are 17 features that are joined. I then want to update my SDE (which was also the input) based on the join. It runs successfully but won't update my fields.The workflow looks like thisReader A Reader B featuremerger Attribute manager Writer I need an attribute from reader b to update the writer which is the same feature as reader A
We use a PostgreSQL connection to access our GreenPlum environment to execute a SQL statement to pull non-spatial point data. Normal Query runtime, runs fine.When the tables involved in the SQL are under heavy load, the query slows down a lot. It then NEVER returns anything and will continue to run until we stop it.So, my question is. When we setup connections in FME desktop, is there any way to setup a MAX connection timeout or Query timeout?