Using readers and writers to extract and load data.
Recently active
I have recently just discovered this software and it seems like a really powerful utility. What I would like to do is take a kmz file of building geometry that has been verified in Google Earth and convert the file into a meshable file type such as an stl. Is this possible? I see from the data inspector that all of the points necessary to define each building exist in LLA format and data sets are defined as boundaries and polygons so I'm inclined to think it's possible, I just can't get it to work. I've also noticed that kml/kmz files can't be inspected in 3D which I believe is a manifestation of my issue. Any help is greatly appreciated! I've attached a screenshot from the data inspector in 2D and 3D as well as one from Google Earth
HI All, Has anybody tried using FME to write to the MilSoft STD format?The format is not in the formats list on the Safe website.Maybe somebody created a work-around for the format.Any help is highly appreciated. Thanks,Erik
Hi,I'm working on Smallworld for the first time. I observed that understanding of Small world readers are not like other readers. It has a unique feature of adding readers based on status i.e. existing, abandoned, etc but reads all the data when we add existing or abandoned reader. I do not understand this logic. Why Smallworld reader is reading all the data every time when we placed only existing/abandoned reader...?In my case pole_exi table has 1lakh records and pole_aba have 9 records as well as there is another reader with name pole which has 25k feature.1. Why it has so many readers when it is reading all 125009 features every time2. Is there any settings we have to change or it is not in our control3. Even if we pass "10" in "max features to read", surprisingly, it reads all 125009 and pass 10 features out :) by which it is even more wasting the time while testing.Can we any one help me... Thank you in advance
I've got a bunch of input files that are stored in sub-directories, I use a path and directory reader to grab these and send them into a workspace runner. A bunch of things take place and then I want to write them all out to 2 layers within a gdb. So dozens of files being brought together to 2 central layers (point, polyline).That's all fine...when I don't run the child workspaces concurrently. I of course get layer locks if I run multiple processes.Ideally I'd like to run multiple processes and have each feature inserted/appended to the table.Any suggestions on how to get around this gdb locking? I'm happy to go out to another spatial db format, that I can later update.
Hi I am reading a json file. Here is one I am reading now: https://outages.electra.co.nz/api/weboutageviewer/get_live_data?Start=&End=&Duration=0&CustomerResponsible=false&Historical=false&_=1564371572592What I want to know is how do I create a reader that can update dynamically if the number at the end changes ie.1564371572592 will not stay constant and this will change.
Hi,I can't seem to find anywhere the sql syntax for performing a geometry filter in the where clause of the File Geodatabase - (Esri Geodatabase (File Geodb Open API) Reader). I would like to only read in geometry of a certain min x, min x, max y and max y bounding.Also, is using the 'where' clause for this the quickest way of filtering a File Geodatabase? I have millions of records so need to optimize the filtering.I am using FME2017.1Thank you in advance.
Hello - in FME Workbench 2018.1 I am adding 2 KML Readers (a point file and a polygon file) to a workspace, and just want to combine them into one KML Writer containing the points, polygons and user attributes. When I inspect the reader I can see the attribute table with all the user attributes, but when I inspect the writer there is no attribute table. The only transformer I have is KMLPropertySetter, and Include Attribute Table has "Yes" selected. What do I need to do to include the user attribute table in my resulting KML file?Thank you
Hello,I have a fairly messy IFC where I need to extract all geometry traits (Pset.Attribute) and I ran into an issue. Not sure what to do here...I'm using the GeometryPropertyExtractor to get all "Pset.Attribute" values and it gives me this:They are supposed to be the same "Pset.Attribute" (by name), but the GeometryPropertyExtractor decided to give one of them a "{0}".I think what's happening is, for some reason one of the Psets has a different ID, so technically it's correct, just not what I want? Maybe?I guess I can remove all "{0}" with the BulkAttributeRenamer and hope for the best? Or is there a way to force the GeometryPropertyExtractor to use the Pset name instead of the id?Or is there a different reason?
Hi,i have two tables, one containing a code list and the meaning of each code:Code Meaning 500 Grass 501 Tree 502 Street The other table, coming from the land survey team, contains the coordinates and the code of the point.X Y Code 51XXXXX1 9XXXXXXX1 501 51XXXXX2 9XXXXXXX2 500 51XXXXX3 9XXXXXXX3 500 I want the meaning of each code in this table is added in a new column:X Y Code Meaning 51XXXXX1 9XXXXXXX1 501 Tree 51XXXXX2 9XXXXXXX2 500 Grass 51XXXXX3 9XXXXXXX3 500 Grass I m new to FME, usually i would do this with a script, e.g. in QGIS. My FeatureMerge options so far look like:Any hints are welcome!Thank you!
I have updated to FME 2016 and have had a few glitches. The recent one is using a KML reader which errors when starting with the following message. |FATAL |KML: Cannot open dataset `E:\\... data\\**\\*.kmz'|FATAL |KML: Error initializing readerAny ideas what the cause could be and how to fix it.
I have a PDF file like this: No.productleaderPartnerStatus1xxxcompany O5Parner1 (5%), Parner5 (80%) Parner67 (15%)ok2yyycompany 08Parner A (50%) Parner B (25%), Parner C (25%)ok3zzzcompany07Parner I (50%) Parner II (50%)ok4bbbcompany10Parner k (100%)ok And I need to have an excell file like : No.ProductLeaderPartner%Status1xxxCompany 05Parner15%ok1xxxCompany 05Parner580%ok1xxxCompany 05Parner6715%ok2yyyCompany 08Parner A50%ok2yyyCompany 08parner B25%ok2yyyCompany 08Parner C25%ok3zzzCompany 07Parner I50%ok3zzzCompany 07Parner II50%ok4bbbcompany10Parner k100%ok
Hello,my first problem: Writing a GeoJSON in the right order. Simple example:I want a output in the order A,B,C (like I set it in the writer). But the GeoJSON file is A,C,B, because the first row in B is empty. Second Problem: When the B column is empty. Only A and C is written. How can I get an empty column in the writer? Thanks for your feedback!
Hi @mark2atsafe @andreaatsafe, I am using FME 2018.1.1.1 Build 18578.I am trying to connect to a Microsoft SharePoint list via SAML since it is a SharePoint Online instance, but am getting the following error message. It is message type '200' which apparently indicates success, but this doesn't seem to be the case here...Creating reader for format: Microsoft SharePoint List Trying to find a PYTHON plugin for reader named `SHAREPOINT'Loaded Python module `sharepoint' from file `C:\\Program Files\\FME_Desktop_2018.1.1.1\\plugins/python27\\sharepoint\\__init__.pyc'Creating reader for format: Microsoft SharePoint ListTrying to find a PYTHON plugin for reader named `SHAREPOINT'Loaded Python module `sharepoint' from file `C:\\Program Files\\FME_Desktop_2018.1.1.1\\plugins/python27\\sharepoint\\__init__.pyc'Microsoft SharePoint List Reader: Items Per Request format parameter is set to '5000'Microsoft SharePoint List Reader: Logging into xxxxx as 
Hi,In my Postgres database there is one field created directly in database called 'code'.This field is auto increment.How I inform to FME that this field exist and none value can be recorded by FME.I tried record my data without this filed in FME but the ERROR was showed for me.thank´s
Let me start off by saying I'm very new to FME. I'm trying to transform data from Excel to KML and I want the output in KML to create a folder hierarchy using some of the attributes from the data.Each record in my spreadsheet has some of the following information. Here is a small sample:DECADE: 1940sYEAR: 1946FLIGHT: 1IMAGE: 1-1-1.tif What I want to do is use this data to create the folder hierarchy in the KML file.Example of end folders in the KML:Top level=1940s (DECADE)with sub of 1946 (YEAR)with sub of 1 (FLIGHT)then my feature of 1-1-1.tif (IMAGE)How would I best accomplish this??
I have an issue with the coordinate system of the IFC geometries.I have to extract the reference point from IFC, that is referenced by in IFCSite.The element is IFCLOCALPLACEMENT that references the IFCAXIS2PLACEMENT3D that referencesIFCCARTESIANPOINT that has the coordinates which I need. The problem in FME is, that these coordinates are used to define the transformation matrix forall geometries, but I cannot access these coordinates directly.The similar issue was discussed in:https://knowledge.safe.com/questions/4813/extracting-transformation-matrix.htmlBut the solution is far from elegant Is there any way to obtain the IFC reference point coordinates? Thanks in advance for any help!
Hello,I have a question regarding the conversion of .las files into Cesium3Dtiles with FME2017. The goal is to convert .las files (EPSG: 31256) into Cesium3Dtiles (EPSG:4326) including an offset of z = 156.68 m. Furthermore, the bounding volume type of the Cesium3Dtiles should be given as a bounding region (six numbers) with coordinates in degree instead of a bounding box (12 coordinates) in radians. Converting the .las file into the cesium3Dtiles with the mentioned reprojection doesn`t seem to be the problem. However. I do not know how to convert the output, which automatically creates a bounding box with coordinates in degrees, into a bounding region in radians.
I am extracting data from a dB and writing it to a gml file with the GML writer.I am also writing the xsd schema.In my data, some dates are empty, and this is normal. However, in the XSD file writen by FME the dates are not nullable. The type of error I am getting is:_xml_error{5}.desc (string): invalid date value ''I am wondering if I am doing something wrong or if there is a problem with the xsd writter?
Hi,I've been trying to put together a workbench to take features from a WFS and populate them to an SDE. Initially, the workspace seemed to generate without error. However various XML errors (covered in other questions) meant I changed the parameters to 'Ignore Application Schema' and use 'GML Feature Elements = ##any'. This seems to have worked for some imports. However now I am encountering further errors which seem to centre around issues with the schema.Trying to run operations on various other feature layers gives the error <ows:Exception exceptionCode="NoApplicableCode=">I am unable to repeat the operation of adding the same WFS reader to a new workspace with the same parameters previously usedIf I change the parameters to Ignore Application Schema as mentioned above, I lose the order of my feature attributes, and the reader also fails to map any empty columnsSo I'd like to avoid ignoring the application schema if possible as this seems a w
Hello I have a workspace that uses a FeatureWriter to output a series of images that are then used in a validation report.In the workspace the images are being stored on my local drive. How do I get the images to be created / stored on the Cloud Server?
While parsing an INSPIRE gml via the FME 2019.0 INSPIRE GML reader,i get the following error for one of the features:xml-geometry-ref Geometry Builder: unable to adopt the below geometry because construction for its own geometry has already been finalizedStoring feature(s) to FME feature store file `C:\IMKL to DGN v2.3 - 2019 - test_log.ffs'+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Feature Type: `'Attribute(string): `fme_geometry' has value `fme_line'Attribute(string): `fme_type' has value `fme_line'Coordinate System: `'Geometry Type: IFMELineName(UTF-16LE): `net4_centrelineGeometry'Number of Geometry Traits: 1GeometryTrait(encoded: UTF-16LE): `gml_id' has value `id-03d59852-793e-4725-b313-bd8840b1949f-0'Number of Coordinates: 10 -- Coordinate Dimension: 2(158575.379167511,211074.867855639)(158588.771742026,211098.641083634)(158597.934106561,211114.905244107)(158599.225499418,211118.054957503)(158612.218427047,211140.966125445)(158625.409716029,211171.
Using BinaryDecoder; Error: "BinaryDecoder (TextEncoderFactory): Invalid Base64 character 'ÿ'" Any suggestions? What to de instead? (using FME 2018 and 2019.2 beta) Thanks for any help, Marion
I am using the MS_ACCESS_JDBC in FME Workbench to read an access database. One of the tables contains a "long binary data" field (blob) that I want to obtain the shape from. Then I try to write this field to a shapefile using the Esri Shapefile writer without success. I have tried using the Geometry extractor testing all types of Geometry Encoding. But this doesn't provide me with any geometry. Also, the reader specifies "oleobject" as type of this field (I can't change the field type from oleobject to blob)...not sure if this might be the problem. Any help would be appreciated. Thanks!
We are attempting to migrate a set of syncing scripts from FME version 2014 to the latest FME version 2019 at the customer's premises. In one of the first steps, FME is stopping with the message: MSSQL_SPATIAL reader: An unknown exception occurred (log in attachment ). In 32 bit version, FME Desktop goes out of memory, while using 64 bit version, the memory usage is high, but apparently still workable.
We are trying to get our FME Desktop Smallworld edition software up and working. When we do it on a 32bit Windows system, we are able to use the reader. But when we use it on a 64bit Windows system, we get the following error...Creating reader for format: Smallworld 4/5 Trying to find a BUILTIN plugin for reader named `SWORLDSWAF' Trying to find a DYNAMIC plugin for reader named `SWORLDSWAF' This FME edition does not recognize the `SWORLDSWAF' reader. Please ensure that the current platform supports this reader, the reader name is spelled correctly, and that you have installed all required plug-insInformatio such as the Smallworld SWAF Quick Facts state 32bit Windows as a requirement. 32bit Windows is getting hard to come by these days. Is it really a requirement or is there just some additional configuration required to make it work? Maybe something is looking in Program Files instead of Program Files (x86).