Using readers and writers to extract and load data.
Recently active
Hi, i'm trying to define and write IfcShapeRepresentation properties (attributes) like the RepresentationType and RepresentationIdentifier for geometries (2D points) in IfcBuildingElementProxy (class) , but unfortunately without success.So how to define and write a 2d point in IfcBuildingElementProxy classe? According the IFC definitioin (link below) i have to define the RepresentationType as "GeometricSet" and the RepresentationIdentifier as "FootPrint" for defining a 2D pointhttps://standards.buildingsmart.org/IFC/RELEASE/IFC2x3/FINAL/HTML/ifcproductextension/lexical/ifcbuildingelementproxy.htm By following your "AutoCAD to IFC Conversion Example" Tutorial i have to set the geometry name to "FootPrint" (what defines the RepresentationIdentifier) with the GeometryPropertySetter-Transformer. (see workspace below)Now, how to set the RepresentationType as "GeometricSet"? (A "normal" point geometry like fme_point do not
Hi Folks, I’m trying to download images from Google Drive and convert these images to point and add the photos as attachment to the extracted points.I’ve created the relationship class in ArcCatalog and I could have the points and the attachment table when I disabled the Relationship writer. But when I enable it I got the following error “ERROR |Failed to retrieve origin row for a relationship feature with OBJECTID '226' from table/feature class 'ARSiteVision_Images'”I’m not sure what I missed here, I followed the instruction in this link but with no luck. I attached the FME Workbench if this is could be helpful. Ps: I have only 224 images so I would have 224 points so I’m not sure from where 226 come! Thanks,Rawan
There's been several topics on reading Civil 3D Property Sets on the FME forum, and according to the release notes for FME 2019.1 support seems to have been silently added: -------------------------- FME 2019.1 b19527 20190309 --------------------------Civil 3D: Added read support for property sets [FMEENGINE-10155]-------------------------- FME 2019.1 b19540 20190327 --------------------------Civil3D: Read property sets from CAD entities as well as Civil entities [FMEENGINE-10155] However I'm having trouble in getting it to work in a reliable manner and there doesn't seem to be any documentation of the extent of the support.Above are some of the attributes from our Property Sets. NV-Corridor are automatically assigned by Naviate and all of the information from that plugin works fine. BIP are attributes that we define ourselves with Property Sets. The ones that showup in the Property list in FME and that I'm able to read in the workspace seem to be limited to plain text Properties in t
Hello, I created a FGDB that has a Feature Class, Relationship Class and Related Table. I used this url https://knowledge.safe.com/articles/28340/working-with-geodatabase-relationship-classes-atta.html) as a reference to set up the FME workspace to write data to the feature class and related table. What is interesting is that it writes without errors if I only write to the feature class and related table. If I try to also write to the relationship class writer, then I get this message. "Failed to retrieve origin row for a relationship feature with OBJECTID '1' from table/feature class" This makes me wonder if in this situation I don't need to write to the relationship class. If I do, hopefully someone can provide an answer as to why I am getting this error.Kind Regards,Laura
Hi,I want to transfrom shapefiles into dwg-files. Therefore I tryed this tutorial:https://knowledge.safe.com/articles/18703/how-to-convert-shp-to-dwg-esri-shapefile-to-autoca.htmlBut I have a problem. If I want to transform polygon shapefiles, I always get more objects in the dwg file, then the original dataset had. In the video tutorial is the same problem. The original shape has 18 objects and after the transformation the dwg file has 21 objects. How could this happen?
I have a workspace that simply loads data from a staging table to a table in our ERP schema. It has a unique constraint that should not allow duplicates. I want the fmw to load all records that do not violate the constraint and just ignore the bad records. I have the REJECTED FEATURE HANDLING set to CONTINUE TRANSLATION. I would expect to just load all records that do not violate the db constraint. However, the fmw just fails and no data is loaded.How can I get this to load valid records and ignore those that violate the constraint?
I am trying to read data from a large PostGIS database. Because the database is so large I am using the featurereader and the initiator as a spatialfilter. However, I discovered that not all the data from the PostGIS database is loaded. The PostGIS database contains tables with multiple geometry types. For example there is one table called "wall" containing both polyline and polygon geometries.It seems like the featurereader uses the first encountered geometry type from a feature and ignores all other types. In my case it only loads polyline geometries from the wall table.Is there a way to also load the other geometries with the featurereader? Or another way to load a large PostGIS database while using a spatialfilter where I do not have this problem?
Ok, so on rare occasions it appears that a certain feature class gets corrupted in a file gdb. The data is still there but you can't edit or add new data to the table. What we do is manually delete the feature class from the gdb, then load a blank feature class template of the same name into that gdb, then add the data back.What I would like FME to do is read the data from the feature class, delete said feature class from gdb, add blank template of feature class from another gdb, then insert the attributes from the original gdb into it. Is this possible?Read attribute values from PIPELINE feature class in GDB 1Delete PIPELINE feature class in GDB1Add PIPELINE feature class from GDB 2 into GDB 1Set values of PIPELINE in the newly created feature class of GDB 1Thank you,Chris
Hi All, I’m trying to download images in a folder from Google drive and then convert those geotagged images to points with having the images as attachment to the point feature class, something similar to GeoTagged Photos to Point tool in Arcmap. I started my workbench by using the Google drive connector then photo coordinate extractor and vertex creator, but my workbench stuck in google drive connector all my records keep rejected if I choose to download them as a folder while it's working fine if I choose to download them as attribute.I could have the images folder in my machine when I run the workbench but it's not allowed me to continue the whole process.Any ideas on how could I achieve this? Thanks,Rawan
Hello, I have a workbench I'm having a difficult time with. As you can see in the image below, I have a shapefile being joined with a table from another database. I have confirmed with data inspector that before the join it has 524 Features, but after the join, even when I do a full join (the one pictured is an inner join). it only returns around half of the geographic features. I was wondering if anyone had any tips, or if I'm missing a Transformer I should be using?
We are trying to connect to our ArcGIS Portal using the portal reader. We are receiving the error "The Server does not appear to be an ArcGIS Portal instance.This really does not make any sense because there definitely is a Portal Instance there that is used by 100's of people in our company.I found some of the other threads but none of the solutions solved our problem (such as adding 7443, etc)I also tried all the variations of login methods.I am hoping someone else has had this problem and solved it or if it is just a bug with FME?I tried it with FME Desktop 2018 and 2019 and our Portal is 10.6
Hello,I could use some help with accessing custom IFC properties (and their values) in the FME workbench (version 2018.1.0.0). I am working on a transformation from an IFC file to PostGIS. The IFC file contains custom properties for some classes (e.g. IfcBuilding and IfcSpace). I can see those custom properties and their values when I inspect the IFC file with an IFC viewer. I can also see the values of the custom properties when I open the IFC file in the FME Data Inspector when I set the "Data Model" parameter of the reader to "Hierarchical". Only in that case I can't tell which IFC class instance the value belongs to. From reading related question and answers I have understood that in order to expose custom IFC properties I would need to add a Attribute Exposer transformer. I tried several settings for the IFC reader parameters, and I have tried specifying additional attributes in the AttributesExposer, in the format <name of the IFC property set>.<
Hi, I would like to use the featurereader to read from elasticsearch, however I am looking for a parameter, in the elasticsearch reader there is a type and JSON query field where is this in the featurereader? Ultimately I need to pass some parameters into the JSON query which is why I need access in the feature reader.Many Thanks
I have a bunch of large files to SFTP into the fme server. In order to not deplete the space on the local disk, I am moving them to S3 after they complete. How can I ensure the files are complete before using a directory watcher to move the files to s3? I am running my own fme server, not cloud version.
Hello,I am transforming Ordnance Survey MasterMap data into an ESRI Geodatabase. Where I require assistance is with the cartographic text (labelling) layer. This layer provides labeling information including font, colour, rotation and placement. I can't use these attributes directly in ArcMap or ArcGIS Pro which leads to labels overlapping and looking generally messy. I have found that writing these attributes to the relevant format attributes in the geodatbase writer work well but it is increadibly slow and discoraged by Safe. I am seeking advice or an alternative.Many ThanksDavid
I have v 2019.0 installed and dont see it , is it a separate install? where can i get the download for it?
Hi I have a table with about 5 million rows. I need to populate an attribute in the table using an external HTTP service, which expects a json parameter built using attributes from same table. The response is also in json formatExpected input json:[{"id":0,"x":320000,"y":290000}{"id":1,"x":345000,"y":310000}{"id":2,"x":410000,"y":300000}] Expected Output:[{"id":0,"z":45.0009}{"id":1,"x":12.236633}{"id":2,"z":24.9987}]Any suggestion what would be the best way to do this using FME?
Hi,Is there a sensible way to update part of a large raster held in a Geopackage? I have a large (100GB) raster of the whole of UK in a Geopackage. When a new tile is released by Ordnance Survey I want to insert it into the large Raster. At the moment I can't see any way other than to read the whole of the large raster, then mosaic the new tile, then write the whole raster out to Geopackage again. Just writing the new tile to the Geopackage deletes the existing data, leaving me with just the new tile. Unless I'm not seeing an 'update' parameter.If I do have to read everything, mosaic, then write, is there a 'most' efficient way of doing that?Thanks in advance.Chris
Is it always necessary to have PNI or another Smallworld application running with FME?
I am trying to get the file name along with a coordinate from our FieldSmart redline note XML files. They are not a traditional XML document. I am able to get 12 rows from the attached XML file but I want the 12 rows to be 12 attributes. How can I do this?
Hello.I am generating a report in excel using a template in FME. Which looks like a below-attached image. I need the same Fields getting populated in my excel output. The template does consider the formula. I also tried to add formulas in the Destination Excel file and get the report auto-generated, but the file gets completely inserted and I am not able to retain those formulae which I have in Sheet 2. Any help in this regard is highly appreciated.
Hello,I am Tolga, and I try to create 3D IMDF file for indoor mapping. In my project, i have a 3D revit model, and i want to use this model for facility management. For facility management, it can be better if it has indoor mapping. For this purpose, i started researching IMDF, but there is no document about creating 3D IMDF. My question is how can i create a 3D IMDF file using revit? Is that possible? If any document exist in this topic, can you share this with me?Thanks for all,Tolga YÜCEL
It gives the error: Python Exception <FMEWSException>: Type: 3, Number: 1, Message: Failed to get authorization header.The workbench has been working in 2018 version
As you can see below, I have a simple DWG to Shapefile workbench going. But every time I need to add a new CAD layer to be read, I need to add a new reader, so I end up with multiple readers reading the same DWG as seen below: How do I make it so I can simply add a new CAD layer to be read from the same DWG without having to stack up multiple reduntant readers like this each containing a couple of layers from the same drawing? Is there a setting that will allow me to alter it like I can with writers for example, as seen below?
I have SQL Server non-spatial reader that pulls data from a view. We have updated the view to add several fields in SQL Server but the reader does not read the new fields (see attached). Any ideas?Thanks,--gary