Using readers and writers to extract and load data.
Recently active
Hi I want to visualize in 3D NDVI values (single band .tiff raster) in combination with RGB .las point cloud. What would be the best apporach? Cheers
I was wondering if anyone might be able to help me out? I'm writing tabular data to a SQLite database and I'd like to run the VACUUM command after it's been written. I thought it might exist in the SQLITE3 writer parameters but no luck. I'm using FME 2019 desktop
I am trying to read metadata from feature classes in an SDE but am consistently getting an error. I add a reader (format "Esri Geodatabase (ArcSDE Geodb)", point it at one table (interactively selected in the Table List field), set the Feature Read Mode to "Metadata", and then click Ok, and then comes the error (The error number from ArcObjects is: '-2147216072'. The error message from ArcObjects is: {Underlying DBMS error}). My overall goal is to read a feature class's metadata, update it to show when the feature class was updated, and then write the new metadata to the feature class. I am able to create and update tables in this SDE using FME so I don't think it's a permissions issue. I've tried various settings in the reader but cannot get past that error. Has anybody ever encountered this? The full log file:Starting translation... FME 2018.1.0.1 (20180730 - Build 18528 - WIN32) FME Desktop ESRI Editi
I get datas from a csv file that contains a latitude and longitude field. These geographical data must be reprojected with different local systems. What should I do to build a postgis table with the correct coordinates (after reprojecting the given lat and lon in the correct geodetic system) for each point that I get ? Should I split in many different tables ?
I want to create many number of 3d model with different position. I am having one 3ds model file and an excel(.xlsx) file which has location data(latitude, longitude) to create many number of 3d model. Using Cloner transformer, I cloned required number of 3d model. But I don't know, how to set the location(longitude, latitude) for the cloned 3d models from the excel file?. Can anyone help me out?.Here I attached 3d model and it's position excel file.
Hi,i want read from Sharepoint 365, but i get only error messages. What can i do for connect? https://***/AllItems.aspxuser: ***@***.depw: ******@Rileygreene
I have a number of workspaces pulled together into a .bat file that runs on a schedule every night. Recently, a few of the workspaces fail to run but if I open the workspace in Desktop and run it is fine. The workpaces are pulling data from AGOL and often get an error "ArcGIS Online Feature Service Reader: Encountered an unexpected error. The error code from the server was '503' and the message was: 'An error occurred.'. Details: ''" and nothing further. The issue may well be with AGOL but it feels a little inconsistent when the individually ran workspaces seem to be fine.Has anyone else had this issue and if so, what suitable steps did you take to resolve?
Hi, i'm trying to define and write IfcShapeRepresentation properties (attributes) like the RepresentationType and RepresentationIdentifier for geometries (2D points) in IfcBuildingElementProxy (class) , but unfortunately without success.So how to define and write a 2d point in IfcBuildingElementProxy classe? According the IFC definitioin (link below) i have to define the RepresentationType as "GeometricSet" and the RepresentationIdentifier as "FootPrint" for defining a 2D pointhttps://standards.buildingsmart.org/IFC/RELEASE/IFC2x3/FINAL/HTML/ifcproductextension/lexical/ifcbuildingelementproxy.htm By following your "AutoCAD to IFC Conversion Example" Tutorial i have to set the geometry name to "FootPrint" (what defines the RepresentationIdentifier) with the GeometryPropertySetter-Transformer. (see workspace below)Now, how to set the RepresentationType as "GeometricSet"? (A "normal" point geometry like fme_point do not
Hi Folks, I’m trying to download images from Google Drive and convert these images to point and add the photos as attachment to the extracted points.I’ve created the relationship class in ArcCatalog and I could have the points and the attachment table when I disabled the Relationship writer. But when I enable it I got the following error “ERROR |Failed to retrieve origin row for a relationship feature with OBJECTID '226' from table/feature class 'ARSiteVision_Images'”I’m not sure what I missed here, I followed the instruction in this link but with no luck. I attached the FME Workbench if this is could be helpful. Ps: I have only 224 images so I would have 224 points so I’m not sure from where 226 come! Thanks,Rawan
There's been several topics on reading Civil 3D Property Sets on the FME forum, and according to the release notes for FME 2019.1 support seems to have been silently added: -------------------------- FME 2019.1 b19527 20190309 --------------------------Civil 3D: Added read support for property sets [FMEENGINE-10155]-------------------------- FME 2019.1 b19540 20190327 --------------------------Civil3D: Read property sets from CAD entities as well as Civil entities [FMEENGINE-10155] However I'm having trouble in getting it to work in a reliable manner and there doesn't seem to be any documentation of the extent of the support.Above are some of the attributes from our Property Sets. NV-Corridor are automatically assigned by Naviate and all of the information from that plugin works fine. BIP are attributes that we define ourselves with Property Sets. The ones that showup in the Property list in FME and that I'm able to read in the workspace seem to be limited to plain text Properties in t
Hello, I created a FGDB that has a Feature Class, Relationship Class and Related Table. I used this url https://knowledge.safe.com/articles/28340/working-with-geodatabase-relationship-classes-atta.html) as a reference to set up the FME workspace to write data to the feature class and related table. What is interesting is that it writes without errors if I only write to the feature class and related table. If I try to also write to the relationship class writer, then I get this message. "Failed to retrieve origin row for a relationship feature with OBJECTID '1' from table/feature class" This makes me wonder if in this situation I don't need to write to the relationship class. If I do, hopefully someone can provide an answer as to why I am getting this error.Kind Regards,Laura
Hi,I want to transfrom shapefiles into dwg-files. Therefore I tryed this tutorial:https://knowledge.safe.com/articles/18703/how-to-convert-shp-to-dwg-esri-shapefile-to-autoca.htmlBut I have a problem. If I want to transform polygon shapefiles, I always get more objects in the dwg file, then the original dataset had. In the video tutorial is the same problem. The original shape has 18 objects and after the transformation the dwg file has 21 objects. How could this happen?
I have a workspace that simply loads data from a staging table to a table in our ERP schema. It has a unique constraint that should not allow duplicates. I want the fmw to load all records that do not violate the constraint and just ignore the bad records. I have the REJECTED FEATURE HANDLING set to CONTINUE TRANSLATION. I would expect to just load all records that do not violate the db constraint. However, the fmw just fails and no data is loaded.How can I get this to load valid records and ignore those that violate the constraint?
I am trying to read data from a large PostGIS database. Because the database is so large I am using the featurereader and the initiator as a spatialfilter. However, I discovered that not all the data from the PostGIS database is loaded. The PostGIS database contains tables with multiple geometry types. For example there is one table called "wall" containing both polyline and polygon geometries.It seems like the featurereader uses the first encountered geometry type from a feature and ignores all other types. In my case it only loads polyline geometries from the wall table.Is there a way to also load the other geometries with the featurereader? Or another way to load a large PostGIS database while using a spatialfilter where I do not have this problem?
Ok, so on rare occasions it appears that a certain feature class gets corrupted in a file gdb. The data is still there but you can't edit or add new data to the table. What we do is manually delete the feature class from the gdb, then load a blank feature class template of the same name into that gdb, then add the data back.What I would like FME to do is read the data from the feature class, delete said feature class from gdb, add blank template of feature class from another gdb, then insert the attributes from the original gdb into it. Is this possible?Read attribute values from PIPELINE feature class in GDB 1Delete PIPELINE feature class in GDB1Add PIPELINE feature class from GDB 2 into GDB 1Set values of PIPELINE in the newly created feature class of GDB 1Thank you,Chris
Hi All, I’m trying to download images in a folder from Google drive and then convert those geotagged images to points with having the images as attachment to the point feature class, something similar to GeoTagged Photos to Point tool in Arcmap. I started my workbench by using the Google drive connector then photo coordinate extractor and vertex creator, but my workbench stuck in google drive connector all my records keep rejected if I choose to download them as a folder while it's working fine if I choose to download them as attribute.I could have the images folder in my machine when I run the workbench but it's not allowed me to continue the whole process.Any ideas on how could I achieve this? Thanks,Rawan
Hello, I have a workbench I'm having a difficult time with. As you can see in the image below, I have a shapefile being joined with a table from another database. I have confirmed with data inspector that before the join it has 524 Features, but after the join, even when I do a full join (the one pictured is an inner join). it only returns around half of the geographic features. I was wondering if anyone had any tips, or if I'm missing a Transformer I should be using?
We are trying to connect to our ArcGIS Portal using the portal reader. We are receiving the error "The Server does not appear to be an ArcGIS Portal instance.This really does not make any sense because there definitely is a Portal Instance there that is used by 100's of people in our company.I found some of the other threads but none of the solutions solved our problem (such as adding 7443, etc)I also tried all the variations of login methods.I am hoping someone else has had this problem and solved it or if it is just a bug with FME?I tried it with FME Desktop 2018 and 2019 and our Portal is 10.6
Hello,I could use some help with accessing custom IFC properties (and their values) in the FME workbench (version 2018.1.0.0). I am working on a transformation from an IFC file to PostGIS. The IFC file contains custom properties for some classes (e.g. IfcBuilding and IfcSpace). I can see those custom properties and their values when I inspect the IFC file with an IFC viewer. I can also see the values of the custom properties when I open the IFC file in the FME Data Inspector when I set the "Data Model" parameter of the reader to "Hierarchical". Only in that case I can't tell which IFC class instance the value belongs to. From reading related question and answers I have understood that in order to expose custom IFC properties I would need to add a Attribute Exposer transformer. I tried several settings for the IFC reader parameters, and I have tried specifying additional attributes in the AttributesExposer, in the format <name of the IFC property set>.<
Hi, I would like to use the featurereader to read from elasticsearch, however I am looking for a parameter, in the elasticsearch reader there is a type and JSON query field where is this in the featurereader? Ultimately I need to pass some parameters into the JSON query which is why I need access in the feature reader.Many Thanks
I have a bunch of large files to SFTP into the fme server. In order to not deplete the space on the local disk, I am moving them to S3 after they complete. How can I ensure the files are complete before using a directory watcher to move the files to s3? I am running my own fme server, not cloud version.
Hello,I am transforming Ordnance Survey MasterMap data into an ESRI Geodatabase. Where I require assistance is with the cartographic text (labelling) layer. This layer provides labeling information including font, colour, rotation and placement. I can't use these attributes directly in ArcMap or ArcGIS Pro which leads to labels overlapping and looking generally messy. I have found that writing these attributes to the relevant format attributes in the geodatbase writer work well but it is increadibly slow and discoraged by Safe. I am seeking advice or an alternative.Many ThanksDavid
I have v 2019.0 installed and dont see it , is it a separate install? where can i get the download for it?
Hi I have a table with about 5 million rows. I need to populate an attribute in the table using an external HTTP service, which expects a json parameter built using attributes from same table. The response is also in json formatExpected input json:[{"id":0,"x":320000,"y":290000}{"id":1,"x":345000,"y":310000}{"id":2,"x":410000,"y":300000}] Expected Output:[{"id":0,"z":45.0009}{"id":1,"x":12.236633}{"id":2,"z":24.9987}]Any suggestion what would be the best way to do this using FME?
Hi,Is there a sensible way to update part of a large raster held in a Geopackage? I have a large (100GB) raster of the whole of UK in a Geopackage. When a new tile is released by Ordnance Survey I want to insert it into the large Raster. At the moment I can't see any way other than to read the whole of the large raster, then mosaic the new tile, then write the whole raster out to Geopackage again. Just writing the new tile to the Geopackage deletes the existing data, leaving me with just the new tile. Unless I'm not seeing an 'update' parameter.If I do have to read everything, mosaic, then write, is there a 'most' efficient way of doing that?Thanks in advance.Chris