Using readers and writers to extract and load data.
Recently active
I'm using a HTTP caller to download a ZIP file from a API. After that I'm using the ZipExtractor transformer to extract a number of csv files from the ZIP file to a folder and then a FeatureReader reads the files and so on. Only problem I'm having is that the CSV files change from time to time. They all start with the time of the export followed by the filename. So every time that happends I have to go back to the FeatureReader, select the files again and reconnect the files to their appropriatie transformers. Is there a way to rename the files after the ZipExtractor ? I have found some topics using the Directory and File Pathnames Reader with the File Copy writer but I cannot get that to work. Any help would be greatly appreciated.
I'm trying to write texts to Microstation and having trouble getting certain characters across, specifically ü and ç but there may be others. They are present in the source data and inside FME right up to the point where they enter the writer. I'm pretty sure it's an encoding issue, but can't seem to set UTF-8 on the Microstation writer. Any ideas on what I can do to get those characters into DGN?
Hi. I'm having trouble seeing views in a REVIT file with the FME Form reader. I can't see the views of the Area Plans as per the Project Browser (see the attached image) but I can see the Floor Plans and 3D views. I've set the Read Geometry As: parameter to Floor Plans and then specified a view to read. The ones that I need aren't visible though. How do I expose these? via attribute or a different method? Many thanks,Michael
I have 64-bit FME Desktop installed (version 2017.1.1.1)I also have ArcGIS Pro installed (version 2.0.1)When trying to add readers requiring esri licensing, for example Esri Geodatabase (File Geodb) or Esri Geodatabase (ArcSDE Geodb). I am getting the following error message…Unable to perform any licensing related tasks. This 64-bit version of FME requires 64-bit Background Geoprocessing, ArcGIS Pro or ArcGIS Server. Refer to this this article http://fme.ly/qua for more detailsI have added the path to the ArcGIS Pro executable to the system PATH environment variable. FME still does not seem to see that ArcGIS Pro is installed. What do I have to do to get FME desktop to recognize the installed ArcGIS Pro?
How do I go about creating a table in AutoCAD like the one attached with inputs that look exactly the same (basically an insert of a csv)? It seems like such a simple task but is proving to be hard. FWIW I am learning AutoCAD via FME so my AutoCAD knowledge is not of a professional standard.
Im playing around with OSM data, which when exposed leaves a very very large number of attributes, the majority of which are empty or have at best 1/2 entries. Im wondering is the way a to filter "active" attributes from an FFS (or a PBF) IE: Filters where all or a certain percentage of attributes entries are not Null or Missing. I know you can do this for individual attributes using things like "attributefilter" or tester, but I wonder is there an easy way to select every exposed attribute, filter this and leave a list of attributes after that have these conditions.
After publishing the ArcGIS Portal Feature Service, I haven't had any success updating the service except for small dataset. I used the ChangeDetector to perform the comparison that includes UPDATE, DELETE AND INSERT. CRCGenerator was used to generate the unique key for the change detection. In the output, Writer Mode=Insert, Truncate First=No. In Advance setting, Use Global IDs=No. The Feature Type was imported from the Original service.The error is as follow:ArcGIS Portal Feature Service Writer: Encountered an unexpected error. The error code from the server was '500' and the message was: 'JSONObject["globalId"] not found.'. Details: ''Your help will be much appreciated.Lawrence
I would like to apply a background mask to some of the text I'm writing to AutoCAD. Does FME expose a parameter for the DWG writer to enable the creation of a such a mask? This is standard, if uncommon, functionality in AutoCAD.
Hi,I have 3D aggregates which I'd like to write to STL-format. Just before the wroter everything look fine but after it a part of all my buildings area swollowed by the terrain. It looks like a bug in the writer. I attached the 3D data in a FFS file. Before (ffs-file):After (STL files): Thank you,Arno
error ( Microsoft SQL Server Spatial Reader: Failed to connect using Microsoft OLE DB Driver for SQL Server. Provider error '(-2147467259)). FME server version FME Server 2022.2 Build 22765 - win64, works on desktop with same SQLServer credentials
I tried to keep the same credentials to S3, but in the server side, the error points to the process doesn't have permissions to access the file. Does the server's user have to ask for reading privileges in the bucket?
Hi All,Workbench is returning an error message I've never seen before when trying to write some photo's to an attachment table of a versioned feature class and i'm getting the message; "Unexpected execution path. please visit http://www.safe.com/supportGeodatabaseRelationshipFeaturesPipeline::GeodatabaseRelationshipFeatures (SortFactory): A fatal error has occurred. Check the logfile above for detailsA fatal error has occurred. Check the logfile above for detailsSome error has occurred closing the pipeline factory, see previous warning" in the translation log. Any ideas where I can go from here to try and trace the troubleshooting?
I create alayer by overlapping some polygons and save the results in an oracle tabe. When trying to open that table in ARCGIS, I receive the error message [The number of points is less than required for feature]After doing some research, it was stated that the arcsdegridSanpper can be used before the writer but it now depreciated and therefore can not be used in my workbench since I'm using FME 2021. How can I solve this issue?
This is more format than FME related but I want to make sure that FME is not the cause of a problem I have with reading a geopackage. I created a workspace that downloads a geopackage from an API and reads it with a FeatureReader for further processing. The geopackage contains a point, a line and a polygon layer but for some reason all 3 layers have the geopackage_type "geopackage_linestring" and fme_geometry "fme_line" in the format attributes (example in the attachment). I created a separate Geopackage with the same geometry types in QGIS and here FME returns the correct types so I'm guessing the geopackage from the API has some SQLite metadata that is not defined correctly. I already checked the metadata in QGIS but here the layer informations show the correct types for each geometry. What or where could be the cause of this problem?
I am unable to find online if FME can read data from Power BI. We currently us an SSRS to pull data from multiple sources and write them to a xls file. According to our developers Power BI can't write an xls file the same way so we were wondering if FME can reach into Power BI to pull data out as a reader in the workbench.
Hi, I have a scenario with a random string test; "Häradålderön" which my goal is to se the result to "Haradalderon". Basically replace any [ä, å, ö] with [a, a, o] letter. I guess using regular expression could do it, but I find it tricky since it might be three sequences to search for ä, å, ö. Any ideas appreciated!
In earlier version this error did not acccur
I am trying to load ArcGIS Pro Annotations which in the source system have also Leading Line. Annotations are successfully loaded into the FGDB, but, although I populated (hopefully correctly) all geodb_text_leader_line* attributes, Leading Lines are not visible.Does anyone have maybe working example on how Annotations containing Leading Line should be loaded in ESRI GDB?
Hello. I have created some geometries (using Bufferer and Extruder) from 2d coordinate points. Can anybody let me know how I can export them as IFC Geographic Elements in an IFC file?
Hi, see the attached, I'm reading MVT Tileset and want to fan out the output file GDB dataset on zoom level and fanout the feature types too on fme_feature_type, I get an error saying the schema doesn't have the correct element, but it does! All help appreciated. The fmw is self contained, it downloads MVT tilesets (not too big).The error at write time is:ERROR |Esri Geodatabase Writer: Feature Type Definition 'bl' was requested, but not defined. Please visit https://www.safe.com/support
When attempting to load in a VRT Raster, created with GDALBUILDVRT that is in Int8 Format, FME says it is invalid. I am licensed to use the VRT format. I am using FME 2021. I am using the correct VRT Raster format when loading it into my workspace. It seems rather strange that FME would not support VRTs in Int8 formats. I am using GDAL 3.7.1-1 to create my Raster VRT's. Either using the commandline tool directly or manually creating VRT's in QGIS results in the same error. GEOTIFF writer: Setting feature type level option 'geotiff_compression_method' to value 'deflate' for feature type 'changedetect'GEOTIFF writer: Setting feature type level option 'geotiff_jpeg_compression_level' to value '25' for feature type 'changedetect'GEOTIFF writer: Setting feature type level option 'geotiff_deflate_compression_level' to value '6' for feature type 'changedetect'GEOTIFF writer: Setting feature type level option '
Does FME have the ability to export Milsoft's Windmil .gdb to an Esri .gdb?
Hello, I'm currently working on .dgn files I am using FME to make attribute changes and adjustments. However, I have the impression that FME automatically divides the objects or cells in my plan, as soon as I enter my .dgn data in the script, without any transformers being used... Here's an overview of the data before and after FME: I also tried using an aggregator. But the objects and geometry in the output dgn file are still not aggregated as in the original dgn file (see the second photo).I would like the geometry of the objects not to be affected. Have you ever had this problem, and if so, do you have a solution to solve it? Thank you in advance.
Heya FME specialists, another PostGIS question:As a start I have a PointZ PostGIS table created with a PostGIS writer in workbench.Next I have a very simple workbench to duplicate some PostGIS tables from the production server to my local server for offsite development / analyses:I use a PostGIS FeatureReader with schema and generic because I want to dynamically create a clone of the table which is altered (data AND schema) in production without having to update readers and writers. This works wonderful!The one problem I have is that the geometry column definition changes from PointZ to GeometryZ:Original:( pkey serial NOT NULL, the_geom geometry(PointZ,28992), CONSTRAINT testpoint_pkey PRIMARY KEY (pkey))Duplicate:( pkey integer NOT NULL, the_geom geometry(GeometryZ,28992), CONSTRAINT testpoint_pkey PRIMARY KEY (pkey))I double checked to make sure the Create Generic Spatial Columns parameter is unchecked. Do I need to change another parameter or do I forget a crucial step? I att