Using readers and writers to extract and load data.
Recently active
I have an AutoCAD DWT template file and I would like to extract all of the layer definitions (e.g. line style, weight, colour, etc.). The DWT file does not contain any objects (i.e. no lines, points, blocks, etc.), so FME does not have any features to process. Is there any way that I can extract the layer definitions?I've tried using the schema reader and I can use that to get all the layer names, but not the associated linestyles, etc.My end goal is that I need to validate supplied CAD files against the standard layer definitions defined in the template file and I was hoping to extract the template layer definitions into a spreadsheet or database so that I could use that to do the validation. Perhaps I'm going about this the wrong way? Is there a way that I can use FME to validate that a DWG matches a template DWT definition?
Recently I tried to write a few million non-spatial features to a Hyper writer. At some point (around 11.000 features) in committing the features to the file (create if needed on a new non-existent file) it errors. With the debugging option in the log I was able to figure out that a 'COPY-IN' statement is executed I think.When I look at the documentation https://tableau.github.io/hyper-db/docs/sql/command/ no such statement is supported. Am I correct here? Features per transaction is set at 1000. Bulk insert: Yes. Changing these makes no difference. When limiting the features that pass to the writer it will write the file correctly. Like say about 50.000 no problem. I am using FME(R) 2022.2.2.0 (20230106 - Build 22782 - WIN64) Is this a bug? Should I upgrade to a newer version? RAM is not a problem, disk space isn't either.
Hello. I´m Topo79.I'm trying to export through pdf_rasterized_pages to an GeoTiff in its real coordinates but it's imposible. I've transformed a gdb into Adobe Illustrator, ffs and GeoPDF at once, but from GeoPDF to georreferenced GeoTiff it isn't posible.Thanks a lot ;)
Hi, I’m trying to add into a pdf (PDF2D) an image. I have created it as a png with transparent background. However when the pdf is created the background is black. I have tried different things but can’t figure it out how to remove the black background. This is what I’m doing: CreatorRasterReaderRasterGeoreferencerPDFStylerPDFPageFormatterPDF2D Writer I played with the PDFStyler but it doesn’t change the result. Can somebody guide me? Thanks,
Currently we have the following where clause for the database connection which works well: Need to add additional parameter which is [transactiondate]= CONVERT (date, GETDATE()) . Tried the following but no results returned:[PartDate]= CONVERT (date, GETDATE()) AND [transactiondate]= CONVERT (date, GETDATE()).Ran in SQL and for sure there are data based on the above where statement. Please let me know what did i do wrong. Thanks.
Does anyone know if it's possible to suppress or otherwise fix the following warning which comes up when writing features to an MS SQL server database? The column in the database is "nvarchar(max)" but FME always flags this warning when the workspace runs, because it uses "nvarchar_max". It's only a warning, but when we then deploy this to FME Server/Flow - we regularly check the job logs and these always show the exclamation icon - so just an annoyance as it's not actually an issue.
Hello, We have a situation using SAP HANA Spatial and we would like to be able to access data held in SAP HANA database tables. We know that native reader/writer does this but I understand from customer that in such cases, we will loose guaranty for SAP from provider.Second option is JDBC driver (or it is mandatory for first option???). In conclusion, my question is if there is any other SAP connector already developed (which can connect to client accessing SAP database). Thank you.
Mongodb supports EPSG 4326 by default you can specify a custom crs : https://www.mongodb.com/docs/manual/reference/operator/query/geometry/ My workflow is simple : geopackage to mongodb. I tried : Specify source and destination projection : no effect (data are in 4326 in mongo)Extract geometry (projected in 2154) and store in attribute geometry2 but there is no json type (or even geometry type). Extract geometry and write it in a geometry attribute : fme returns an error.
I'm using a HTTP caller to download a ZIP file from a API. After that I'm using the ZipExtractor transformer to extract a number of csv files from the ZIP file to a folder and then a FeatureReader reads the files and so on. Only problem I'm having is that the CSV files change from time to time. They all start with the time of the export followed by the filename. So every time that happends I have to go back to the FeatureReader, select the files again and reconnect the files to their appropriatie transformers. Is there a way to rename the files after the ZipExtractor ? I have found some topics using the Directory and File Pathnames Reader with the File Copy writer but I cannot get that to work. Any help would be greatly appreciated.
I'm trying to write texts to Microstation and having trouble getting certain characters across, specifically ü and ç but there may be others. They are present in the source data and inside FME right up to the point where they enter the writer. I'm pretty sure it's an encoding issue, but can't seem to set UTF-8 on the Microstation writer. Any ideas on what I can do to get those characters into DGN?
Hi. I'm having trouble seeing views in a REVIT file with the FME Form reader. I can't see the views of the Area Plans as per the Project Browser (see the attached image) but I can see the Floor Plans and 3D views. I've set the Read Geometry As: parameter to Floor Plans and then specified a view to read. The ones that I need aren't visible though. How do I expose these? via attribute or a different method? Many thanks,Michael
I have 64-bit FME Desktop installed (version 2017.1.1.1)I also have ArcGIS Pro installed (version 2.0.1)When trying to add readers requiring esri licensing, for example Esri Geodatabase (File Geodb) or Esri Geodatabase (ArcSDE Geodb). I am getting the following error message…Unable to perform any licensing related tasks. This 64-bit version of FME requires 64-bit Background Geoprocessing, ArcGIS Pro or ArcGIS Server. Refer to this this article http://fme.ly/qua for more detailsI have added the path to the ArcGIS Pro executable to the system PATH environment variable. FME still does not seem to see that ArcGIS Pro is installed. What do I have to do to get FME desktop to recognize the installed ArcGIS Pro?
How do I go about creating a table in AutoCAD like the one attached with inputs that look exactly the same (basically an insert of a csv)? It seems like such a simple task but is proving to be hard. FWIW I am learning AutoCAD via FME so my AutoCAD knowledge is not of a professional standard.
Im playing around with OSM data, which when exposed leaves a very very large number of attributes, the majority of which are empty or have at best 1/2 entries. Im wondering is the way a to filter "active" attributes from an FFS (or a PBF) IE: Filters where all or a certain percentage of attributes entries are not Null or Missing. I know you can do this for individual attributes using things like "attributefilter" or tester, but I wonder is there an easy way to select every exposed attribute, filter this and leave a list of attributes after that have these conditions.
After publishing the ArcGIS Portal Feature Service, I haven't had any success updating the service except for small dataset. I used the ChangeDetector to perform the comparison that includes UPDATE, DELETE AND INSERT. CRCGenerator was used to generate the unique key for the change detection. In the output, Writer Mode=Insert, Truncate First=No. In Advance setting, Use Global IDs=No. The Feature Type was imported from the Original service.The error is as follow:ArcGIS Portal Feature Service Writer: Encountered an unexpected error. The error code from the server was '500' and the message was: 'JSONObject["globalId"] not found.'. Details: ''Your help will be much appreciated.Lawrence
I would like to apply a background mask to some of the text I'm writing to AutoCAD. Does FME expose a parameter for the DWG writer to enable the creation of a such a mask? This is standard, if uncommon, functionality in AutoCAD.
Hi,I have 3D aggregates which I'd like to write to STL-format. Just before the wroter everything look fine but after it a part of all my buildings area swollowed by the terrain. It looks like a bug in the writer. I attached the 3D data in a FFS file. Before (ffs-file):After (STL files): Thank you,Arno
error ( Microsoft SQL Server Spatial Reader: Failed to connect using Microsoft OLE DB Driver for SQL Server. Provider error '(-2147467259)). FME server version FME Server 2022.2 Build 22765 - win64, works on desktop with same SQLServer credentials
I tried to keep the same credentials to S3, but in the server side, the error points to the process doesn't have permissions to access the file. Does the server's user have to ask for reading privileges in the bucket?
Hi All,Workbench is returning an error message I've never seen before when trying to write some photo's to an attachment table of a versioned feature class and i'm getting the message; "Unexpected execution path. please visit http://www.safe.com/supportGeodatabaseRelationshipFeaturesPipeline::GeodatabaseRelationshipFeatures (SortFactory): A fatal error has occurred. Check the logfile above for detailsA fatal error has occurred. Check the logfile above for detailsSome error has occurred closing the pipeline factory, see previous warning" in the translation log. Any ideas where I can go from here to try and trace the troubleshooting?
I create alayer by overlapping some polygons and save the results in an oracle tabe. When trying to open that table in ARCGIS, I receive the error message [The number of points is less than required for feature]After doing some research, it was stated that the arcsdegridSanpper can be used before the writer but it now depreciated and therefore can not be used in my workbench since I'm using FME 2021. How can I solve this issue?
This is more format than FME related but I want to make sure that FME is not the cause of a problem I have with reading a geopackage. I created a workspace that downloads a geopackage from an API and reads it with a FeatureReader for further processing. The geopackage contains a point, a line and a polygon layer but for some reason all 3 layers have the geopackage_type "geopackage_linestring" and fme_geometry "fme_line" in the format attributes (example in the attachment). I created a separate Geopackage with the same geometry types in QGIS and here FME returns the correct types so I'm guessing the geopackage from the API has some SQLite metadata that is not defined correctly. I already checked the metadata in QGIS but here the layer informations show the correct types for each geometry. What or where could be the cause of this problem?
I am unable to find online if FME can read data from Power BI. We currently us an SSRS to pull data from multiple sources and write them to a xls file. According to our developers Power BI can't write an xls file the same way so we were wondering if FME can reach into Power BI to pull data out as a reader in the workbench.
Hi, I have a scenario with a random string test; "Häradålderön" which my goal is to se the result to "Haradalderon". Basically replace any [ä, å, ö] with [a, a, o] letter. I guess using regular expression could do it, but I find it tricky since it might be three sequences to search for ä, å, ö. Any ideas appreciated!