A space to discuss FME Form
Recently active
I have a dataset of features that I'm trying to insert in a Postgres (pg14) database. That data has a number of text columns that together make up a "report name" plus a timestamp. The name and timestamp together make up the primary key of that dataset. There are also some more columns that contain the actual data. The table I'm inserting this in currently has 800 million rows, and I'm inserting in batches of around 50k rows about a hundred times a day, so keeping indexes small is important. Given the above situation, the text columns from the "report name" have been put into a separate "dataset_reports" table" (~60k rows); with the timestamp and actual data being stored separately (with a foreign index) in their own heavily partitionned "dataset_reports_data" (~800M rows) table. In order to insert data in that table, I need to upsert dataset_reports with all the unique report names in my feature set in a first pass, then get the FK value for all these reports and then I can insert the
Hi Community, I am using some SQLExecutors in my workbench and the this is taking so much time to execute. Is there any way I can execute it faster. Is it because the statement going from fme to outside db and execute it in batches of 1000 and commits the edits making the whole delay?. Is it possible to execute the whole sql actions using a plsql script and bind it to fme?. I may also need to have logs or exception tables for plsql script. Is it possible through fme?
Hi! I'm trying to transfer the information from the layers and tables of one geodatabase (with domains and relationships) to another geodatabase with a different data model. I need the GlobalIDs from the reader geodatabase to remain in the writer geodatabase. In some tables/layers, I manage to keep them by setting "translation type: none" and "preserve GlobalID: yes," but in others, it's necessary for the translation type to be edit session, and then the GlobalIDs are not preserved. Is there any way to maintain the GlobalIDs regardless of the translation type or in any other way?I have read several posts regarding this issue but I can't find a solution.thanks!
Hello! I have recently started working with FME Flow. I’m just testing the possibilities of writing to the Fme flow temporary resource directory, which causes the translation to fail immediatly. My script is just a reader, which in this case is reading from a shapefile, as well as a feature writer. The featurewriter is set to write to [FME_SHAREDRESOURCE_TEMP] and the response i’m getting when running the workspace is this: Has anyone encountered this before, and is there any hope for me and my workspaces in FME flow? Thanks!/Alex
I am using ArcGIS Desktop 10.8.1, ArcGIS Pro 2.5 and it is working well in FME 2023+But in FME2024 version I have problem with reading and writing geodatabase, I get the following error message:“Unable to perform any licensing related tasks. Please check your Esri ArcGIS Compatibility workspace parameter, found in Navigator -> Workspace Parameters -> Translation. This 64-bit version of FME requires ArcGIS Desktop along with 64-bit Background Geoprocessing; ArcGIS Pro; or ArcGIS Enterprise. Refer to this this article http://fme.ly/qua for more details”“Failed to obtain any schemas from reader 'GEODATABASE_FILE' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more information”“Workspace generation failed. Parameter file was C:\Users\Acer\AppData\Local\Temp\FME_1709721529788_18364”I guess the FME2024 version has problems with ESRI licensing or maybe a change in licensing methods.A
We have FME 2022 with floating lic, with 2 editions, Database, and ESRI. Would like to install FME Form 2024.0 along side FME 2022. I know at some point Safe did away with Lic Editions, any idea if we can use the same FME 2022 lic file and make it also work for FME Form 2024 ? .
I have a workspace in FME Form 2021. It includes an Automation Writer. This writer writes keys from FME Form to my Automation in FME Flow 2021, Given this is the 1st time I have pushed FME Attributes into an Automation as Keys, just being curious, I clicked on the “View Written Data” icon in the Automation Writer. It gave some errors and a new windows opened with red in the parameter boxes. It would seem wise to disable this icon when a Automation Writer is chosen. Are there any plans to do this? This does not impact my workspace or Automation. It just seems a bit annoying, unless I am missing something? See my screenshots for a better illustration of what I see happening:
Hi,I have a shape file and want to create some geometries and annotations and export them as IFC.The geometries are correctly exported. But the Annotations are really small in the exported IFC file. I used the Scaler before exporting the IFCAnnotation. But the problem is that the scaler doesn’t change the Size of the text, but also the location of it. Can anyone help me please to make the Annotations larger and also have them in their correct location?
I am trying to do incremental updates from a secondary database (ArcSDE Geodb) because the entire original dataset is > 400k rows and times out or chokes FME. But I have tried about seven different ways and cannot get the WHERE clause to do anything meaningful (except 400 fatal error, which is maybe meaningful but not useful). If it does not fail fatally, it just brings the entire dataset in, or crashes at around 325k. The current attempt is DATEDIFF(day,CURRENT_TIMESTAMP,[Updated_On]) < 2 - I also tried various permutations of [Updated On] > DATEDIFF(day,-1,@GetDate) but that seems pretty clearly to not work for ESRI data (there are so many years of FME advice online, searching is a bit hazadous). [Updated_On] > DATEADD(day,-1,CURRENT_TIMESTAMP) worked using SSMS to hit the secondary database directly, but seems to do nothing in FME... I do not have any control over the source database format or view - but can confirm that [Updated On] is ‘datetime2(7)’ not string. In Da
MongoDB Reader creates Geometry Collections if the mongo collection contains more than one geometry field. Is there a way to choose which one of these fields should be treated as a geometry?
Hi everyone. I am reading data from an Esri Geodatabase. I have an issue with the Shape area reading as negative values. I have tried the geometry validator with Area Orientation set to “right” as with “Allow Left” and “Check doughnuts only” does not deliver any repair results. After the feometry validation, my repaired results still contain the negative area values. Negative values after geometry validatorIs there another way of solving this, I know the issue can be resolved in ArcMap wit geometry repair is there a similar way of doing this with FME?
Hello! I just got ortho images from Realworks, but I got images without coordinate system and some information in txt format. Is there any way to put this txt file as a coordinate system in FME?At last, I would like to get EPSG : 3857 geo referenced ortho images.
Hi Support, Just wondering when the official FME 2024 version is expected to be released. Thank you
Hi everyone, I have some DEMs. I combined them (PointCloudCombiner) and have created surfaces on them (PointCloudSurfaceBuilder) and exported them as LandXML. The problem is with the borders of the DEMs. They are not connected. How can I solve it?Thanks!
Hi, I am having an issue with feature readers and XML. I have a process which downloads an XML file from an ftp site, and the file name changes daily. Upon download, I am trying to trigger a second process which reads the downloaded xml, so I can then split it into separate records (hence why reading in as text will not work, as I need the xml fragments). I use a path reader, to get the file name, but when I put ‘Path_Windows’ as the dataset, i get this error: error message If I choose to ignore the message, and run to the featurereader, It reads in the correct amount of records (59), but the schema is blank. Blank Schema Log Error message Now, i know for a fact that my xml does in fact, have a schema, because if I hard code the file name in the feature reader, it works perfectly fine. (see below) FeatureReader with hard coded file nameSuccessfully read The parameters are identical on both. FeatureReader Parameters I am at a total loss as to why when I want to put in a dynamic
Hi there, Just wondering if anyone else is getting locked out of Sharepoint with the connector transformer....it seems to have started last week when MS further eroded support for IE but we dont know if it related...basically, we have been using the SharePointOnlineConnector for months without issues...but now all of our workbenches are failing with the attached error message. --We can/have re-authenticated the connection with no problems, but it just keeps throwing this error...any thoughts anybody? Thanks very much!
Hi when I try to setup the coordinate system for my reader to EPSG7792 the Arcgis data interoperability doesn’t have Can you support please ? thx Francesco
Our company has a new credit card. So, I have to change it in the billing in FME Hosted. But there no place to do this. As far as I know i'm the admin, so should have all the rights.Does someone have an idea?
I am attempting to convert a DXF/DWG file into the IMDF format. Following the instructions outlined in the first and second articles, I have successfully preprocessed and located the DXF file.However, I am encountering an issue at part 3 of the process. The Reader does not seem to be reading any features as expected.The tutorial I'm following can be found here. One thing, I updated the reader format from Autodesk AutoCAD RealDWG DWG/DXF to Autodesk AutoCAD DWG/DXF.Because I could not load module '/Library/FME/2023.2/plugins/realdwg/realdwg.so' .But i do not think that causes the problem.I would greatly appreciate any assistance in troubleshooting this problem. Thank you.
Hi All,I have created a workspace that reads all GDBs included in a folder (and subfolders) and export a few attributes to an excel file but now need to bring the GDB name (path_filename) into the final output. I tried to expose the attribute to bring it along the workflow but seems isn’t part of the unexposed attributes.I was expecting to see the GDB name as part of the Generic elements (within the unexposed attributes) but the GDB is only in the <Schema>,How can I bring the GDB name as column in the final output (excel file in this case)?<Generic> screenshot<Schema> Screenshot
Dear FME community, apologies up front for being a novice python userI am trying to use the python caller transformer to execute an external .py file. However my external .py file does not have any classes therefore I don’t know what to do with the ‘Class to process features’ parameter in the transformer. If I run the python caller regardless, it executes my .py script fine, but crashes at the end with this error message “PythonFactory failed to load python symbol `FeatureProcessor'”. This is because I’m using the default ‘FeatureProcessor’ as my parameter for the “class to process features”, which I know is wrong.My python script simply generates a JPG file and saves it to a directory.I hope someone can assist and I haven’t totally missed the point.Regards, Damian
Hi. I need to know how can I get data between two characters.I have an attribute like this:10 12 Street (Main) CamnoreFirstly I need to get data between two characters ( ) and Secondly I need to convert it into two columns with this result:10 12 Street Camnore10 Main CamnoreIs StringSearcher is helpful? if yes how can I get this result?I really appreciate your assistance
I need to transfer a file to an external agency, who has set up a ftp filedrop locationI am required to use TLS/SSL Explicit encryptionI have been given an ftp URL ftp://a usernamea passwordAlso, my organisation has a proxy server, which I think I have to specify in some wayIs FTPCaller suitable for this task?
Hi community,I would need your help to make my FME code smarter and more dynamic. I am retrieving data via API. The problem is that I can only retrieve 100 items per page. I have 6 pages so I duplicate 6 httpcaller to be able to recover all of my data.Wouldn't there be a more dynamic way to retrieve this data without having to duplicate the httpcaller, maybe by looping but I don't know if it's possible on FME.In the first call, I have the information about the number of pages.Thanks for your help
Hi everyone! I am new to using FME software and I am trying to use FME Form to extract information from a PDF using the Adobe Geospatial PDF reader. I was wondering if it was possible to somehow extract the color of the text in the document. For example, if I had a PDF document with yellow highlighting and blue highlighting, being able to extract the bits that are only yellow and only blue. Thanks!