Data

I’m fairly new to FME.  I’m using FME Workbench 2023.1.  I am trying to recreate an excel output similar to the below image, but I’m not sure FME is capable since there isn’t much information out there on using FME to write an excel output like what I have a need for…  All I see is more simple outputs.  I need to be able tie the output values of a lot of those cells to data created in other transformers, but since the layout is not your typical excel sheet layout, I can’t seem to find any info if you can use a template and then tie the output from another transformer to the particular cell it goes with in the excel template.  If anyone knows where I can find more information on this, I would greatly appreciate the help! Sample template with values 

I am totally new to FME.I would like to merge all the shapefiles located in the all the folders called 2012. Any ideas how to do it? 

Hi!I have many workbenchs to manage and I would like to find a way to create a table linking the workbench name with the output writers of each workbench. The goal is to find which workbench generates which table(s). My idea is to add a custom transformer to all my workbench. The information I would like to have is :name of the workbench directory of the workbench writer information (table name, table qualifier and writer)With ParameterFetcher, more specifically, the FME_MF_DIR and FME_MF_NAME parameters, I can get the information about the the name of the workbench and directory. But I cannot find a way to extract the information of the writers. All the writers I have are in a postgis format.I would prefer not to use Python if possible. I’m sure there’s a way to extract the information since it appears in the log, I just don’t know how to get to it! Thank you 😀 !

"Hello, I have a folder containing multiple shapefiles, labeled as (a, b, d, e, f...). My objective is to utilize the AnchoredSnapper transformer in the following manner: initially, snap shapefile 'a' with 'b', where 'a' serves as the anchor. Then, the resulting snapped shapefile will be used as the anchor and snapped with 'c', and so forth until all shapefiles are snapped. I tried to implement loops but the problem is that the output have to be the new output after everh iteration, so i can't get a configuration of the loop.  I appreciate any assistance or proposition you can provide. Thank you."

Hello, I am trying to convert an shapefile in IFC format, never did before.What I did is to connect the reader for shp format to a writer for IFC format but the result is empty.Please, can you explain me the setting to use or the procedure to perform this conversion?Thanks

Hi there, I am getting an Error on Windows Server FME 2021.2.5  when add Reader FGDB and tried to open Tables. (Geodatabase Error (-2147024894) Please see the attached image for more details.I have used FGDBs many times using FME, Windows Server Patches installed by the IT Department recently and it seems since then I am having this issue on FMEI have tried on different servers, ie: Windows 2012 & Windows 2019 and FME on all servers have the same issue.I can drag and drop FGDBs on to the FME Workbench canvas without any issues. Could anyone help me to identify this issue and let me know how to resolve it?thanksRegards,Pushpa

We have a series of databases (postgis) that get _year_month added to their endings so that we can see which one is the newest. The rest of the name, schema etc is the same.It would be convenient to have our workspaces automatically look for the most recent database.So if there exists: supercooldatabase_21_09, supercooldatabase_23_07 and supercooldatabase_24_03 on the server I would like to have FME check all supercooldatabase’s and select the one with the higest number, aka _24_03. This attribute would then be passed on to guide FeatureReaders correctly.Would it possible to do this within FME?

Hi, I am using a sql executor reading dynamically some data from our db. I am using following query: select * from t_@Value(F_CLASS_NAME) where fid=@Value(FID). How can I expose the attributes of each query ? I can not use the attribute exposer of the sql executor as the attributes name and number change depending on the table name. I tried a few things but nothing has worked so far. I am reading about 10-40 tables so I want to avoid to manually type in all diff attribute names.

Hi, When I try to overwrite a layer in AGOL using the AGOL Feature Service Writer it creates a duplicate feature layer, with a different feature ID. I need to overwrite as there is a schema change in the data and i’m trying to avoid creating a new feature layer as we’ll have to re-configure the downstream map services.I ran the same workbench on a different environment and it had no issues overwriting the layer I was pointing at. Any ideas on how to get this to overwrite?I’ve attached a screenshot of the settings I'm using 

I want to give file path to load multiple CSV file to SQL server, How to give file path to reader to select multiple CSV file?  

Hi All,I need to concatenate the two values of the same cell into just one line. I’ve been (partially) able to do it by using a StringReplacer but some of the cells show an space which make the StringReplacer not working, see below an example:There’s an space between line 2 and Siding, how can I make the final result ‘CE Siding’ ?  

Hello enthusiasts, I am trying to migrate a bulk data (assume 2Million records) to an oracle table due to size  planning to split and sent them by batches. In this situation I have a certain doubts which are below, if a data already migrated to the oracle table, but next batch also have that record means oracle will through the “unique id constraint” error. how can I skip that record and move next one? Due to size of the data, i am splitting them into different batches and try to run parallel. FYI: I am migrating data into one same oracle table using oracle writer. can i run multiple workbenches (like insert1.fmw and insert2.fmw) parallelly and is it works fine or will be chances to loss data in this scenario ?WRITER using: oracle spatial object expecting your thoughts and suggestions.Thanks in advance !

Hi FME community,I’ve been tasked with trying to get the metadata we hold (in a SQL server database) into an INSPIRE-compliant format.I was hoping that we could use the metadata we currently hold (Title, Abstract, Temporal Extents etc) and run it through an INSPIRE XSD template. However, it’s pretty overwhelming when I look at the XSD templates (which I got from here - application-schemas/schemas at main · INSPIRE-MIF/application-schemas · GitHub) as there are so many nested parts (see screenshot). Is there a relatively straightforward method I could use for each topic of data (be they addresses, parcels of land etc - which have their own topic under the INSPIRE framework) which could be joined in FME and output an XML file which can be imported to the data in ArcPro? It seems a bit convoluted but I’m just trying to get an idea of where to go from here with a large shift in metadata storage and how we will be using it at my organisation going forward. Thanks

Hello, I am trying to update the date field records of a feature class using arcpy update cursor, but I am getting the following error (text in bold), please let me know If I am missing anything :   Field Name : e_result_datetimeField Values : 20230803081554 Field datatype : Date Also, want to mention that I am able to update the string, double data type fields using updatecursor in FME with no issues - it’s only with date data type I am facing the problem. Python Exception <RuntimeError>: The value type is incompatible with the field type. [e_result_datetime]Traceback (most recent call last):  File "<string>", line 46, in inputRuntimeError: The value type is incompatible with the field type. [e_result_datetime]Error encountered while calling method `input'PythonCaller (PythonFactory): PythonFactory failed to process feature 

Hi AllI am trying to set up a workspace to react when a change is made to an ESRI Enterprise Geodatabase table but cant figure out how to watch for changes on the table.I could set up a scheduled task to read all of the data and then a change detector to update a further table but that doesn't seem a wise use of resources, particular if there are no changes.SO any ideas how to watch this database table for changes efficiently??Regards   

Hi,I have a shapefile with lines, some of which show the degree of curvature...I would like to delete some lines based on the angle of curvature.How can I do that?  

Hiich would like to write an gml Class "ExistingLandUseGrid" Object from the INSPIRE Specs http://inspire.ec.europa.eu/schemas/gelu/4.0Wenn adding a INSPIRE GML writer by pointing to the cooresponding GriddedExistingLandUse.xsd, the writer does not offer a featuretype "ExistingLandUseGrid" which is what i would expect. The only featuretype in the GML writer is "SpatialDataSet".Are there any options for the writer to enable writing a featuretype "ExistingLandUseGrid"? Or an example of a working script? RegardsPeter

Dear readers, A colleague of mine is trying to extract data from an FTP server.Using FME for this process would be beneficial to a large part of our organization, since it would enable us to create ETL processes for FTP-data. My colleague encounters the following problem:FTP/FTPS/SFTP transfer error: Timeout was reached The settings he uses are:URL: <url links correctly to a .csv on the FTP server starting with FTPS://FTP>Transfer type: Download to a File Target File: <.csv on OneDrive that does not exist yet>File Path Attribute: _downloaded_file_path Connection Mode: Passive / Active triedTransfer Mode: BinaryVerify SSL Certificates (ftps/ftpes only): Yes Authentication Type: Password < username and password correctly set> Proxy Type: Use FME Network Proxy Settings My colleague received the following error:FTP/FTPS/SFTP transfer error: FTP: command PORT failed We guess that this is a question for our FME functional manager, but any thoughts on how to solve this probl

Good morning,  I'm currently facing a really weird issue. In my workbench I have a Reader that is loading a quite large Excel file, containing multiple tabs. I decided to remove all the unwanted data from the Excel sheet and keep only the tab I really need.  When I try to update the Reader feature types the Excel tabs that I just removed keep showing! I have tried adding this Excel sheet to a new workbench; same result.  What I've tried so far: - Adding the Reader to a new workbench in 2018.1 and 2019 beta. - Purged temporary files in FME. - Restarting FME / computer - Ran Windows disk cleanupNothing helped, I'm still seeing the tabs I deleted.   Cheers, Ed

Hi All, I’m struggling to explode/conver the fme_aggregate to fme_polgon. I have already used 2DForcer and GeometryCoercer already, settings in the screenshot below:This comes from a DWG file and I need to create the outline boundary as AOI,Any ideas?

I am using ArcGIS Desktop 10.8.1, ArcGIS Pro 2.5 and it is working well in FME 2023+But in FME2024 version I have problem with reading and writing geodatabase, I get the following error message:“Unable to perform any licensing related tasks. Please check your Esri ArcGIS Compatibility workspace parameter, found in Navigator -> Workspace Parameters -> Translation. This 64-bit version of FME requires ArcGIS Desktop along with 64-bit Background Geoprocessing; ArcGIS Pro; or ArcGIS Enterprise. Refer to this this article http://fme.ly/qua for more details”“Failed to obtain any schemas from reader 'GEODATABASE_FILE' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more information”“Workspace generation failed.  Parameter file was C:\Users\Acer\AppData\Local\Temp\FME_1709721529788_18364”I guess the FME2024 version has problems with ESRI licensing or maybe a change in licensing methods.A

I am trying to do incremental updates from a secondary database (ArcSDE Geodb) because the entire original dataset is > 400k rows and times out or chokes FME. But I have tried about seven different ways and cannot get the WHERE clause to do anything meaningful (except 400 fatal error, which is maybe meaningful but not useful). If it does not fail fatally, it just brings the entire dataset in, or crashes at around 325k. The current attempt is DATEDIFF(day,CURRENT_TIMESTAMP,[Updated_On]) < 2  -  I also tried various permutations of [Updated On] > DATEDIFF(day,-1,@GetDate) but that seems pretty clearly to not work for ESRI data (there are so many years of FME advice online, searching is a bit hazadous). [Updated_On] > DATEADD(day,-1,CURRENT_TIMESTAMP) worked using SSMS to hit the secondary database directly, but seems to do nothing in FME... I do not have any control over the source database format or view - but can confirm that [Updated On] is ‘datetime2(7)’ not string. In Da

MongoDB Reader creates Geometry Collections if the mongo collection contains more than one geometry field. Is there a way to choose which one of these fields should be treated as a geometry?

Hi everyone. I am reading data from an Esri Geodatabase. I have an issue with the Shape area reading as negative values. I have tried the geometry validator with Area Orientation set to “right” as with “Allow Left” and “Check doughnuts only” does not deliver any repair results. After the feometry validation, my repaired results still contain the negative area values. Negative values after geometry validatorIs there another way of solving this, I know the issue can be resolved in ArcMap wit geometry repair is there a similar way of doing this with FME?

I am attempting to convert a DXF/DWG file into the IMDF format. Following the instructions outlined in the first and second articles, I have successfully preprocessed and located the DXF file.However, I am encountering an issue at part 3 of the process. The Reader does not seem to be reading any features as expected.The tutorial I'm following can be found here. One thing, I updated the reader format from Autodesk AutoCAD RealDWG DWG/DXF to Autodesk AutoCAD DWG/DXF.Because I could not load module '/Library/FME/2023.2/plugins/realdwg/realdwg.so' .But i do not think that causes the problem.I would greatly appreciate any assistance in troubleshooting this problem. Thank you.