Using readers and writers to extract and load data.
Recently active
Hi all,I am currently using ArcPro 3.5 DI tool that uses,FME(R) 2025.0.0.0 (20250228 - Build 25208 - WIN64)Some of my FME scripts are failing when reading an excel file if it as a python start up script that imports arcpy specifically. If i remove arcpy, the excel reader works fine.Is this a bug with the FME build that came with our ArcPro 3.5 or is it consistent with a stand-alone FME install?Some of the warnings are:----------------------------------------------------------The Startup Python Script changed the current FME process locale from 'English_New Zealand.utf8' to 'English_New Zealand.1252' and FME has restored it back to 'English_New Zealand.utf8'. It is undefined behavior to change locale and doing so may cause unexpected errors. For more information, visit http://fme.ly/PythonLocaleError-----------------------------------------------------------Excel Reader: Could not read cell at row '0', column '1' for sheet 'can't read more cells in trial version'. Error message is 'can'
This morning I tried to import data using a WFS concerning a Dutch data source. I got into a weird error:Used WFS: service.pdok.nl/kadaster/kadastralekaart/wfs/v5_0?request=GetCapabilities&service=WFSDoes this look familiar to someone?
Wow - new marketing campaign?!https://youtu.be/XaXGa_zijlo?si=_6mP-oYSZanl9ZfII think Im a fan
Hey everyone, I'm writing some data into a Snowflake database and getting a geometry validation error on the Snowflake side: SnowflakeSQLException: Geography validation failed.When I run it thru the FME GeometryValidator - it passes.If I run it thru the SQLExecutor and call ST_ISVALID it returns false so in theory, I could call the SQLExecutor for every record however with a million records, this really isn't feasible. I thought about grouping the inserts by 1000 and if it fails, run those 1000 thru the SQLExecutor however I couldn't figure out how to have the FeatureWriter continue if it fails on a group.Does anyone have any ideas on how to get these records to continue. I really just want FME to remove any bad geometries and log which one's failed. Thanks!
After a week+ of trial and error I wonder. Have anyone managed to create an FBX-file with FME that contains terrainmodel + ortophoto draped on top. That can be opened WITH materials/texture directly in Navisworks? I have tried all settings - but can not make it work. The files open correctly in FME Data Inspector, Autodesk FBX Reviewe, 3dsmax, Lumion and even Infraworks. And also the export from Infraworks to Navisworks work OK! However I cant seem to be able to open the FBX-file directly in Navisworks - it only shows the terrain with no texture/material. Even when it shows the texture in the "materials" pane. Material is added on a Mesh-group and displays nicely before writing and as mentioned in the other software above.Some stuff I have tried:- All settings on the FBX-writer- Manually changing the scaleuints on the ASCII- file from 1 to 100 to scale to meters instead of default cm. It seems that there is some scaling issues between geometry / material or bug related to mat
Hello, I just upgraded to FME Form 2025.1.2 and am having a problem with the Google Sheets Reader. The Reader previously worked in FME 2024.x, but I am now getting a very ambiguous error whenever I try to read a sheet into a workspace. I literally just upgraded this morning after initially opening the workspace in Form 2024 and successfully running it, so I know nothing has changed on my computer or anything otherwise. Any ideas what I am doing wrong?
Hi,I wonder if someone could help me?I would like to merge pdf files in one folder (folder1.png)with pdf files in different folder (folder2.png) based on data in excel (merge.png). For an example, merge 1.pdf in folder1 with 421.pdf,422.pdf,423.pdf in folder2 like it says in the table. And 2.pdf in folder1 with 424.pdf, 425.pdf in folder2 and so on...Is that possible?Thank you, Jasna
I have a fileGDB with many records, of which I only want to read a Selection.I know how to use the Search Envelope to select records in a bounding boxIs there also a way of Selecting records where an Attribute equals a value? (actually one of three values)Or is the only way with a Transformer after the Reader?Just trying to optimise
Hi,I want to automate the process of downloading a dataset that comes as a zipped folder. Inside the folder, there is a GeoTIFF file that I want to read into FME. After that, I want to write it to a new GeoTIFF file, which should automatically update when the dataset is updated.What is the simplest way to do this?The file i want to work with is this: https://ext-dokument.lansstyrelsen.se/sodermanland/Geodata/Gron_infrastruktur/LstD_GI_Ädellöv_int.zip
Hi everyone,We recently switched to the new version (2024) of FME. I ceated a new fmw-file to convert gml to dgn. But when opening the dgn, I noticed that every level that uses an attribute value has the colour ‘white’ instead of the intended colour.Is this a bug? Can somebody help me how to solve this?Thanks in advance.
I am trying to get my few MS Excel as a reader and then write them to a new Excel all together however, I got this error that says Excel Writer: xlsx row limit of 1048576 exceeded for New. The first 1048576 features of New will be written to file. Ending translation ? Is there a way around to pass this ?
I would like to fill the holes or patch the gaps that are not really holes (see image), but in the output I don’t get any attributes. Why is that, and what is the best method? I try Areaamalgamator but ii cannot retrieve the attributs in output…thank you
Hi, I have the following csv sheet created with FMEThat is not exactly what I want. I would like to see the following format:The third column is empty, and for the last 4 columns only 1 row is needed. How can I achieve that? The values in the last 4 columns are purely inserted in the user interface at the start, not more than that.Below is the part of FME:The user parameters of the writer are as follows:Any tips?
Hi community!I’d like to know how to make the white background of this image transparent and change the black color of the geographic region to white. It’s important to keep the original resolution and export the file in Uint16 format.I’ve attached the image: could someone kindly apply this transformation and send me back the modified version?Thank you so much!
Hi,I do have a question for anyone that experience about extracted information from a website . I have a geodatabase that I set it up as a field with Domains.The project I am working on is Campground for my Forest here we have many campgrounds. I work on about 18 campground so far…My question is can I go to Recreation.gov site and select a campground using in FME ? For example, in the search box , type Colorado Campground and then it turns to new page and you will see the campground map that has all the Site number you can pick.So click on number three and then click View details...which will bring another page and it gives you all the information about that site number…That is what I plan to use this…I have done input all the information into my geodatabase there. Will HTMLExtractor work for this type of thing ? Am I making myself clear Thanks !
Hi everyone,I’m running into an issue where FME hangs while reading a DWG file using the ACAD reader. The translation process stops and doesn’t progress past the following message:while reading dwg file translation will be stopped by 'LogCount_func' Loaded module 'LogCount_func' from file 'C:\Program Files\FME\plugins/LogCount_func.dll' FME API version of module 'LogCount_func' matches current internal version (4.0 20240212) Additionally, when using a PythonCaller with arcpy, I can confirm that the Python Factory locale is being flipped from UTF-8 (German_Austria.utf8) to ANSI (German_Austria.1252):import locale print("Startup locale:", locale.getlocale()) import arcpy print("After arcpy:", locale.getlocale()) Output:Startup locale: ('German_Austria', 'utf8') After arcpy: ('German_Austria', '1252') This matches the warnings shown in the FME log:PythonFactory script changed the current FME process locale from 'German_Austria.utf8' to 'German_Austria.1252' and FME has restored it back to
Dear community, I am trying to activate a workspace when a survey123 form has been edited and the user confirms that all necessary information has been completed (yes/no field). The work space would then extract data from ArcGIS online feature layer of incidents and the relevant repeat tables. The extracted data would then be used to populate a MS word template which once complete would be saved/exported as a pdf document. This pdf document would then be attached to an email and sent to the manager of who filled in the survey123. My main problem is trying to find a way to fill in the relevant field in the template with the extracted information from the ArcGIS online layer. Is there a transformer or series of transformers which make this possible? Thanks in advance.
Hi,We are trying to use a FileCopy Transformer to transfer files from one location to our server (synology) / other computers (other computer).If we do it in Ubuntu GUI / SystemCaller command it works perfectly.But the file copy transformer always give error messages as we don’t have sufficient permission. Even if I put our NAS credential in the transformer (with a featureWriter), it give the error messages. The files are created in the server but there’s no content inside.Does somones already experienced it ?Thank’sSam
Hi community,how can I set a NoData value for the pixels that are located outside my geographic area of interest?Attached you can find a GeoTIFF file:https://we.tl/t-XjrxojSLZhThanks! 🙏
Hi, I’m trying to generically read some tables and distribute them into different DWG Object Data layers. For this, I have a mandatory attribute containing the output layername.I use a SchemaScanner with a Group By on this attribute to generate the schemas and finally write everything using a dynamic DWG Object Data Writer.But it doesn’t work, I get a Layer 'XXX' is not definedBut(bis) if I use another DWG writer (e.g. RealDWG) with the exact same configuration, it does work.I guess the difference comes from the Object Data table definition? But I have no idea how to do that. I’ve tried to sort schemas and features to make sure that the schemas arrive before the features but it doesn’t change anything.When using the RealDWG Writer, if the parameter Output Schema Before Data Feature is set to No, I get the same error, but once set to Yes, the file is written without problem. What should I change when working with a AutoCAD Object Data Writer? Any help appreciated. Best Regards, Julien F
Hello, I am using FME Form 2024.1 and have the Esri ArcGIS Connector Package (version 3.11.3). I am experiencing some weird datetime functionality. I have a Portal Feature Service Reader (old school) in my workspace and would like to upgrade it to the new ArcGIS Feature Service Reader. Setup was great and reading the data worked well, but I noticed that any datetime attributes that come through are now being read differently. I have attached two screenshots of two datetime attributes that are being read differently depending on their Reader. The old version looks correct, you can generally start to make out the date for a feature (20250906), but the new way of reading looks completely different.Is there a setting I missed when setting up my new reader, or is this some new format? At first I didn’t notice this, but when I went to write the data back to Portal after passing it through my workspace, I got an error regarding these attributes (basically saying they were invalid)DateTimeConv
Question:I need to generate a square georeferenced PNG where: the interior of a geographic region is transparent, the exterior is filled with a solid color (e.g., gray). Currently, I have two geometries in EPSG:2056, which I merged using a junction node.How can I produce a single georeferenced PNG with these properties?I’ve attached my script and the two input files.
hello , How to use textures for different meshes of the same model in the PythonCaller converter?
I have a point layer, and within this layer I want to search around each point for those that are within 5000 m. For this, I used the Neighborfinder with "candidate only." It outputs a list with points that sometimes have 8 neighbors. In this list, I would like to keep either the initial point or the neighbor with the highest value in the TEST field. I'm stuck. I attached an image of the result and circled in red the points I’d like to keep.Moreover, the Neighborfinder transformer says it does not compare a point with itself, but I notice the opposite. Could you please help me?
Hi,I’m trying to modify the output file of a workspace using a Python shutdown script before it’s caught by the download service (or after, but before downloading). Is there any way to do that?The configuration is:workspace creating an output text file (interlis) workspace added to a Flow app with a download serviceI’ve tried to use the destination dataset parameter from the writer but without success. The script is :import fmedest_dataset = fme.macroValues['DestDataset_Interlis']with open(dest_dataset, 'r') as file: filedata = file.read()filedata = filedata.replace(',', '.')with open(dest_dataset, 'w') as file: file.write(filedata)Or if you have any clue on how to force an Interlis writer to use dots instead of commas as separator without changing the server locale, I’ll take that info as well. FME versions:Flow 2023.1.1.1 Form 2023.1.1.1 Best regards,Julien