A space to discuss FME Form
Recently active
I have used a PythonCaller to flatten a xml dataset and have many handfulls of attributes that need to be exposed. Cutting and pasting into the AttributeExposer does not feel appealing. Surely there must be an easier way to do this? After all the features already have these attributes, only they are set to be Unexposed. It should be just a hide-unhide setting that is needed?
Hi,I recently upgraded from 2025.1.1.0 b25615 to 2025.1.3.2 b25646 and noticed that whenever I open a .fmw file, a new folder, “.sentry-fme” is created in the same directory.When I started FME from my desktop shortcut, a “.sentry-fme” folder was created on my desktop once the program was up and running.Could we get this fixed? I’d rather not bloat my directories with temporary files if I can help it. I’ve since downgraded back to 2025.1.1.0.Thanks,
I’ve been experimenting in FME and reading some conflicting data on this but it seems like there isn’t a way to publish from FME to AGOL raster data without the image license for ArcGIS online. Either AGOL stores it as an image file or FME will store it as a BLOB. I’ve tried using the pythoncaller and httpcaller to no avail. Anyone know any other workaround / have experience here?
Hi FMEers.I have an interesting task and thought I’d come directly to the experts for advice! I want to pick a random position on Earth, but it has to be on land. How would you go about it?The obvious route is to simply pick a random coordinate, repeating the process if it doesn't fall within a land boundary. That seems inelegant. Alternatively, maybe I could use H3 hexes? Generate all level 15 hexes over land and pick one at random. That seems slow.I'm open to any suggestions. I want lat/long coordinates to about 7 decimal places, and I need it to run (on Flow) in around 1 or 2 seconds.Thanks for any suggestions.Mark
I have a list of client records with a start-date and an end-date. In some cases there are multiple lines for a client, identical except for start-date and end-date. I need to somehow either concatenate them into one client record which contains the minimum start-date and the maximum end-date from each of those client’s records, or create a new client record for each client with the minimum start-date and the maximum end-date. All other data can be discarded in the process.For example, I start with:JohnDoe, startdate: 1 Jan 2024, enddate: 1 August 2024JohnDoe, startdate: 3 Mar 2024, enddate: 31 August 2024JohnDoe, startdate: 3 Mar 2024, enddate: 15 Dec 2024DavidSmith, startdate: 1 Feb 2024, enddate: 15 Oct 2024DavidSmith, startdate: 3 Mar 2024, enddate: 18 Oct 2024 And I want to end up with:JohnDoe, startdate_min: 1 Jan 2024, enddate_max: 15 Dec 2024DavidSmith, startdate_min: 1 Feb 2024, enddate_max: 18 Oct 2024 I have managed to create a really intricate and clunky solution which kind
Good evening,I am wondering what the community thinks about this situation:FME Form 2024.1.3.0 (20240927 - Build 24627)Writing to Esri Enterprise Geodatabase (SDE) 10.9.1 - MS SQL Server 2022I have almost 700,000 records that need to be written out to our SDE into 1 feature class.Currently I have 1 Writer using the Esri Geodatabase (ArcSDE Geodb) format.The 1st attempt to write the data failed after 22 hours because I had a loc on the destination feature dataset. doh!On the 2nd attempt to write the data to the SDE, the job has been running for 12 hours. I cancelled the job, and below are snippets from the logfile highlighting how many records have been written, and how much time passed. This shows a pattern that: as time progresses, the processing time is becoming exponentially longer. I am thinking of breaking the data into 100,000 chunks, with the first chunk first truncating the table and then loading, and the sequential chunks appending to the table.Is this performance hit expe
I am trying to validate some properties of objects in DWG files, and some of the things I’d like to check require me to know what paper space viewport an object is visible through, but I have been unable to get the autocad_viewport_handle attribute to show up.I’ve tried a few combinations of reader parameters, including checking all boxes in the “Model and Paper Space Options” section, unchecking some options while leaving “Read Model Space Entities Through Viewports” checked, and tried reading multiple DWGs, but so far I have not had any luck. I am thinking this must be a “me” problem, but I’m kind of at a loss. Is there a certain set of parameter settings required to get autocad_viewport_handle to show up? I am setting the reader to expose the attribute, but so far, it is always missing. I’m using FME 2025.0.
Hi all,I hope all is well! I am very new to FME and data products.We use FME 2022.2 but we thought it will be time to upgrade to the latest version to benefit from the updates.I have installed 2025.1 and the first thing that I can see is the reader format has changed I would use “Microsoft SQL Server Spatial” in 2022 but in 2025 it is “Microsoft SQL Server (MSSQL)”I would assume they have aggregated both non-spatial and spatial into one reader format.I go to add the connection that we normally use - in this case it is called GisAzureView which is a hosted server for us. I would then need to select which tables I would like to read from but I get this error: 2025.1 Error when reading hosted SQL database“Failed to obtain any schemas from reader 'SQLSERVER' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more information” - is the error that comes up - so it is failing to open the reader
We upgraded FME from 2022.2.2 to 2024.0.2.2 one week ago, and I found out today the SQLExecutor gives an error for the SQL Server T-SQL Merger statement. The SQLExecutor is set up as follows:----------------------------------------------------------------------------------------------------------FME_SQL_DELIMITER ;use VENDOR_GLOBAL_SPGI;MERGE INTO SPGI_INT.BLOCKS_VALID_INT AS tUSING (select distinct GA_ID,BLOCK_NAME,ONS_OFFSHORE from SPGI_INT.BLOCKS_VALID) AS sON t.GA_ID = s.GA_ID and t.BLOCK_NAME = s.BLOCK_NAMEWHEN MATCHED THEN UPDATE SET t.ONS_OFFSHORE = S.ONS_OFFSHORE;--------------------------------------------------------------------------------------------------------It gives this error:Microsoft SQL Server Non-Spatial Reader: Query failed, possibly due to a malformed statement. Query Text `MERGE INTO SPGI_INT.BLOCKS_VALID_INT AS tUSING (select distinct GA_ID,BLOCK_NAME,ONS_OFFSHORE from SPGI_INT.BLOCKS_VALID) AS sON t.GA_ID = s.GA_ID and t.BLOCK_NAME = s.BLOCK_NAMEWHEN MATC
Hi All,We have deployed FME Flow 2024.2.2 with ArcGIS 3.4 and wanted to run a few tests to ensure that Flow works correctly with the arcpy library. Below is the installation setup on the same virtual machine:FME Flow 2024.2.2 ArcGIS 3.4I have created a very simple Workbench in FME Form that invokes arcpy, and it works fine with the following Python compatibilities:Esri ArcGIS Python 3.9+ Esri ArcGIS Python 3.11I uploaded the same Workbench into FME Flow 2024.2.2 and encountered the following error after running the tool:Any idea? I have tried with 3.9 and 3.11 already,Thanks in advanced :)
Hello,Created a nice workbench with FMe. However, there are also many individual points in the data, which are poorly visible.Which transformer can you use to replace a point in the data with a symbol (e.g., a circle with a specific diameter)?This improves clarity and better visualization in the final result.
Yes he does have hallucinations ! This transformer doesn’t exist. I wish it would though.
I’ve been needing to identify leading and trailing spaces across many attributes, with a significant number of features. I don’t need to trim them, but rather identify their existence.The only solution I’ve been able to come up with so far is to use AttributeValidators - this way, I can set it to run against the 50 or so fields that need to be validated. I’m using Regex and the rule “^ +” for leading spaces, and a second AttributeValidator with the rule “ +$” (double quotation marks only for readability here, not used in the Rule Configuration) for trailing spaces.This works, but it is very slow. Is there a better way to do this within FME, without resorting to some Python?Thanks in advance for any thoughts on alternative approaches!
Hi I am uploading data to S3 using the S3 connector. However, empty folders are not being uploaded, even though I have selected “Contents only” as No. I need to upload some projects that contain empty folders and subfolders as well.!--startfragment> Many thanksNasir
Is FME able to read the MicroStation DGN file geographical coordinate and use this information when creating esri geodatabase features? I see several tutorials and methods that seem to suggest CAD data such as DGN (MicroStation Design Files) do not contain geographic Coordinate systems but is not totally true. Design files do or can have coordinate systems, and most do when relative to Transportation Civil Engineering Design.
HiI have a a workflow exracting data from an API. I have got almsot everything I need from the JSON but need to get as single description field. The JSON structures breaks the description into sever parts all nested within the description part. The number of parts varies by feature.I essentially need all the text elements in the image below When I use a JSON exposer it asks me to specificy each indexed element, but I do not know how many there will be in any given feature I imagine there is something really obvious I am missing hereClosest I have got is adding another JSON extractor using the query:json["fields"]["description"]["content"][*] is giving me:{"type":"paragraph","content":[{"type":"text","text":"This Jira ticket is for all activities related to the implementation of 365 – "},{"type":"text","text":"Office.com","marks":[{"type":"link","attrs":{"href":"http://Office.com"}}]},{"type":"text","text":" rollout."}]}Or using:json["fields"]["description"]["content"][*]["content"][*
I have two tables where I have to compare rows against columns. First table (excel) contain Analytes as columns, but the second table (sql) has analyte column which contains all the analytes as values. I have to compare the values from the Excel table (which has analytes as columns) with the corresponding limits from second table.Example of first table:Example of second table: I have tried couple of methods such as attributepivoter ,doing it via the pythoncaller but was not successful
Hi FME users,I am creating an automatic workflow to download GTFS (Transport Data) by HTTP caller. The zip file contains few CSV files which I need to read them separately for my workspace. The issue is I cannot reach each file through the zip folder by using Feature Reader. I want to avoid unzipping manually as I want to create an automatic workspace. Can you please advise on how to solve this issue? Appreciate your help.
I am reading data from SQL Server that is in the default dbo schema. I want to write the data into a specific schema in postGIS.But i struggle to make to do this as a dynamic workbench.The setting is to Always create tables. The table is created as expected (dbo. is replaced with correct postgis schema name in StringReplacer).But i get an error trying to write featurePOSTGIS Writer: Fanout for feature type '' failed to find feature type template ''Seem to be a missmatch between the schema feature and the feature itself?
I have an odd problem. I have suddenly lost the ability to view the lists on my objects in the “feature information” pane. They are indeed there, I can search and explode them, but for some reason -mid working on this workbench- I have suddenly lost the ability to see my lists.I am in version 2024.2. I havent found anything helpful or related online yet so thank you if anyone is able to assist. created list ^ no list visible ^ I am ONLY able to see the lists in the “Found” port of a list searcher, but in NO other occasions can I see them.
Hi,I've been trying too use autocad_xref_path and autocad_xref_name to insert file (another dwg) into REALDWG writer feature type. It should be basic. But it's not working. No warnings, no errors.Did anyone succesfully managed to do that? Can you explain me what am I doing wrongRegards,Želimir
Hi, Has anyone had any issues placing in 3D symbols via cell file into FME DGN styler? It seems as soon as a solid or surface is involved the symbol dies not show correctly i.e these elements are missing. any advice thanks?
Hi,HELP. experiencing issues with cells in dgn styler.Can FME dgn v8 writer output solids? I am using dgn styler to input graphic cells from .cel file but seems like data is lost on output. When lines are used within the .cel file lines change colour within the output also. Please advise. I read about named and unnamed cells what is the difference? When I add the cel file to dgn writer elements go missing and colour of symbol is altered! In the writer I am using v8 seed file as provided in fme install. Am I missing anything had anyone wise have cell dgn styler experience?
I’m running FME 2024 soon to be 2025.My workflow is reading tables from SQL Server and writing them to Snowflake.Can someone please advise if it is possible to have the workflow automatically handle new columns being created on the source table?I don’t want to have to publish a new version of a workflow just because a source table has a new column added to it.Thanks in advance.
Hi,I have 3 raster’s that I wish to merge into one. Two of the 3 are of the exact same extent, cell size and CRS. The third has a larger extent (but overlapping the first two) and a smaller cell size. The issue I am having is that once I have resampled and clipped the 3rd raster to the extent of the other two they are mis-aligned, and I can’t figure out how to fix it. I need them to be exactly aligned so I can merge them. So far this is my method:Read in all 3 raster’s and ensure their CRS is the same (Using ... Resample the 3rd raster to the cell spacing of the other two (5000 x 5000) Raster 1Raster 2Resampled Raster 3Clip the 3rd raster to the extent of the other two:I use RasterExtentsCoercer for one of the first two raster’s (as they have identical extents). Set extents type to ‘Data Extents’. As I want the data extent clipping not the outer extent rectangle. Then using clipper with the output of RasterExtentsCoercer as ‘Clipper’ and resampled 3rd raster as the ‘Candidate’. It is t