Data

I have many parquet files stored in an s3 bucket; when I use the s3 connector to download the parquet file, I am able to read it successfully, but passing the s3 uri (“s3://”) raises an error: PARQUET reader: PARQUET reader: Failed to open file 's3:\my-bucket-s3-test\fme-test\test.parquet' for reading. Please ensure that the file exists and you have sufficient privileges to read itFailed to obtain any schemas from reader 'PARQUET' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more information When I try to pass the url: PARQUET reader: PARQUET reader: Failed to open file 'HTTPS:\s3.us-west-2.amazonaws.com\my-bucket-s3-test\fme-test\test.parquet' for reading. Please ensure that the file exists and you have sufficient privileges to read it When I use the feature reader, regardless of whether or not I specify a web connection, it converts forward slashes to back slashes. How do I work

Hi, I have downloaded, installed and uninstalled all versions of FME Form from 2024.0 up to latest 2024.2 and still having issues reading and or creating a new reader from Microsoft SQL Server. Every time I create a new and or update reader transformer, the reader disappears. Same when I create a new reader, it never show up. I have another machine that runs (2023.1.1.1 (20231011 - Build 23636 - WIN64) and it runs fine. I want to update my version as this old version is unable to read from Amazon RDS. Has anyone experienced this or experiencing this? Update * after further investigations. I have found the below. There seems to be incompatibility with the versions and I could not find a version that can read both version of MSQL. Microsoft SQL Versions FME Form 2023 (x64) FME Form 2024 (x64) Microsoft SQL Server 2017 - 14.0.3480.1 (x64) TRUE FALSE Microsoft SQL Server 2019 - 15.0.4410.1 (x64) FALSE TRUE

Is it possible to know that the relationship class "C04_EjesVia_LS_Rel" links the feature class "C04_EjesVia_LS" with the annotation class "A04_EjesVia_LS"? Any specific Reader configuration or attribute that I'm missunderstood? I attach FGDB sample.

I have a Geometry column that includes an easting and northing that is separated by a space in the middle as follows: I want to split this data up so that eastings go into one column and northings go into another. I have tried using an AttributeSplitter with a space as the delimiter and then a ListExploder to view the results but unfortunately this doubles the number of records in my data instead of creating two unique columns. How can I create two separate columns from my data?

Hi, i’m working on water treatment facilities. I’ve to categorize them in order to write a excel file which lists the existing and some deliverable. I’ll try to explain the best i can : basically the data are from a gdb, i’ve a tester to sort depending on categories. Some cat can have missing/null values, i need to “force” those missing values into the translation in ordrer to write the corresponding categories in the excel files. my situation now is that the missing values given they’re not written shift the writting in my writer and then do not correspond with their according row. i’ve 9 differents categories so 9 row but when i’ve just 5 filled categories, i’ve those 5 written but it change the alphabetical order in the written row so the categories dosent match the row. How can i say to the translator “if i’ve no values write the default value “0” else “no action”” Thanks, hope i’ve been clear enough

Hi All, We are currently working on Maximo connector transformer(s), and have been successful in connecting and querying a Maximo database. However, there is an incredible amount of functionality available through the APIs, and I would like to initially concentrate on what is most useful to our users. So I am requesting your feedback on how you would like to use FME with Maximo. Do you want to add Assets or Work Orders? Do you want link Maximo info to your GIS or BIM data. Do you want to do complex queries? This is a chance for you to shape the design of a new series of transformers. Detailed uses cases would be greatly appreciated.

Hi all, I am experiencing an issue with writing dynamically to SDE for large datasets (i’m unsure of the exact number, but above ~5000 features seems to cause a fail). My flow reads in a dataset name from an SQL table, matches it to a dataset that has been downloaded as part of a previous flow, checks if it has been updated and if so drops and recreates the Feature Class using a name given in the SQL tables. When running the flow in batch using a Workspace Runner, ~half of my datasets ran successfully, and ~half failed to be updated in the SDE. I have looked into this is some depth and the only pattern I can see is the datasets that are failing are larger. The error message I am getting is below. I have tried using a sampler on the data just before the FeatureWriter and the flow works correctly, which validates my findings. What could be the potential reasoning behind this behaviour? or has anyone else experienced similar? If there are any other suggestions of settings I could change t

We have several FME Server services that runs nightly to update hosted services. This all works well but every month or two the services all fail because they have lost their authentication to AGOL even though there were no account changes. I can re-authenticate the connection and then the services run for a month or two and then they lose their authentication again. Is there a way to set up the authentication so that they do not have to be periodically re-authenticated? Thanks in advance, David

A bit of a subjective question, but what are fast file-based geospatial data formats to read in FME? I have a set of geodatabases (10GB) covering the whole country, and it’s located locally on the C-drive of the FME Flow server. Users specify a bounding box to extract the data for their area of interest.To make the current setup faster, I have played with indexes and made sure that I’m doing a bounding box intersect on the FeatureReader, etc. But it still takes at least 10-15 minutes to get the output. One other idea that I’m playing with is to use a different format for the source data instead of geodatabase. GeoPackage got a mention somewhere; FlatGeoBuf apparently is fast; and I have heard good stories about GeoParquet. Any other formats I should consider?Has anyone done any comparison on this? Any pitfalls / drawbacks I should be aware of? At the moment I’m looking more at file-based formats, as formats that require additional (database) software would involve IT too much. I will d

Hello , I need a help I successfully updated a point geometry in the ArcSDE writer within a specific version. I encountered an issue. When I select "Update Mode" and set "Row selection - Columns " to ObjectID, I get an error translation running . But if I leave "Row seletion - Columns" empty, the translation runs successfully. The "Row selection - Columns " field turns red when left empty, and I’m unable to click "OK." To work around this, I temporarily set "Row Selection - Columns" to ObjectID, click "OK," and then use a Remover transformer before the writer to remove ObjectID—and when I run the workspace ,it works great and translation is successfully . But ’m unclear on how FME identifies the correct point to modify it ,how to resolve my issue ? Update Spatial columns : Should be yes or no ? FME version: 2021, 64-bit. Thanks in advance

I would like to use 2 UserParameter values as attribute names in my workbench. Is this possibe? Current situation: What I would like to have:

Hi everyone, I’m working on an FME workbench where I download a full dataset file geodatabase daily. I also have a CSV file that lists daily changes. My goal is to remove files from the main dataset based on the CSV and add updated files from file geodatabase back into the main dataset. I’ve tried using the FeatureMerger and FeatureJoiner transformers to identify changes, but they were not effective due to time constraints. Since this needs to be done daily, time efficiency is crucial. Do you have any suggestions, Python scripts, or SQL queries, or any other ideas to speed up this process? Thank you!

Hi, Is there a way to remove build pyramids when converting geotiff images to mbtile? I just need the image to display and improve mbtiles creation time

Snowflake recently released their new "geometry" data type. Not to be confused with the existing "geography" data type. The geometry data type can contain geometries in other coordinate systems, not just WGS84. Whereas geography is specifically WGS84. See Geography vs Geometry data types documentation here Geospatial Data Types — Snowflake Documentation When will FME support writing of the new snowflake geometry data types? Is there a way to do this right now, or will it be a future release of the Snowflake Spatial writer?

I am reading dynamic data and sometimes there is text fields that contain newline characters and I would like to replace them with just a space. How would I go about this?

Hi all, I see some strange behaviour when converting a simple 2D box from PostGIS to Geopackage in a dynamic mode (using schema). I have attached a simple workspace which demonstrates the strange behaviour. A simple box is created in 2D and writen to PostGIS as a postgis_polygon. I ckecked the table in the database and is has the correct definition for the geometry (geometry(Polygon, 28992)). After the creation the table is read wit a FeatureReader of type PostGIS with the same connection parameters. It is set to read the schema and the features. The result is directly written to a geopackage with a FeatureWriter. Geometry is from schema definition. When i open the result in the Data Inspector i see the geometry type has become geopackage_multisurface where i would expect it to be of type geopackage_polygon. At the moment we are upgrading our FME environment (Form and Flow) from FME 2021.2.6 to 2023.1.2 and ran into this problem. In FME 2021.2.6 i did not see this behaviour. This parti

Hi, I have a annotation class in a file geodatabase. I want to convert it to a polyline or point in a file geodatabase. I could not fine any transformers in FME. I really appreciate your assistance.

Hi I have a requirement to connect to the new Ordnance Survey (GB) WFS service in FME, their system responds with 100 records at one time, there doesn't appear to be an option in the reader to facilitate this paging implementation as in other products Any help to be able to access this API would be greatly appreciated

I have a list of Attributees{}.name That contains attributes for each feature. the element count is variable. I am also using the ListElementExtractor and like how it works but i need from 15-258 attributes to put the list into.is there a way to get the list values out as attributes? or at the very least mmake the list populate (i.e. attr1, attr2, - attr258) in the destination attributes? I am reading the schema from a (blank) gdb with coded domains and WAY too many attributes to use AttributeManager. the purpose is to get the attributes with the correct domain and values so a different schema can be fed into this format and output as gdb with domains intact.

Hi Everyone, I am working on a project for school and am reading in CAD data and outputting it as GIS data. However, the File Geodatabase writer is not outputting any features. I am setting it up how I’ve always done it in the past, but it is not creating the GDB where specified as the translation log says no features are being written. I have no clue on why this is happening nor how to fix it, so any help would be appreciated. Thank you in advance.

Hi all, I would like to use an existing FME reader to open a file with an unsupported extension. Is there a workaround to achieve this? Alternatively, how can I clone an existing reader and modify it to support the desired file extension? Thanks a lot! 🤓 hp

Hi, I have a layer with closed polygons. On top of these polygons lies a layer with smaller areas. These areas are divided into 3 types.Each type of area needs to be assigned a year, and the total area per table type should be approximately equal within the larger area.How can I create a distribution where each type of area is used, and the total area of each type is approximately equal? How could I achieve this with FME?

I’m encountering this error and am at a loss. Everything in workbench (SQLCreator - Attribute Mgr - Excel Writer) seems to work fine, up until it gets to the writer. Excel Writer: Failed to write an attribute of type 'string' with value 'XMLDATA' to row '0' column '-1015942868'. Error message is 'col must be in range 0-16383'. Skipping feature Writer Mode: Update Output Field Names: Yes Formal Field Names: No Use Attribute Names as Column Positions: Yes Start Position: Start Column: 1 Start Row: 1 Any suggestions?

I am working with a script that transfers data from one SDE to another SDE. Currently, the script does not ensure that the relationship between a feature and its attachment remains intact. To address this, I extended the workspace based on the guidelines in this article: Writing ArcGIS Geodatabase Attachments. This solution worked fine when transferring data from one GDB to another GDB using the same data model. However, when we run the script from one SDE to another SDE with the same data model and data, it fails and I encounter the following error messages: Failed to retrieve origin row for a relationship feature with OBJECTID '3' from table/feature class 'BAGGERWERK_WATERLOPEN' GeodatabaseRelationshipFeaturesPipeline::GeodatabaseRelationshipFeatures (SortFactory): A fatal error has occurred. Could you provide guidance on how to resolve this issue?