A space to discuss FME Form
Recently active
Hi,I’m getting data from a streaming source (Kafka) that contains multiple geometry per feature read in WKT. To process the geometry, I “desaggregate” the feature first, produce a geometry from the WKT string, then try to aggregate it back with the Aggregator transformer. As stream processing doesn’t allow blocking transformers, I have set the Group Processing parameter to “When Group Changes”.My issue with this solution is that the feature leave the Aggregator only when effectively, the group changes which means when a new feature is read… I was wondering if there was a way to force the output of the latest feature, or if it was possible to make the process “Desaggregate/Produce geometry/Aggregate back” treat one feature per feature. Edit: this is most probably possible with a PythonCaller, I’m wondering if there was a “native” solution.
Hello, What is the best way to extract metadata from a shapefile? This would include Title, Tags, Summary, Description, Credits, Field Names, and Summaries. I want to export the metadata to an Excel spreadsheet.I am looking for some ideas on what transformers to use.
Hi,My goal is to read multiple (unknown) Hosted Feature Layers (HFLs) from an AGOL group and write those to ArcGIS Enterprise (11.3). I can successfully specify a single HFL in my FeatureReader and using an Automated schema in my FeatureWriter, specify each individual layer and write it to Enterprise. As I need this to work for multiple HFLs, most with multiple layers, I need to use a dynamic schema in my FeatureWriter. As soon as I do this, my workbench fails. Every time I switch to a dynamic writer, using the fme_feature_type as layer name and schema from schema feature, the workbench fails due to these errors:Message Type: fme::internal::_v0::py::ExceptionPython Exception <KeyError>: 'My_HFL_Name'ARCGISPORTALFEATURES writer: An error has occurred. Check the logfile above for details I’ve tried everything I can think of to get this working and cannot understand what I’m possibly doing wrong. Any help would be greatly appreciated. My workbench (so complex...) AGOL HFL FeatureRea
In the exercise: "Add Appearances to a 3D City Model" I have a problem with the "AppearanceSetter" transformer because I cannot get the colors in the buildings in the PDF output, as described by Liz Sanderson. I always get them in RED in both cases, namely: "AppearancesRed" and "AppearancesBlue". I have run the workspace as I downloaded it but both types of buildings always come out in RED in the PDF.https://support.safe.com/hc/en-us/articles/25407543263373-Add-Appearances-to-a-3D-City-Model
Bonjour,je veux d’automatiser le téléchargement et la mise à jour des données accessibles via les plateformes de diffusion de données géographiques (IGN : BDTOPO, BDCARTO, etc., OSM, DREAL…).Actuellement, je travaille sur la partie automatisation du téléchargement dans FME, qui consiste à moissonner ces données. J’ai déjà fait quelques avancées, mais je sollicite votre aide sur des conseils; liens utiles ou des pistes afin d’approfondir mes travaux..En vous remerciant d’avance.
Hi,When using HTTPCaller with an authorization header with a bearer token, the token appears in the log.How can I prevent this ?I’m using FME desktop and server version 2021 so LOG_FILTER_MASK doesn’t work. Updating the version is not a solution. The bearer token is obtained at runtime so I can’t put it in a private parameter (PP cannot be updated at runtime).Thanks.
Bonjour, Je rencontre des difficultés depuis plus d'une semaine pour lire et transformer un fichier raster étendu au format ECW (orthophotographie avec une résolution de 5 cm et une taille de 30 Go) sur ue version FME 2020. Je sollicite des aides.Merci d’avance Mouhamed
In some tables stored in an Oracle database there are more than one spatial column.The reader can't read all the spatial columns but it reads onnly the first column it encounteres.how to read an Oracle multi spatial column table with FME Workbench?Emilio De Palma
I’m wondering whether the dashboard workspaces for various versions are available online anywhere.I note that this question has kind of been asked before for a couple of reasons, most commonly that a restore and overwrites the dashboard workspaces of a new FME Flow installation.While it’s probably best practice to download the workspaces before the restore occurs, with the best answer for the previous question was for the workspaces to be attached (attachment is no longer available though), I’m wondering if it would be possible to have some hosted or available online, potentially via the FME Hub.As always, thanks in advance.
Hello!I generated a CityGML building model from an fbx model. The model could be opened in FZKViewer but the view is very strange. I could see the textures in the back when I am on the front view. It is like the surface in front of me becomes a very transparent glass.This happens at all of the sides of the model except the roof and ground surface. When I turn off the texture, everything is back to normal. Is it the problem of the texture? How could I check if it is on the texture and how could it be fixed?
Hi community, I am using FME Workbench 2024.1 to create parquet files. Those files contain DateTime columns. It seems as those DateTime columns are missing a codec flag in order to enable the loading in other software (Dremio in my user case). Using parquet-tools we can see the problem:java -jar parquet-tools-1.9.0.jar schema ~/Downloads/part0.parquet can not read class org.apache.parquet.format.FileMetaData: Required field 'codec' was not present! Struct: ColumnMetaData(type:INT64, encodings:[RLE_DICTIONARY, PLAIN, RLE], path_in_schema:[_transaction_ts], codec:null, num_values:66, total_uncompressed_size:95, total_compressed_size:113, data_page_offset:35, dictionary_page_offset:4, statistics:Statistics(max:EC 90 D1 36 42 42 10 18, min:EC 90 D1 36 42 42 10 18, null_count:0), encoding_stats:[PageEncodingStats(page_type:DICTIONARY_PAGE, encoding:PLAIN, count:1), PageEncodingStats(page_type:DATA_PAGE, encoding:RLE_DICTIONARY, count:1)]) I include here a small parquet example with two date
Hi all,I’m looking for assistance with calculating the Internal Rate of Return (IRR) in FME for a dataset containing annual cash flows grouped by a RecordID attribute.I’ve attached a sample CSV file ("Annual_cashflows_by_RecordID") that includes the data I’m working with. Each RecordID represents a unique group of annual cash flow amounts. My goal is to calculate the IRR for each RecordID.From my research, it seems the best approach is to use a PythonCaller transformer, but I’m not familiar with Python coding or how to configure this transformer for the task.If anyone has experience with similar calculations or can provide guidance on setting up the necessary transformers (or Python script), I would greatly appreciate your help!Cheers,
I have a workflow that assesses the proximity of points along lines. These points extend along a series of line segments of varying lengths. For instance, the distances to the next points might be 0ft (the start), 100ft, 100ft, 200ft, and 250ft, so I would like for the corresponding field next to these values to display 0ft, 100ft, 200ft, 400ft, and 650ft, etc. I am aware of the workflow to find cumulative sums (Attribute Creator>Statistics Calculator>Attribute Renamer). While this processes as described, I regret that the cumulative sums do not “reset” when there’s more than one batch of point data within the feature table (the initial point of an additional batch of points simply takes the prior set’s end sum and begins adding new distances from there). If there’s a way to prompt the cumulative sums to account for new “initial” points in a feature dataset and so start from scratch each time, I would greatly appreciate any insight on how to prompt that to occur. I’m happy to sha
I have a requirement to modify the list attribute generated on schema port.Lets say my schema scanner have default attributes name, fme data type and native data type.I want to look on name attribute and find any of its elements have OBJECTID string and remove if it is present.I try to modify list attributes using python caller. It modifies the list elements when I overwrite using feature.setAttribute method it is not working and returns original schema attributes unmodified. Any help using python would be highly appreciable.
I’m trying to output all property sets from IFC files into separate Excel sheets. So far I’ve found all of the property sets, their attributes and their attribute values. This is my data:What I would like to do is transpose this list into separate lists for each property set like so: After that I could simply write each list to separate Excel sheets, but this is where I get stuck. I create the sheets by feeding the writer from a DuplicateFilter, but how do I join each PsetAttribute to Pset as well as transpose the data so each PsetAttribute is a single column?I need to do it without knowing the exact names or number of property sets existing in each IFC file as well.
Hi, I have a lot of polygons. I want to identify these ones who contain arcs.option: the polygon is made of lines onlythe polygon is made of lines and arcsI want to filter out all the polygons that contain lines only (option 1). I want to keep the ones that contain arcs (option 2). I tried the geometry property extractor but all polygons are always rejected : MISSING_GEOMETRY_PROPERTY as the error message. I don’t understand why. pls advise.
"Failed to free sufficient memory to reach the process usage limit"This warning is appearing my log files. What do I need to do about it? What is the potential impact if nothing is done?As far as I can tell there is nothing wrong with the output files the script is creating.
Hi,After a migration to Office365, FME is unable to open Access files. The following error is given:Microsoft Access Reader: Unable to find provider 'Microsoft.ACE.OLEDB.12.0', falling back to 'Microsoft.Jet.OLEDB.4.0'. The 2007 Office System Driver might be missing from your system; follow this link for more information: http://www.microsoft.com/download/en/details.aspx?displaylang=en&id;=23734Microsoft Access Reader: Connection failed. Connection string `Provider=Microsoft.Jet.OLEDB.4.0;Jet OLEDB:Engine Type=5;Data Source=K:\\dienst VR\\02_rapporten\\Lijst_SEVESO-inrichtingen 2016.accdb;User ID=admin;Password='. Provider error `(-2147467259) Onbekende database-indeling K:\\dienst VR\\02_rapporten\\Lijst_SEVESO-inrichtingen 2016.accdb.'We tried installing 2007 Office System Driver, as given via the link in the error message, but this did not solve te issue. The following error message still appears:Microsoft Access Reader: Connection failed. Connection stri
Host Revit file has 137 linked files. When I try to read even a small portion of these I get the error.Failed to obtain any schemas from reader 'REVITNATIVE' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more information.I’m using a FeatureReader linked to the Metadata.LinkedInformation output of the host Revit file (first strcating the LinkedFilePath and Name attributes). I get this error even when I limit the input to one record. Separately, a FeatureReader (along with Creator to initiate) can read one of these files. I saw a similar post where the answer was to change the FME_Temp folder. I don’t think this will make a difference since I get the error when only trying one file. I would try this but I need admin rights to set this up on my computer and I won’t be able to get that until next week. Also, I would rather know for sure before I ask. Thanks in advance.
Hello!I am new to using FME and I am working on converting an FBX file storing a 3D terrain model into a CityGML format. I have come across with two questions. How to generate a TINrelief from an FBX file in FME? Does a TINrelief have/need a GML/JSON encoding in CityGML/CityJSON for conducting further geospatial analysis? Can it be a TIN file or a Geotiff file?Thanks!
Is there a way to join two tables using the between operator (SQL). I know I can use SQLCreator but I would like to do this join directly in workbench. sql example: TABLE1.*,TABLE2.*FROM TABLE1LEFT JOIN TABLE2 ON TABLE1.NAME = TABLE2.NAME AND TABLE1.DATE BETWEEN TABLE2.FROM AND TABLE2.TO
Hello,I want to create a workbench for a datastreaming service, that will be call through fmedatastreaming.I want to test and call this service with a FME workbench including an httpcaller transformer.Il a want to pass information through an Upload Body. How this information will be pass and how to interpete this in the workbench of datastreaming? Do you have an exemple ? Thanks
I have a work process that inlcudes running FME jobs daily.I would like to automate logging of potential errors. To do so i am thinking of just reading the .log files from the workbench(es) and search for error as keyword to catch if something went wrong in the translation. I thought it would be straight forward to implement, but i cannot find a way to read .log files using FME directly. Instead I am thinking to use a python script. But I wanted to ask here if I have missed an easy method to check log files for errors.
Hi,I am using FME Workbench 2024. I am wanting to know if I can use a loop or iterative process of some sort to individually run multiple feature classes and shapefiles through a single AttributeKeeper Transformer for each data source, possibly using the names as an iterator. I am working on bringing in utility data from multiple sources and ultimately writing them to a single geodatabase feature dataset. First, I want to clean up the fields and only keep certain ones. Each source of data has a different schema. Currently, I can only use an AttributeKeeper on each feature class/shapefile in order to later output each to its own feature class in the output geodatabase. This would make for a messy workspace with many of the same transformers. Any advice would be greatly appreciated!
Hi All,I am working with lists and require some guidance on the below scenarioI have list which contains 'n' elements. I would like to add a sub-element to each element in the list.Assuming my list name called as "list{}"Example: (My list currently looks like this) List{0} element1 element2 element3 List{1} element1 element2 element3 List{2} element1 element2 element3 List{n} element1 element2 element3 I would like to add new sub-element called "element4" at the end of each list element (i.e., add "element4" as sub-element below "element3" ) Expected Output (I would like to achieve something like below) List{0} element1 element2 element3 element4 List{1} element1 element2 element3 element4 List{2} element1 element2 element3 element4 List{n} element1 element2 elem