Skip to main content
  • EN

FME Form

A space to discuss FME Form

10000 Posts
marjan_nikoukar
Contributor
marjan_nikoukarContributor
asked in Data
Convert Text file to CSV

Hi,I have a .add file that I just could open it as a text file in FME. Do you know anyway to read this file as CSV? Or a way to replace all spaces with one space?There are irregular spaces between them, and when I open it as a CSV, it is not a helpful file.I tried to use SrtingReplacer to replace many spaces with one space, but there are many different numbers of spaces in each attribute.Thank you for your assistance.

1161
jkr_wrk
Influencer
tschoppenhof
Contributor
tschoppenhofContributor
asked in Transformers
Is the FileExistenceChecker able to recognize url-adresses?

I tried the FileExistenceChecker to check fo a online xml-document but it seems that it can not check url adresses (result -> DoesNotExist). It didn't recognize an url-Adress that the xml-Reader is able to read (See attached Test Workspace). Any Idea what the problem could be?

512
helmoetz
Supporter
P
p.wintjes
asked in Transformers
Must be the owner to perform this operation

When reading FCL from ArcGIS sde database, also the information about the FDS in which the FCL resides is available in FME. There is no problem in writing it to another database in a FDS, even if this FDS does not exist in the target. If one would like to create the new FCL not in a FDS (in my case SQL server database) straight from the input, you will get an error creating a FDS.Geodatabase Writer: Creating feature class `ARCFMUT.FCL_BW_LOGGER' in feature dataset 'BW_intern.ARCFMUT.FDS_BW_DIVERSEN'An error occurred while attempting to create the feature class 'ARCFMUT.FCL_BW_LOGGER'. The error number from ArcObjects is: '-2147220969'. The error message from ArcObjects is: {Must be the owner to perform this operation.}After some time of investigating this issue, I concluded that the writer tries to create a FDS using the credentials of the reader, which of course did not exist in the writer, even if I explicit had left the field for a FDS to blank.My solutio

1757
sam_appleton
Contributor
alfons
Contributor
alfonsContributor
asked in Transformers
Reading Features with Feature Reader using a list for WHERE Clause

I have two feature classes (FC) that are linked by a 1:1 relationship. Both FCs contain about 4,000,000 objects, of which I ultimately need about 20,000 objects. I understand that I could join all 4,000,000 objects, but that would take a considerable amount of time, which I want to save.My idea is to select the required objects in FC A and create a new list using the join attribute. Later, I want to use the FeatureReader and a WHERE clause query to read and process the required objects in FC B. Unfortunately, I am having a problem with the creation of the WHERE clause, so no objects are being read.My workflow is as follows:Read and select objects from FC A Prepare the join attribute for the WHERE clause (add quotes) Create the list using the join attribute Convert the list to a string with commas as separators Read the objects using FeatureReaderEverything seems to work except for the last step. If I enter the WHERE clause manually (without the list), it works. Below is my current work

6131
s.jager
Influencer
vvaldor
Contributor
vvaldorContributor
asked in Data
Error Server codes '1003' and '1001'

FME Workbench ver. 2021.2.3, build 21812FME Server ver. 2021.2.3, build 21812Hi Everybody.Sorry for my Canadian French, I try to be correct as much as possible in English, you may notice some errors on my part.Yes, I know, we should migrate to FME Form/FME Flow. The steps have been initiated with our supplier but we must wait until the migration from ESRI ArcGIS Desktop 10.8.1 to the ESRI Enterprise 10.9.1 version is completed. Premises:We maintain data that we share on a feature service hosted on ArcGIS Online with a subcontractor (different types, SQL Server, GDB and Shapefiles); The address of the feature service must remain constant for the processing of our subcontractor; The initial creation of the feature service goes correctly (an FME Workspace process launched manually for creation; We must replicate the update autonomously on our FME Server (same version as the FME Workbench, 2023.2.3, build 21812) so that the data is up to date over a 72-hour period.The update workspace fail

2512
vvaldor
Contributor
saravanakumar
Supporter
saravanakumarSupporter
asked in Integration
trigger mail when my workbench face error in fme forms?

Hi All, I would like to know thatis there any possible way to trigger mail while running my workbench in FME Desktop/ Forms if it is facing a error?.FYI : I am using FME Desktop 2020.1.1 version. Thanks in advance!

536
saravanakumar
Supporter
myadegaryiutac
Contributor
myadegaryiutacContributor
asked in Integration
_response_body is not in JSON format

HiI am using the HTTPCaller to get the information from Issues page in Autodesk Construction Cloud (ACC).The AuthorizationToken has been created and looks good but once I am using HTTPCaller to get information form issues page,  the result created in “_response_body” is not in the json format so consequently I am not able to use JSON extractor Is there any step that I am missing?P.S:In “HTTPCaller4”in requested URL I used “https://developer.api.autodesk.com/docs/issues/projects/$(PID)/issues”*I have predefined $(PID) in User Parameter. In Header I used “Authorization Token” created in 1st stepThanks

1387
jkr_wrk
Influencer
stu_home
Contributor
stu_homeContributor
asked in Authoring
Is there a better way than using a ridiculous number of Feature Joiners?

Surely there’s a better way than this???I have a json file with lots of attributes hidden in lists. So I use 5 ListExploders to expose those attributes.The ultimate goal is to then combine all of those attribute fields into one massive table, using the unique identifier field of “NODE_ID”.As you can see in the screenshot the Node list then feeds into AttributeFilter to reduce the number of features a little.So far so good… but this is where it goes a bit mad. I then need to combine all of those 5 exposed lists into one table. FeatureJoiners are then used to try to merge the datasets together.Those in the left hand bookmark are joined using an inner join to try to get as many features with the same NODE_ID value combined into the same row in the table.Those in the right hand bookmark then use a full join to pick up any stragglers from the first bookmark.I have 200 JSON files to work on, and this example uses just one of them, so I have to try to account for all output ports, to ensure n

1349
thomasmarti
Contributor
J
jeremyalcorn
asked in Data
Writing data into an ESRI File geodatabase writing to a feature dataset

I need to set up a workspace to write a file directly into a specific Feature dataset within an ESRI File Geodatabase - is there any way I can set this up.

6843
weihong
Contributor
thomasmarti
Contributor
thomasmartiContributor
asked in Data
Reading RGB from ZFS Pointcloud

HiI got an ZFS Pointcloud (here) with integrated RGB colors. These are greytones (concrete) and visible in Autodesk Recap. From Recap i can export the PointClound to an e47 file and the colors are still included.But i got over 1’000 files, so I want to convert them with FME. With the ZFS Reader i can load the PointClound, filter it with the header information as decribed in the help (reflection), but the color is missing. Regarding the help, FME can read the color from an color file, linked in one of the header information, but I got no such files, the colors are integrated. How can I get access to these RGB values (color_red, color_green, color_blue)?

572
thomasmarti
Contributor
narinder
Contributor
narinderContributor
asked in Authoring
How do I get my FME workbench that uses 2 Readers pointing to SQL tables to be outputted to Excel template writer but the two outputs to saved to two different tab sheets.

I’ve got an FME workbench that picks up 2 seperate SQL tables in the two readers and the data is sorted and the filtered. It then needs to be output to an Excel template containing 2 tab sheets and save the data from each SQL table onto the separate sheets.Test copy of workbench looks like this:This first attempt only outputted the data from the first reader onto both tab sheets in excel.Then did this:So this did pick up both readers but instead of saving the one excel template with the data outputted to both tab sheets, it created to excel files with the data being populated on the tab sheet.Essentially I want to pick up both sql readers, sort them and filter them and then output to the excel template but the data gets saved onto sheet 1 and sheet 2 for example for each reader and then save the one excel file to the drive location!Am I missing a step or should i be using different transformations, etc?Appreciate any suggestions? 

462
ctredinnick
Supporter
lindsay
Contributor
lindsayContributor
asked in General
Read Excel File from SharePoint Online as Attribute, Rather than Downloading

I am trying to create a workspace to read the contents of an Excel file from SharePoint directly into memory to then operate on, rather than download the file to a temporary location first. I understand that I should be able to read files to memory by using the SharePointOnlineConnector with 'Action: Download' and 'Download as: Attribute' settings, and have had a degree of success with a simple text file that I'm using for test purposes.​The '_contents' attribute returns the full content of my text file, as below:However, I'm not sure how to deal with this attribute to make it usable after this point… ​I've tried passing the '_contents' attribute to a CSV FeatureReader as the 'Dataset', but this didn't work, as the reader tries to open a file at the location specified within that attribute. I guess I've already read the CSV file with the SharePointOnlineConnector, so now need to work with the attribute directly...​Reading an E

6964
ridleyj
Contributor
lorenrouth
Contributor
lorenrouthContributor
asked in Authoring
PythonCaller: No Geometry or original attributes are returned

This script works, but leaves out the geometry and original attributes.  My hunch is there’s something wrong with the close(self) function, but I’m stumped.  The code takes a feature id number and list of nearby ids from a NeighborFinder list, where it matches them up and assigns a _group_id attribute to  use with the Aggregator.  Really, it should be part of NeighborFinder.  The way I had been grouping features is to use two or more AttributeCreators and assign a common Id from the feature and id list.  It’s a hassle because you end up with duplicate features.  Very inelegent. I have seen a few posts on missing attributes, but I can’t see how they apply to my code: import fmeimport fmeobjectsfrom collections import defaultdictclass FeatureProcessor(object): def __init__(self): self.og_ids = [] self.closest = [] self.lines = [] def input(self, feature: fmeobjects.FMEFeature): id_number = feature.getAttribute('_count_Glaz_H') if id_number is not

532
lorenrouth
Contributor
hoa_le
Contributor
hoa_leContributor
asked in Data
Getting attribute information of multiple polygon intersected by line

Hi everybody,I have a map with 'Layer A' (polygons district boundary) and 'Layer B' (lines roads).I would like to add a field on my 'Layer B' table with the name of every district crossed by each road.In this example, I would like my Road 1 attribute to tell me it crosses 'City A', 'City B', 'City C', and 'City D'. And my road 2 attribute to tell me it crosses ‘City A’.Could you please show me how to make it? Thank you  

1097
lambertus
Enthusiast
vki
Contributor
vkiContributor
asked in Transformers
catch error in sql-statement run in the SQLExecutor

In an sql_executer I run an sql-statement that updates a table, but does not output any features. If there is an error in this update, an error message appears in the log file, but the translation as a whole is successful. How can I intercept this error so that the translation aborts if there is an error? 

332
vki
Contributor
kardemummabulle
Contributor
kardemummabulleContributor
asked in Transformers
RCaller

Hello,I have a general question regarding the RCaller. I have been actively coding in R over past 10 years, and started playing with integrating my code into FME for automating some of the analyses about a year ago, but what bothers me most is that FME is always putting up a fight whenever facing more complex custom R functions, i.e. loops, advanced raster processing involving raster lists/stacks, LiDAR, etc. It is always a problem when trying to get FME recognize the results as fmeOutput, and it is just never easy compared to how other things work in FME...It just seems like the RCaller is so basic in FME, rudimental even, not allowing no unleash the full R potential within the FME environment. Hence is my question to you, have you guys considered developing it further or is it because nobody is really interested in using R inside FME? Or is it just my subjective opinion and I am basically missing something? :)@dmitribaghThanks in advance.-Sveta

2205
kardemummabulle
Contributor
rudystricklan1
Contributor
rudystricklan1Contributor
asked in Transformers
Remove Geospatial PDF White Collar

Is there a way to specify removal of “white collar” areas in Adobe Geospatial PDF outputs? I don’t see any options in the Page Size parameters to restrict the output to be just the extents of the Reader-specified image source.

342
rudystricklan1
Contributor
kersy
Contributor
kersyContributor
asked in Integration
OpenAI completion transformer to support non-deprecated models

The completions API models were deprecated at the beginning of 2024. The current version of the transformer does not have model options like gpt-3.5-turbo. Will there be more options for models in the near future from FME's side?   

981
danminneyatsaf
Safer
salvaleonrp
Enthusiast
salvaleonrpEnthusiast
asked in Transformers
What's the quickest way to get to AI Assist for Regex?

Just curious. Currently it takes about five clicks using the AttributeManager to get to AI Assist. Any shorter way?

482
salvaleonrp
Enthusiast
lazarlubomir
Contributor
lazarlubomirContributor
asked in Transformers
How to create WKT in FME

Hello,I created bounding box in FME and I need to get from this polygon WKT file. How can I reach this in FME please?Thank You so much!

8742
amyw
lorenrouth
Contributor
lorenrouthContributor
asked in Authoring
'Error Running Translation' immediately in version 2023.2.4. Works fine in v2023.2

I was installing a Python module and pipeline (spaCy and en_core_web_sm.whl) into FME2023.2.4.  spaCy installed fine, but pip would not install the pipeline and I got this message: Since then, my FME 2023.2.4 will not work, at all.  No translations will work.  I made a blank Workspace with just a Creator and still immediately got:  “Error running translation”.What’s going on?  Did I break it?  Do I need to reinstall? My FME2023.2 works fine with the same Workspace.Any help is appreciated.

1212
lorenrouth
Contributor
scarecrow
Contributor
scarecrowContributor
asked in Transformers
Error "The table name or field names may be too long or invalid for the server"

Hello,I’m trying to read specific feature classes from an SDE database using a user parameter within a feature reader.I’ve not had a problem with this previously so not sure if it’s a bug (I’m using FME 2023.1.2.0 (20231110 - Build 23641 - WIN64) The issue I’m having is:When selecting feature classes manually in the ‘Feature types to read’ section of the Feature Reader window I can select as many as I want and they’ll all read fine.When using the user parameter (please see settings in screenshot below):Selecting one dataset reads fineSelecting 2 or more feature classes I get the error “Error creating feature dataset 'feature class a feature class b'. The table name or field names may be too long or invalid for the server” Thanks for you time 

1923
crystalatsafe
Safer
joaniegeo99
Contributor
joaniegeo99Contributor
asked in Authoring
Error using User Parameter for FeatureReader dataset

FME(R) 2023.1.1.0 (20230928 - Build 23631 - WIN64) FME FormHello,I have a set of QAQC workspaces that I’m trying to run in sequence with workspace runners. I have a parent workspace that, using scripted parameters, generates a bunch of output file names where I’ll write the results of the various workspaces, and runs workspace 1, then workspace 2 then workspace 3. I only want to run workspace 3 if my tests ‘Pass’ in workspace 2. So I write out a CSV file called _qaqc_status.csv in workspace 2 with ‘Pass’ or ‘Fail’ as the only attribute; the file location is in with the data and is variable.The problem comes when trying to read the parameterized file name ($(QAQC_STATUS_CSV)) with a FeatureReader; I get  the following error message   Worker 27572 > CSV reader: Failed to open file '' for reading. Etc, etc.and my CSV doesn’t show up on the output ports. If I hard code the FeatureReader dataset to an existing csv it works fine.Any help is appreciated, or even a workaround suggestion. Th

562
joaniegeo99
Contributor
dcox
Contributor
dcoxContributor
asked in Authoring
Help using string replacer

I am trying to join a SharePoint table with no geometry to a set of polygons (about 2000 rows). The table has unique project titles for for each polygon that I want to use as a join field; but the polygons themselves are stored as fgdb files deeper within the SharePoint file structure and they are a non-standardized legacy dataset that I am trying to aggregate (hence why I am transferring them all over to SharePoint as the first step).  When writing the fgdb’s I am also exposing the file path as the fme dataset field, so the unique project id’s in the table are a part of that file path. I am trying to use the string replacer to replace all the characters leading up to, and after, the project title with nothing so that only the project title is exposed. Sadly I can’t just count the characters as there are different folders within the file path with different names and character lengths so now I am trying to come up with a more complicated regex expression that will trim the start and th

1365
dcox
Contributor
alanaliberti
Contributor
alanalibertiContributor
asked in Integration
kml placemark name as output dwg layer name

Hello allI’m trying to achieve the above, so far I’m struggling on how to find out the KML reader ‘placemark name’ property, to write it as a DWG layer name.Could anyone point me out on how to do that? Thanks

835
liamfez
Influencer

Badge Winners

Show all badges

Community Stats

31,807
Posts
120,815
Replies
39,431
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.