Skip to main content

General

A read-only category for lost FME Form topics. We hope to move them shortly.

  • 4,039 Posts
  • 13,878 Replies
4039 Posts
mark2atsafe
Safer
mark2atsafeSafer
asked in General
Question of the Week: Parallel Processing in the ShortestPathFinder

Happy new year, FMEers. Our question-of-the-week was posted just a few hours before I started to review the week. It's about parallel processing and the ShortestPathFinder transformer. Question of the WeekQ) I was hoping to speed up my ShortestPathFinder calculations with "Parallel Processing", but I don't notice any speed improvements. The 2018.1 documentation says "If it is enabled, a process will be launched for each group specified by the Group By parameter." However, the most recent documentation does not mention parallel processing at all. Am I missing something? Asked here by @magnus A) Yes, there are a number of points. The first is what happened to parallel processing in 2019, the second is how to ensure parallel processing works... Parallel Processing in 2019So here's a quick refresher on parallel processing in 2019. Basically it was removed from individual transformers and retained only in custom transformers. I wrote a blog article to explain why. In short, parallel process

1292
danilo_fme
Evangelist
C
cj_gis
asked in General
FME server workspace not sending emails as failing to find attachment

Keeping getting the following error message - Overdue_Emailer: The file 'C:\\ProgramData\\Safe Software\\FME Server\\repositories\\GIS\\Test send Email/Overdue.xlsx' could not be found. It is required to form the content of the attachment Overdue.xlsx Works space created in workbench and published to server. Works fine if a run from workbench and I can see the .xlsx files that are the attachment in fme server repository but still getting an error

1025
dylan.at.safe
Safer
f.kemminje
Contributor
f.kemminjeContributor
asked in General
Can FME do the postman application job(http request) ?

Hi Team,I am using the following xml snippet (thru postman) to get the response and i get the response from postman. it is working good. Now the same thing i need to achieve thru FME. Please help me on what transformer to be used? and how can i pass the parameters?can httpcaller do this? i tried with http caller using GET methos but Response is NULL. <soap:Envelope xmlns:soap="http://www.w3.org/2003/05/soap-envelope" xmlns:test="http://www.synchronoss.com/spatialSUITE/test"> <soap:Header xmlns:wsa="http://www.w3.org/2005/08/addressing"> <wsa:Action>HubTraceB7</wsa:Action> <wsa:To>http://gisstrm-po-c2p.cable.comcast.com/trainingSTORM/spatialSUITE/v7_1_0/ws-i/HubTraceB7</wsa:To> </soap:Header> <soap:Body> <test:TestRequest> <test:Action>echo</test:Action> <test:Parameter>CB10995066|Incoming|CB10995070_1</test:Parameter> </test:TestRequest> </soap:Body> </soap:Envelope>

994
expertappdevs
Observer
A
aseem1150
asked in General
Hi All, I'm new to fme, I have a LAS/LAZ point cloud data and I want to convert it to cesium 3d tiles. how can i do that using FME 2022.1.3. Please Help. -Thanks Aseem

Hi All, I'm new to fme, I have a LAS/LAZ point cloud data and I want to convert it to cesium 3d tiles. how can i do that using FME 2022.1.3. Please Help. -Thanks Aseem

2182
lunttibluntti
Contributor
L
lxk
asked in General
How to use Esri Geodatabase writer to fanout to multiple Feature Classes nested in multiple dynamically named/created Feature Datasets?

I have multiple .dwg files I am trying to convert to feature classes. However I would like to nest the resulting feature classes inside a feature dataset that has the same name as the input .dwg file. I have tried to change the Feature Dataset name to @Value(fme_basename) under Table Creation Parameters after previously exposing fme_basename: But running the workspace with the above displays this error in the logs: "Esri Geodatabase Writer: Creating feature dataset '@Value_fme_basename_'An error occurred while attempting to create a feature dataset. The error number from ArcObjects is: '-2147220654'. The error message from ArcObjects is: {The table name is invalid.} GEODATABASE_FILE writer: A fatal error has occurred. Check the logfile above for details A fatal error has occurred. Check the logfile above for details" When I remove @Value(fme_basename) and just write a regular string, it works. Thanks!

1865
mmorgan0110
Participant
markcoopersdc
Contributor
markcoopersdcContributor
asked in General
Read data from external SQL database (ODBC connection) which requires SSL

Hi I am trying to set up connection to an external SQL database (the supplier describes it as an ODBC connection). I am using the SQL non spatial reader. However, we have been told it needs to use SSL to connect. Is there an option in FME to use SSL for the connection please?

823
chrisgoodman
Contributor
C
clives_online
asked in General
Limit records

Greetings, I used a setting that limits record input to 1,000 records before. I cannot find the setting to limit FME to read the first 1,000 records?? This is useful when testing a FME workbench that has large number of records. If anyone can point out the setting, it would be appreciated. Thanks Clive

4054
leamoraes02
Participant
dustin
Influencer
dustinInfluencer
asked in General
Possible bug associated with table handling on FME Server

I have a workspace published to FME Server 2022.1.1 (build 22623) in which I want to give the user the option to Truncate Existing or Use Existing via a user parameter. When you create the parameter in the ArcSDE writer feature type, the name of the parameter defaults to fme_table_handling. This works fine when running from FME Desktop 2022.1.1 (build 22623). When running from FME Server, the parameter choice is not honored. It simply uses the choice of the parameter that was made in Desktop before the upload. However, when you change the name of the parameter to something else like 'table_action', it works as intended on FME Server. Here is a screenshot from FME Server log file, where the parameter name is left as the default value (fme_table_handling). As you can see, the parameter is preceded by only one dash, where it should be two dashes. And also, 'fme-' has been dropped off. I think this is where the issue is occurring.

574
matt.stull
Contributor
A
asadamjad
asked in General
I am getting errors while JobHistoryReader

Feature Type: `JobHistoryReader_LoopHere' Attribute(32 bit integer): `Loop to JobHistoryReader_LoopHere1664443291 Input Splitter.BranchingFactory.Count' has value `1' Attribute(string: UTF-8) : `_min_job_age' has value `20220928000000' Attribute(64 bit integer): `_offset' has value `0' Attribute(string: UTF-8) : `fme_feature_type' has value `Creator' Attribute(string: UTF-8) : `fme_geometry' has value `fme_undefined' Attribute(string: UTF-8) : `fme_type' has value `fme_no_geom' Coordinate System: `' Geometry Type: IFMENull Coordinate Dimension: 2 =========================================================================== Loop to JobHistoryReader_LoopHere1664443291 Input Splitter (BranchingFactory): Transformer/Factory JobHistoryReader_HTTPCaller is blocking and cannot be used in a loop, but was found between 'Loop to JobHistoryReader_LoopHere1664443291 Input Splitter' and 'JobHistoryReader_LoopHere1664443291 Input Splitter' An error has occurred. Check the logfile above for details

585
mferwerda3
Contributor
boubcher
Contributor
boubcherContributor
asked in General
GeoTag Photo

Hello there we have Millions of JPG Photo we want to geotag all the metadata is located in an excel file is there a way to do this via FME Thanks

2579
philippeb
Enthusiast
A
asadamjad
asked in General
contains a Record Index file that is not a sufficient length to be useful and will be ignored.

Why i am Getiing this warning and error when i try to run workspace on desktop and on server

1645
bwn
Evangelist
K
kamilsql
asked in General
Record Index warnings

Hell all, I am able to read my previously created shp file in Fanout mode, but I get this warnings: Shapefile Reader: Input dataset XXXshp' contains a Record Index file that is not a sufficient length to be useful and will be ignored. Features can still be read but performance may be impacted. After reading this shp file I am using AreOnAreaOverlayer and fme stacked there with warnings. Number of Inner Boundaries: 1 -------------------------------------- Inner Boundary Number: 0 Geometry Type: IFMEPolygon Boundary: Geometry Type: IFMELine Number of Coordinates: 10 -- Coordinate Dimension: 2 ===============================================================ccoordinates ============ AreaOnAreaOverlayer (OverlayFactory): Overlaying requires a tolerance of at least 2.5078612099758616e-13 for these features, and the input tolerance is 0. Setting the tolerance to 2.5078612099758616e-13 When I changed Tolerance from None into Automatic, another warning appears: @Geohash: The feature is either to

1733
arnold_bijlsma
Enthusiast
M
mbulkmans
asked in General
Failed to write to Oracle Table with more than 100 attributes

We recently upgraded both Form and Flow to 2023.1 after we ran some workspace from form and flow we encountered that they were failing on the writer part with the following error message: "Too many values to bind. Found '127' when expecting a max of '100' ". It seems that FME is not able to write the data to an Oracle Spatial DB if the amount of attributes is greater than 100. When we reduce the amount of attributes to lower then 100 there is no such message and the writing is succesful. The problem is that I cannot reduce the amount of columns below 100 (the DB design is debatable I know ;-) ). Is this supposed to work like this or is it a bug in the writer?

774
danminneyatsaf
Safer
soly
Contributor
solyContributor
asked in General
What is Oauth scope ?

Hallo. i am trying to create connection between FME desktop and azure ad i have client id an client secret and tennant id but I am not sure ,what is [OAUTH Scope] ? Where should I get it from ? i have written https://Storage.azure.com instead of Oauth scope because it is the resource. then i clicked test but It shows me a window to log in with Microsoft online . could someone advice me ,what should I do ? thanks is in advance fme 2021

354
natalieatsafe
Safer
creinier
Contributor
creinierContributor
asked in General
FME cached values won't show up when trying to import into a transformer.

I'm attempting to read in address points from a shapefile and filter them by the "County" attribute field. I'm using the AttributeFilter and trying to import all the values to route the points to their respective ports. When I try to import the values in the transformer, the only value showing up is that of the first feature. Not all of them. When I attach a second attribute filter, all the values show up. I guess I can go about the workflow doing it this way, but it seems like all the values should be showing up in the first attribute filter. Any suggestions?

2129
DanAtSafe
Safer
killphil84
Participant
killphil84Participant
asked in General
Further investigation after getting "Esri Geodatabase Writer: XXX attribute value(s) were truncated" in log

I want to write to an existing FGDB and I'm getting "Esri Geodatabase Writer: XXX attribute value(s) were truncated" (in my case: XXX = 500+) in my translation log. Concerning the attribute values that should get written and given data types, everything seems to be fine. What could be a way to determine which attribute values are truncated and why? I can't find further information on this.

1376
bwn
Evangelist
raaaju1990
Contributor
raaaju1990Contributor
asked in General
coordinates or measures are out of bounds when reprojecting features from EPSG: 4326 TO EPSG:3857 and creating a featureclass using fme desktop

Hello, I have several featureclasses to convert from EPSG:4326 TO EPSG:3847. Almost all of the input featureclasses got reprojected and got saved as a new output featureclass . But, for few, I receive the below error , An error occurred while attempting to add a shape to a feature buffer. The error number from ArcObjects is: '-2147220936'. The error message from ArcObjects is: {The coordinates or measures are out of bounds.} I'm not sure what is the reason and how to resolve it. When tried using Arcgis pro it worked well but not in fme desktop. I used ESRI reprojector for this operation and even I tried using other reprojection transformers too and I get the same issue. Can any one provide some guidance or solution to this problem? Do I need to change any writer parameters ? Thanks.

1572
camwatson
Contributor
ryanuthoff
Contributor
ryanuthoffContributor
asked in General
Unable to run Esri Python 3 scripts on FME Server, even though all settings/compatibility appears to be correct

I am having issues running workspaces on FME Server that contain Python 3 (using Esri GIS Python module). This is the error I am getting: The workspace has Python Compatibility set to 'Esri ArcGIS Python 3.6+', which requires an appropriate version of ArcGIS Pro or ArcGIS Server. If ArcGIS is not required by this workspace, then update Python Compatibility to a non-Esri-ArcGIS Python. Otherwise, please install the required ArcGIS product, or if ArcGIS Desktop already installed, update Python Compatibility to 'Esri ArcGIS Python 2.7'. To update this setting, go to: Navigator -> Workspace Parameters -> Scripting -> Python Compatibility Environment Details: FME Desktop/Server 2021.2.5.0, ArcGIS Pro 2.8 and ArcMap 10.8.1 Per the compatibility page (https://community.safe.com/s/article/notes-on-fme-and-esri-versions-and-compatibility) ArcGIS Pro 2.8 is compatible with the version of FME I am using. In my workspace in FME Desktop, I set Python Compatibility to Esri ArcGIS Python 3.6+ (and al

5585
australgis
Contributor
vlroyrenn
Enthusiast
vlroyrennEnthusiast
asked in General
Portable FME Flow/Form Python environment

The FME Python environment is a bit weird, to say the least, which makes it difficult to use in various contexts. It's a Windows Python embedded installation, with the bundled and user-installed libraries in non-standard paths. As stated by the Python doc linked above, this installation doesn't officially support using Pip for package installation (due to the sysconfig paths likely being invalid). For dependency management, I would honestly much prefer using a virtual environment, but the python311 installation bundled with FME 2023 doesn't include the venv module, so that's not even an option. At that point, I would rather just create a separate, regular python installation, manage the packages myself and tell FME to use that instead of the included one, but then I would need to move all the compiled FME libraries (and the DLLs they depend on)to that environment, and I don't see a list of that anywhere. Is there any version of the FME Python libs that can be installed to a fresh Pytho

3385
vlroyrenn
Enthusiast
R
rjwillshear
asked in General
How to split a PDF based on text on pages

So I have a pain in the backside task I'd like to try and cut down to size. Basically we use a piece of software that automatically generates reports and logs for us and they can either be generated individually or as one large PDF. For my current project I need to generate thousands of these reports, which to do individually will be a nightmare, so I want to generate the single large PDF and have FME scan through the PDF and split out the pages. Each report has a location reference number and the sheet number (e.g. 1 of 7) so what I would like to do is have FME scan through the PDF, read the reference and sheet numbers, split out the pages and recombine into the individual location references.

8527
jhawks
Contributor
thijsknapen
Contributor
thijsknapenContributor
asked in General
How to periodically Cleanup the FME Flow Temp Resource (i.e. '$(FME_SHAREDRESOURCE_TEMP)')

I was wondering about the FME Flow Temp Resource (i.e. '$(FME_SHAREDRESOURCE_TEMP)'). As the name suggests its supposed to be a temporary folder. First question I have on this, Is it correct that there is no default mechanism (e.g. that there is no default cleanup task) that cleans out this Temp (FME_SHAREDRESOURCE_TEMP) folder, and that if you want to have it be cleaned every X days/weeks, you should create a new System Cleanup Task? It seemed to me that this was the case, and while setting up my own System Cleanup Task to have this Temp (FME_SHAREDRESOURCE_TEMP) folder cleared, I came across some confusing points I would like to address/ask. My second question; How does the 'Remove Files Older Than' parameter set (at tab 'Tasks' of 'System Cleanup') relate to the 'Task Interval' parameter for 'Normal Conditions' (that can be configured at the 'Configuration' tab of 'System Cleanup')? E.g., if I set up a task to clean up the 'Temp Resource' folder once every hour, but the 'Task Interv

4128
thijsknapen
Contributor
maica
Contributor
maicaContributor
asked in General
FME server: Some or all of the input parameters are invalid

Hi, I receive this message: message":"Some or all of the input parameters are invalid","problems":[{"reason":"dependency","field":"publishedParameters","message":"Illegal field Does anyone know the reason? Thank you

973
vanessarapior
Contributor
brendon_sandrey
Contributor
brendon_sandreyContributor
asked in General
MariaDB Reader (Non-Spatial) getting datatype incorrect

Hi, I have a MySQL database which I'm using the non-spatial MariaDB reader to get access to. Most fields are coming into FME Desktop ok, with the exception of a unique identifier field. The source data has a field called rg_key_id which is defined as char(21) in MySQL. A typical value in this field would be 'RG 022000001' But, when read FME is setting the datatype as fme_binary and I'm seeing '52472020303232303030303031' as the representation of 'RG 022000001' Can someone please point me at a resource, or help me understand, how I can either honour the source datatype or change the FME datatype so that it's no longer fme_binary. Here is the Feature Information showing the fme_binary encoding. Many thanks Brendon

353
brendon_sandrey
Contributor
tb09114
Supporter
tb09114Supporter
asked in General
How can I authenticate my ArcGIS Enterprise Portal web connection in FME Server / Flow?

When I publish my workspace to our FME Server, and run it it works. After a while, published before Christmas 2023 -> ran now again, FME Server return with the following error: ArcGIS Portal Feature Service Reader: Authorization error. See http://fme.ly/AGOL401Error for more info. FMEException: 928221: ArcGIS Portal Feature Service Reader: Encountered an unexpected error. The error code from the server was '498' and the message was: 'Invalid token.'. Details: '' Trying to fix the issue I attempted to re-authenticate the web connection. The issue is, when I click on the 'Authenticate' button, then I get a browser window where I can authenticate myself against our Enterprise Portal and the portal returns a token. In other applications such as Jupyter the token needs to be copied and handed over to the requesting application. This would be here FME Server. However, FME Server does not offer any place where to place the token. How can I authenticate my web connection?

5587
kate-safe
Safer
tomfriedl
Contributor
tomfriedlContributor
asked in General
FME-Form-Starter

Hi all, I'm wirting a program and I thing is alos usefull for other: FME-Starter simplifies the opening of FMW files when installing several FME version. The program must first be associated with the .fmw file extension (Windows context menu, Open with). When opening FMW-files, it will check if there is an FME version installed that matches the last one saved. If yes, this workbench will be opened with this version. Otherwise a selection of all installed FME versions is displayed. If a hotkey is pressed when starting the program, the selection is also displayed. In the settings you can choise the hotkey between Shift or Control. On dircet opening the executable yout can choise the FME-version to run. In the settings you can choise a hotkey (Shift or Control) to run the actual version directly. With FMX-files (custom-transformer) the FME-Starter has the same behaviour with the difference that the file is opened for editing instead of installing it. The settings are accessible via the he

3425
tomfriedl
Contributor

Helpful Members This Week

Badge Winners

Show all badges

Popular Tags

Community Stats

31,166
Posts
118,151
Replies
38,787
Members

Latest FME

Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.