Skip to main content
  • EN

Unanswered questions

153 Posts
agelfert
Contributor
agelfertContributor
asked in Deployment
HTTP Error wtih backupConfiguration.fmw/JobHistoryStatisticsGathering.fmw in FMEFlow 2024.2

Getting an error with the default (OOTB) schedules/workspaces for : backupConfiguration.fmw JobHistoryStatisticsGathering.fmw Both times it’s an SSL error with the HTTPCallers in those workspaces. Looks to me like they’re calling a URL based on the Windows machine name provided (gathered?) during installation.This was not an upgrade but fresh install so I think this thread about the API version does not apply. It’s definitely calling V3.However, after the initial install, I have switched to HTTPS and added a DNS name with a valid SSL cert. All my services - Data Download, Data Streaming, Job Submitter etc - are working fine with this new name/URL.But the HTTPCaller still uses the FME_SERVER_WEB_URL(FME_SERVER_WEB_URL)/fmerest/v3/migration/backup/downloadwhich I think comes fromfmeFlowConfigDid I miss a step when setting up HTTPS and should I have switched this entry? If not, is it safe to just put the full DNS name for my FME Server instance in the fmeFlowConfig ?Not a huge issue wit

10
agelfert
Contributor
dannymatranga
Contributor
dannymatrangaContributor
asked in Data
PowerBI Semantic Model Reader?

Is there a way to read data from a PowerBI semantic model in FME Form?

142
dannymatranga
Contributor
wthall
Participant
wthallParticipant
asked in Transformers
Adding the workbench's file path via a creator

I just returned to work from the Peak Of Data and AI in Seattle and am trying new things.  In existing workspaces, I have added two creators to my workspace where I am adding a DateTimeStamp >DateTimeConverter - then writing to a new tab (Information) in my excel worksheetthe Second creator I am utilizing a FilePathExtractor and writing to the same new tab in excel.  Essentially I am creating metadata to make my job easier to rerun projects year after year.  The question I have is : is there an easier way to extract the File Path of where I have the .fmw saved without needing to navigate to it within the FilePathExtractor?  My ultimate goal is to create a custom transformer that I can share with co-workers that can help them add the date created and the fmw’s file path to their excel writers.

121
alexbiz
Contributor
hkingsbury
Celebrity
hkingsburyCelebrity
asked in Data
Mapping data types stored as attributes

I feel like I’ve seen this done before, but can’t put my finger on how to do it…..A warning, I’m working with 2020.2 so cast your mind back a few years….. Essentially I have a workspace that is taking data from MSSQL and writing it out to SQLite. In theory this is just a straight Reader to Writer.However, the SQLite file is being created fresh each time the process runs and it’s creating any number of tables based on relationships within the MSSQL database - these relationships need to be maintained. Therefore, the schema in the SQLite table is being created with an SQLExecutor and CREATE TABLE statements. Currently, I’m reading the schema from MSSQL and manually mapping each attributes data type from the MSSQL definition to SQLite using an AttributeValueMapper. Now it wouldn’t take too much effort to make this list exhaustive, but there is surely a better way. I initially thought of using a schema attribute and let FME do the MSSQL→ FME→ SQLite mapping with a dynamic writer, and that

392
hkingsbury
Celebrity
galigis
Enthusiast
galigisEnthusiast
asked in Transformers
Customise FME Flow Basemap URL with AGOL map

Hello,I am aiming to customise the FME Flow map interface by integrating a bespoke ArcGIS Online (AGOL) web map. The objective is to allow users to delineate an Area of Interest (AOI) and subsequently export relevant data directly from the application.The intended FME Flow map should utilise a basic AGOL web map that includes basic features layers (e.g. polygon) which are intended to assist users in understanding the extends of the dataset.I attempted to modify the basemap URL (Map Configuration) by embedding the public AGOL web map URL; however, this approach was unsuccessful.Would you happen to have any guidance or suggestions on how to properly embed an AGOL web map into the FME Flow ‘Draw an Area of Interest’ interface?  Thanks:)

80
galigis
Enthusiast
marava
Contributor
maravaContributor
asked in Data
Filter Reader Data based on other reader

Hi, I need to filter some ArcGIS Online Portal Readers based on a unique ID that exists also in another reader (file geodatabase). ExampleReader 1: ArcGIS Portal features w/ UID Reader 2: File Geodatabase features w/ UID Reader 1 should only load features that have a UID that match Reader 2. The UID fields are the same format. Is this possible? Please let me know if can provide further details. I am a beginner/intermediate FME user focused on GIS. Thank you!

80
marava
Contributor
b.hollebeek
Participant
b.hollebeekParticipant
asked in Authoring
Access Sharepoint and conditional access policies

I am trying to create a webservice to access Sharepoint. FME has been registered in Azure but when I try to set up the connection the conditional access policy blocks my connection.It looks like it has something to do with the way the http user client provides info to Azure. With the FME default http user agent you just get a blocking error, with the system default http user agent you get this: It looks like the http User agent does not provide the device ID (apparaat-id): Not available (niet beschikbaar). The conditional access policy demands a registrered device so it blocks this connection.I can make a Azure connection directly from Chrome or Edge in other apps. what is the way to a solution for this problem? 

942
matthew_banyard
Contributor
lilywong
Participant
lilywongParticipant
asked in Transformers
Remove attributes based on external list / Use attribute value as regex in BulkAttributeRemover

I have a workflow that:Takes a feature class from an ESRI Geodatabase (ArcSDE) Removes some attributes via AttributeRemover Writes to several different formatsI want to change Step 2 to use an external list (for example, a TXT file or CSV - the format is flexible), because other users will be regularly updating the list of attributes to remove.It seems like AttributeRemover only takes a single string or manual selection of attributes, so I decided to try BulkAttributeRemover, since it can take an attribute value. However, I ran into this problem:Let’s say I want to remove all attributes that contain the string PRIVATE.When I type the string PRIVATE into BulkAttributeRemover: Expression to Remove, the transformer functions as expected. It removes all attributes that contain the string PRIVATE.However, if I create an attribute called “regex” and set its value to PRIVATE, and then use the attribute “regex” as the Expression to Remove in BulkAttributeRemover, the transformer removes all va

574
woelfl
Participant
bec
Contributor
becContributor
asked in Data
Overwrite existing data without overwriting the data and formatting in the rows above the existing data via FME Excel Writer

I’m using an Excel Writer in FME Workbench 2024.2.  This is a workspace that will be run yearly and I have created an excel file to write to in the format that I need so that the end user gets the same output year after year.  I would like to use FME to clear any existing data in the excel file from row 5 on down, but still keep the data and formatting that exists in the rows above.  I tried Truncate Existing Sheet/Named Range: with my Start Row set to row 5, but cleared all of the existing data from the sheet and then wrote the new data starting at row 5.  In the below images, you can see what the sheet looks like before the writer is run, the writer parameters, and what the sheet looks like after the writer is run.  Is there a setting in the Writer Parameters that I need to change to ensure that the data and formatting in rows 1- 4 doesn’t get deleted?  Or is there another way that I need to approach this?  Any help would be greatly appreciated.  Thanks! Sheet view before writer is r

131
nielsgerrits
VIP
vincenthischie1
Contributor
vincenthischie1Contributor
asked in Transformers
Distance Accumulation Alternative

Hello FME community, I would like to identify all locations that are within a 300m-perimeter around a polygon, taking into account barriers (large roads, rivers etc.). In ArcGIS there is a tool called “Distance Accumulation” that does just this, but I don’t want to depend on it. Thanks!

868
vincenthischie1
Contributor
aron
Supporter
aronSupporter
asked in Transformers
Identify an island in a lake on an island in a lake

I hope I got the title prepositions correct…I want to break apart lake data in order to generalize each category individually. The DonutHoleExtractor will “only” break apart “one level”. That is, independent-lakes and island-in-lakes-on-islands get sent one way and islands-in-independent-lakes and lakes-on-independent-islands get sent the other. Last option is to use an AreaOnAreaOverlayer or similar to sort everything correctly. But I would rather save that computing time since this is a huge dataset. Unfortunately the DonutHoleExtractor does not have an option for lists, or that would have been my chosen route, me thinks. Once generalized the geometries will be reassembled into donuts.  Q: Is there a way to deduct the relations between different types of polygons within the donuts without doing a load of spatial analysis? I would expect there to be some sort of relation info within the geometry type itself?edit: Rephrased the question for clarity  Pic for illustrative purposes 

725
aron
Supporter
cory
Contributor
coryContributor
asked in Transformers
When will the FME Projections for GDA2020 be fixed in FME Form and FME Flow?

Hi Team,I was wondering if there was an ETA as to when a permanent solution for fixing FME Form (and Flow) will be available, as we're still experiencing issues with reprojecting data in GDA 2020. The work around at the moment that we have been given is;- Open up the following file in Notepad (open as administrator) :"C:\Program Files\FME\Reproject\CsmapTransformationExceptions\TransformationExceptions.db" - Find the Australia section and add the following line : GDA2020-7P|GDA2020|XFORM|FWD|NULL_FME - Save!Cheers 

696
df_cos
Contributor
juliarozema
Contributor
juliarozemaContributor
asked in Authoring
How to test for Esri ArcPro Arc

We need a way to detect/test for Arcs in our Esri SDE database.   We manage a large road line segment.  The system that uses this data does not accept Arcs, just polylines. Previously, we edited our data in ArcMap, then run a nightly job to check our data in FME.  Using the PathSplitter, followed by the GeometryFilter we could then find any Arcs that had been introduced into our data. Now that we are editing our data within ArcGIS Pro, it seems that Arcs show up as an Arc within Pro, but in FME, the segments show up as Lines and are not flagged with the workflow, mentioned above, using PathSplitter and GeometryFilter. How can we filter/test to find the Arcs in our data?UsingFME 2024.1ArcPro 3.2.3ESRI SQL SDE 10.9.1Example Arc attached in FGDB.  Then the Feature is opened in ArcPro, and an edit session is started to ‘Edit Vertices’, we can see that there is a verity that controls the curve of the line. 

704
j.botterill
Influencer
dave_oppd
Contributor
dave_oppdContributor
asked in Authoring
Corporate SSL Interception with FME Form/Desktop

My company does SSL inspection/interception which is causing errors when trying to view background maps in FME Form.  I have seen ways to fix this for the FME Flow (Server) side, but is there any way to change any configurations for FME Form to handle this?  The CA certificate for our authority is in the Trusted Root Certification Authorities certificate store on machines so I’m not sure why it isn’t trusted if FME is using the machine’s certificate store for trust.  Below is an example of error seeing from FME Flow 2025.0.1 (but have seen on previous versions as well).Stadia Maps Reader: Failed to load 'https://tiles.stadiamaps.com/tiles/alidade_smooth/5/19/14.png'. Error: 'HTTPSConnectionPool(host='tiles.stadiamaps.com', port=443): Max retries exceeded with url: /tiles/alidade_smooth/5/19/14.png (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Missing Authority Key Identifier (_ssl.c:1018)')))'Python Exception <FMEExcepti

713
j.botterill
Influencer
johnk
Contributor
johnkContributor
asked in Transformers
Looping with a FeatureReader

Hi FME world,I have two tables in a database (ArcGIS SDE). They are effectively a 1:1 match, linked via a common ID. Table 1 features are always present in the flow (filtered prior) and I want to read in ONLY the features from table 2, where match with the Table 1 filtered features (because there are 1m+).I’ve tried options like aggregating the Table 1 features and concatenating the ID, passing into Table 2 feature reader with a where clause. However, there is a maximum limit of queries the database can do (somewhere between 10,000-15,000 - and often I will need to read in more than this.My next thought is to create a looping transformer where I sample the T1 features into groups of 10k, aggregate, pass to FeatureReader, reads in associated 10k T2 features, then loop back to read in the next 10k, until there are no more features to be read (using a NoFeaturesTester to exit the loop.I’m a bit stuck on how to actually implement this though. Any ideas/thoughts much appreciated! Or if i’m

264
hkingsbury
Celebrity
nicholas
Contributor
nicholasContributor
asked in Authoring
Why does FME store files in My Documents folder?

Why does FME Flow (or FME Desktop) store files in the My Documents folder?Why not use AppData\Roaming or AppData\Local? 

161
j.botterill
Influencer
tbsm223
Contributor
tbsm223Contributor
asked in Transformers
Question about HTTPCaller

Hey,  I have a question about the HTTP Caller. Is there a way to have the workspace it is in still continue even if one of the records fails to upload? The reason I ask is because there are some interesting errors I have ran into when uploading records to Cityworks, where something fails and then I have to re-run the entire workspace, after first deleting all of the inspections/work orders that were created.  The error involves an encoded string not being compatible with FME. I would just like a way to run the entire workspace for all features and not have it cancel out on a failure. Any tips?

151
hkingsbury
Celebrity
jpbarnes
Contributor
jpbarnesContributor
asked in Transformers
CKANConnector - Upload error HTTP 400: "Bad request - JSON Error: Invalid request. Please use POST method for your request

With the CKANConnector able to list Datasets and Resources without any issue, so I know CKAN Connection is good.   If I try to add and update a resource I receive the  “upload error HTTP 400: "Bad request - JSON Error: Invalid request. Please use POST method for your request”    I’m pulling the Dataset and Resource for the update resource from the dropdown.    Acts like a permission issue but I’m connecting as an Admin  on the openGov side. 

142
jpbarnes
Contributor
p_c_20
Supporter
p_c_20Supporter
asked in Authoring
New bookmark auto-zoom - can it be turned off?

This is starting to annoy me - in 2024.2, whenever I create a bookmark around something, FME automatically zooms to it. Is this a setting that can be turned off? 

283
p_c_20
Supporter
aashnaparikh
Contributor
aashnaparikhContributor
asked in Architecture
FME Logs and DataBase

What is the process to access the database on the FME Server just so that we could have a trail of files that users ingested and the outputs that were generated? What are some of the best practices we can implement that can be helpful at the time of audit ?

302
hkingsbury
Celebrity
mohamed.n
Contributor
mohamed.nContributor
asked in Transformers
Can't retrieve property sets data of dwg blocks

Hi, I'm trying to access the property sets within the Extended data from dwg file, the property sets are attached to block reference objects, quite similar to the case of this post.Attached below are two snapshots from how the property sets look like in Autocad and FME workbench featuring the two attributes that I was trying to expose with no successcan someone guide me through the detailed workflow, please? I'm using FME workbench 2024.2 Thanks,

355
raghavendrans
Supporter
rmpayaby
Contributor
rmpayabyContributor
asked in Data
Converting DFX to IFC

I have a DXF-file consisting of lines and surfaces. Is there any standard method on how I can convert such files in IFC?

241
desiree_at_safe
Safer
moustik
Contributor
moustikContributor
asked in Transformers
SQLExecutor in FME2024.1 doesn't show Geometry of PostGIS raster, in contrary with FME2023.1

Hello,I am currently working with some database PostGIS rasters and wanted to import some into FME 2024.1, using a filter to only select 2 out of 11030.To do so, I tried both a SQL Executor and a FeatureReader (as both enables PostGIS raster reading).The SQL Executor filters the rasters correctly but doesn’t create the geometry and returns an error in the log file.The FeatureReader loads the 11030 rasters without filtering, suggesting a problem with the “WHERE clause”.I tried the same thing using FME 2023.1 and the SQL Executor is working under this version. I am wondering if there is a bug in the FME 2024.1 version.The problem was the same for the Feature Reader.A colleague said that the Feature Reader outputs everything as well in previous versions of FME (2022.2 and 2021.1).Do you know when the FME 2024.1 bug will be corrected?We are linking our work with ArcPro and we know we will have to use FME 2024.I am enclosing a share folder with the different logs (as txt) and the 2 workbenc

32216
saraatsafe
Safer
fmelizard
Safer
fmelizardSafer
asked in FME Hub Alerts
Survey123ReportGetter_EnterprisePortal

FME Hub user cratcliff just uploaded a new transformer to the FME Hub.Description Get a URL to a formated docx or pdf report file of your Survey123 record. - Modified version for PortalDetails This transformer uses HTTPCallers to submit a report job to Survey123 and returns the report's URL after the job has completed. At the moment, only detail reports for a single Survey123 record are supported. You must create and upload a report template in Survey123 first. See ESRI's documentation for more information: https://doc.arcgis.com/en/survey123/browser/analyze-results/featurereporttemplates.htmThis transformer can be used in a workspace within an FME Server automation that is triggered by a Survey123 webhook, allowing you to create a report as soon as a survey has been submitted.Would you like to know more? Click here to find out more details!

70
fmelizard
Safer
hlynur
Contributor
hlynurContributor
asked in Authoring
GML in generic reader through Add reader as a resource

Hello, have bumped into the problem of generic reader not being able to read a GML and have read the literature on how to circumvent this by adding a separate reader as a resource to make the generic reader understand my GML’s. But I cannot get it to work the reader just runs and doesn't find data, no error or warning, Total Features Read 0.,So my GML is pretty straight forward as there is no problem getting FME to read it with a OGC GML reader without needing to set XSD schemas and so forth, just reads it in by default. I have tried various settings in a GML reader that have all worked and then copied that workflow when I add the reader as a resource without any luck.Have I overseen some step here or any ideas what I might be doing wrong? Send hilfen, Hlynur 

655
crystalatsafe
Safer

Badge Winners

  • Integrate Spatial Data
    laisgouldhas earned the badge Integrate Spatial Data
  • Student (Grey)
    wthallhas earned the badge Student (Grey)
  • Teacher (Grey)
    evoteck-gchas earned the badge Teacher (Grey)
  • FME Certified Professional
    j.botterillhas earned the badge FME Certified Professional
  • Expert (Grey)
    carlwhas earned the badge Expert (Grey)
Show all badges

Community Stats

31,239
Posts
118,444
Replies
38,833
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.