Skip to main content
  • EN

Integration

Connecting FME to web services. Use of APIs. Mobile Apps.

  • 1,161 Posts
  • 4,086 Replies
1161 Posts
joy
Enthusiast
joyEnthusiast
asked in Integration
SharepointOnlineConnector doesn't return all files

Hello everyone,We are encountering an issue when using the SharePointOnlineConnector. My colleague, who is a member of a SharePoint site, was able to retrieve all files from the site using the HTTPCaller. However, when attempting to retrieve the same files using the SharePointOnlineConnector, not all files are returned. We are unsure why the SharePointOnlineConnector does not return the complete list of files from the site. For further clarification pictures are added:My colleague can access a specific list in Sharepoint itself (Codes)In the SharePointOnlineConnector, after connecting to the same Site, the list Codes is not available to him. Codes is a List and not a Document. Maybe that might be the reason why Codes is not available? ----------------------------------------------------------------------------------------------------------------------------On the Azure App Registration side, the settings are configured as follows:Permission Type: DelegatedPermission app registrationSit

330
joy
Enthusiast
jack.heiniger
Contributor
jack.heinigerContributor
asked in Integration
How to dynamically write new or update existing ArcGIS Online Feature Layers.

I’m currently dynamically reading web feature service layers by using a feature reader and trying to write them up to AGOL. I have no issues dynamically writing to a File GDB, but if I attempt to write to AGOL, I only get a Python KeyError, which isn’t telling me anything. Message Type: fme::internal::_v0::py::ExceptionPython Exception <KeyError>: 'Cadastre_Address_LGATE002'ARCGISONLINEFEATURES writer: An error has occurred. Check the logfile above for detailsThis only occurs when I want to write dynamically to AGOL, if I just write the exposed attributes it functions. Is there any way around this? I’m aiming to use one workspace to read in the features based on parameters, and write it out using parameters, as a way of creating and updating feature services.I should note that it seems to be half creating the feature service itself, but when it comes to write any features to the newly made feature service, the error appears.Thanks

494
jack.heiniger
Contributor
saravanakumar
Supporter
saravanakumarSupporter
asked in Integration
Reading larger shape file in FME Forms?

Hi FME enthusiast,               I am trying to read a large size of shape file using fme form (formerly desktop) where the file size 2GB. when I select the file in the esri shape file reader and try to add in workspace I am get the error like image attached below.The server have enough space to perform but I am receive error attached. Did anyone have face this issue earlier?. If anyone have any suggestions, all would welcome. Thanks in advance.!Notes: These shape files are exported from Smallworld using FME only.  I am using FME Desktop 2020.1.1.1 32 bit version.   

526
saravanakumar
Supporter
amber369
Contributor
amber369Contributor
asked in Integration
Create feature service from URL in ArcGIS Portal

Hi All,I'm still somewhat new to FME and am hoping someone can advise me.Through another workbench I have been able to gather a a list of service URLs from an AGOL. I would now like to automate the process of creating a new item in ArcGIS Portal via the New Item > URL workflow.I have looked through the Esri ArcGIS Portal Feature Service Reader/Writer and a few other transformers but none seem to accommodate for creating a referenced item via URL. Google is leading me nowhere either.Any advice or pointers?Thanks very much for your time! 

1216
salvaleonrp
Enthusiast
naveen
Contributor
naveenContributor
asked in Integration
Intermittent problems connecting to ArcGIS Enterprise

Hello All,  We use FME server 2021.2 as an integration platform and it is not configured for HTTPS. Organization internal systems call our FME workbenches via webhook. ArcGIS Portal Feature Service Reader fetches data from ArcGIS portal feature service. It executes successfully most of the time but fails very intermittently causing data discrepancy between different systems. The failure message is: ArcGIS Portal Feature Service Reader: SSL certificate verification failed for host 'xxxx.xxx.com'. HTTPS connections may not be secure. Disabling verification of SSL certificates. Message: HTTPSConnectionPool(host='vgggg', port=443): Max retries exceeded with url: /portal/sharing/rest/generateToken (Caused by SSLError(SSLError("bad handshake: Error([('SSL routines', 'tls_process_server_certificate', 'certificate verify failed')])")))2025-03-05 11:15:58|   0.1|  0.0|INFORM|ArcGIS Portal Feature Service Reader: Getting item with ID 'c505638a9b14460f8267d0a7b562ee48'2025-03-05 11:15:58|   0.1|

542
naveen
Contributor
martinkoch
Supporter
martinkochSupporter
asked in Integration
How to work around an ssl-verification error when using the ESRI Portal reader

Hello all,At a client I often fail to connect to their ESRI Portal, due to failing to verify SSL (see loggin below) on both FME Server and desktop.Proxy settings in FME don't change the behaviour (always uses proxy). The Chrome browser thinks the certificate is o.k. I can't disable ssl-verification in the Portal Reader, as suggested in the log, like it is possible to do in the HTTPCaller.. (see my idea for that). Inspired by this reported problem I exported the certificate from Chrome, and imported it in $FME_HOME\jre\lib\security\cacerts on desktop.. (analogue to these instructions for server, section .pfx certificate, as the problematic server has a .pfx certificate).This did not resolve the problem...Does anyone have any suggestions??? Kind regards,MartinArcGIS Portal Feature Service Reader: Using proxy http://proxy.####.intern:8080/ArcGIS Portal Feature Service Reader: Using authentication type 'NTLM'ArcGIS Portal Feature Service Reader: Logging into 'https://geoportaal.####.intern

7328
naveen
Contributor
B
bschabeniuk
asked in Integration
HTTP Caller POST To Add Attachment to Cityworks Work Order

Im trying to work with the Cityworks API to create Work Orders using FME desktop.I used the http caller to create the Work order and populate the necessary fields. However, my next challenge is to upload an attachment to the Work Order that comes from the attachment in the AGOL feature Layer created from Survey123. To do that I have used another HTTP caller set to POST with the URL.../services/Ams/Attachments/AddWorkOrderAttachment? I know I have the Query string correct but I'm doing something wrong in the Multipart Upload section. Also, Do I need to use a token if I'm using a web connection for Authentication?       

23910
dubosedfme
Contributor
tim_bkr
Participant
tim_bkrParticipant
asked in Integration
PowerPoint to database

Hello,I've got a really challenging question received from a customer !The domain is Heritage buildings protection.An architect/historian evaluates the value of buildings and gives them a mark.He then presents his proposal in a PowerPoint :Identification infoDescriptionMarkLabeletc. PicturesThe proposal is reviewed in several sessions, with different people. The mark may be upgraded or downgraded, the label changed, etc. Once validated, the data is to be captured in an SDE geodatabase. Presently, this is done in two different ways :ManuallyManually copying the data to Excel and it is imported in GDB with FMEBut in both cases, there is a non profit-adding step, which is to manually copy the data.Does anyone out there have an idea how to skip this step ?Could the PowerPoint presentation be structured in such a way (with keywords for instance) that could make the content recognizable and importable directly ?I have thought of different ways but I'd rather keep it open for your inp

495
crutledge
Influencer
tb09114
Supporter
tb09114Supporter
asked in Integration
Hide geometry definition input field from Geometry Parameter

I was wondering if I can hide the input field that comes with the Geometry Parameter when creating a workspace app in FME Flow.My users are all over the place, some of them understand that they have to set a point on the map and are confused thereafter when a whole GeoJSON syntax shows up instead of coordinates they expect, others think they should write a street address in the input field (mistaking the input field for a geolocator), etc…I can leave a message for them but hey, how many will read it...

342
hkingsbury
Celebrity
elmido13
Contributor
elmido13Contributor
asked in Integration
Network Analysis Tracing Downstream with Multiple Source

How to trace downstream in the network with multiple sources and accumulate the value from the intersected nodes of each trace? To Illustrate please see below. Black circles are the starting points.  Appreciate your help.

975
elmido13
Contributor
S
sparki
asked in Integration
How do I parameterise the layer name of a ArcGIS Portal Feature Service reader?

I am trying to figure out how to parameterise the layer name for a Portal Feature Service reader. In the screenshot below you can see the highlighted Layer Name field. However it does not seem to have the ability to set it as a user parameter. You can see it is possible to set other layer variables as parameters, eg Input Geometry Type, etc. Just wondering how I might do the same for the layer name?

20716
AliAtSafe
Safer
couch
Contributor
couchContributor
asked in Integration
I-Twin API

Hi, Anyone used the i-twin model API to download data? Any advice?

231
AliAtSafe
Safer
evoteck
Enthusiast
evoteckEnthusiast
asked in Integration
Having issue running a workflow

From the attached image, I am running a workflow for QAQAC for 2nd Level Check of Electricity Data, and I discovered that some of the transformers is showing under Incomplete Transformers, and also I am having an error showing (ERROR_2.1B:Wrong QA/QC WorkflowKindly run data with the most recent workflow) based on the way the FME Administrator developed the workflow. My question is this, if a workflow is developed with older version of FME like 2 years Gap, does result to some Transformers been listed under Incomplete Transformers, and how can I resolve such Transformers.

302
evoteck
Enthusiast
fmewithvm
Contributor
fmewithvm
asked in Integration
Migrate Data from Oracle to SQL

I’m working on a project where I need to replicate the table structure from an Oracle to SQL Server but without transferring any data. Essentially, I want to: Read tables from Oracle, recreate the same tables in SQL Server and write only the schema (field names, data types), not the records   Is there a best practice to force FME to write only the schema? Are there limitations I should be aware of (e.g. no support for constraints, indexes)?  

151
j.botterill
Influencer
ares
Contributor
aresContributor
asked in Integration
User parameter based on list with attribute value with diacritics

I have a list with values in an attribute which contain diacritics. I would like the user to be able to choose multiple values and then upload it to Flow for self service data download. However, when I open an oracle spatial reader in Forms and use the where clause to add them it doesn't work.What would be the best way to solve this?The where clause of the reader is now as follows:"active" in '$(choose_status)' and "municipality" in '$(choose_municipality)'both attributes are strings and published parameters the list includes only values from the oracle table ‘allow multiple selection’ is on choice list delimiter is ',’ default value is a municipality with diacritics.The first (choose_status) works. The second (choose_municipality) contains diacritics and does only work for values without diacritics.I also tried a Tester (municipality in $(choose_municipality)) but it also only works for values of municipalities without diacritics.

160
ares
Contributor
davidmooney
Contributor
davidmooneyContributor
asked in Integration
Oracle Writer becomes stale

I’ve come across an issue a couple times where the Oracle writer appears to go stale after a few months of working fine. Has anyone else come across this issue and do you have a better fix than mine?Problem: I run an FME workbench that writes data to Oracle, the workbench completes successfully and the log file tells me fme_features were written. When I go look in Oracle to confirm the deltas, the records were not changed.Current fix: If I replace the Oracle Writer and re-run the workbench then the records in Oracle do get changed. Any help would be appreciated

274
davidmooney
Contributor
lazarlubomir
Contributor
lazarlubomirContributor
asked in Integration
GoogleDriveConnector - read full path, not just relative

Hi everyone,please is there any way how to read the full path of the file from GoogleDrive (e.g. Shared with me/Division A/Documents/PDF/data_view.pdf)? I can see that GoogleDriveConnector can load just _relative_path (e.g. Documents/PDF/data_view.pdf). Thank you so much!Lubo

191
j.botterill
Influencer
joy
Enthusiast
joyEnthusiast
asked in Integration
How to get metadata of sharepoint sites such as members

Hello everyone,For my use case, I would like to retrieve information from a SharePoint site of which I am an owner.Specifically, I’m trying to find out who the members of the site are and their mail-adresses. Do any of you have an idea of how I could approach this?I looked into the SharePointOnlineConnector, but it seems I can't retrieve site metadata using it. I might be missing something. 

281
david_r
Celebrity
fbinneman
Contributor
fbinnemanContributor
asked in Integration
Unable to connect ESRI Geodatabae (File Geodb) reader between FME Flow 2025.0.3 and ArcGIS Pro 3.5.0

Once I have upgraded my ArcGIS Pro from version 3.4 to 3.5.0, I am suddenly unable to connect to a GDB file using the ESRI Geodatabae (File Geodb) reader, as I could before upgrading (when reinstalling ArcGIS Pro 3.4, all works again). I am currently using FME Form (version 2025.0.3) (Update: Apologies - the title reads Flow, but it should be Form! - I am unable to change the title with an edit though)., which connects as expected when I have ArcGIS Pro 3.4 installed. In FME the following output is given when trying to connect with the said reader:"Unable to perform any licensing related tasks. Please check your Esri ArcGIS Compatibility workspace parameter, found in Navigator -> Workspace Parameters -> Translation. This 64-bit version of FME requires ArcGIS Desktop along with 64-bit Background Geoprocessing; ArcGIS Pro; or ArcGIS Enterprise. Refer to this this article http://fme.ly/qua for more details "In the gallery, the said reader or writer is not greyed out. I have tried al

932
fbinneman
Contributor
deanhowell
Influencer
deanhowellInfluencer
asked in Integration
Publishing Imagery To ArcGIS Portal

I have a workbench that can take in various formats, at present vector and web services, and publishes these items to ArcGIS Enterprise Portal.I would like to extend the functionality to enable the users to also upload raster imagery i.e geotiff, jpg, etc.I am using a HTTP caller to use the ArcGIS API additem call to add the file to portal and then using the API publish to publish the image, but it never works.I can do it via ArcGIS Pro and end up with a ‘Map Image Layer’. But I can’t figure out the correct process starting with a zipped file containing the image and ending up with an item in ArcGIS Portal that can be used a map service.Any advice would be greatly appreciated.  

284
deanhowell
Influencer
virtualcitymatt
Celebrity
virtualcitymattCelebrity
posted in Integration
An FME based AI Agent

So I’ve been experimenting with using FME to build specific AI agents/agentic workflows.I’m using OpenAI’s API and leveraging function calling. It’s been quite fun and a really good learning experience. You can let the agent make decisions - if you give it tools to use then you can use looping transformers to let it use the various tools you give it, constantly updating it’s context. Looping transformers are a bit of a paint to work with and hopefully there could be something done in this space to make building these tools in FME easier. I’m still not sure what the best way to do this is or even if it makes any sense to use FME for this but I made some progress anyway:for example: should the tools be other CustomTransfomers for example or whole workspaces or maybe both. Should this be something somehow handled in Automations rather than a workspace? So many optionsSo far the agent isn’t interactive and I’m just putting all the context into the logfile, but in the end it would be real n

341
alexbiz
Enthusiast
michaels
Contributor
michaelsContributor
asked in Integration
Rename Attributes with names from other table

I have two input features. One contains the actual data, but with the wrong attribute names. The other contains the desired attribute names plus the connection key.Data-FeatureAttributename-FeatureGreen corresponds to the attribute name in the data feature,Red is the name of the attribute in the end How can I merge the two features and/or rename them so that the correct names appear? 

565
takashi
Evangelist
marcofuchs
Contributor
marcofuchsContributor
asked in Integration
Trouble FME to Databricks Writer

We're currently integrating FME with Databricks. In a vanilla Databricks environment, everything works as expected—both reading from and writing to Unity Catalog tables using the Databricks Reader and Writer in FME.However, in our organizational Databricks environment, we're encountering an issue: Reading works fine using the same credentials (tested with both OAuth and PAT). Writing, however, gets stuck in an infinite polling loop in FME, with no error message returned. The same credentials and target table work fine for writing when using a Python script in the same environment, so it seems to be specific to how FME writes data.Given that writing works in the vanilla setup but not in our organizational environment, I suspect the issue is related to permissions or Unity Catalog access controls that are more tightly restricted in the corporate setup.My questions: What exact permissions are required in Databricks for FME's Databricks Writer to write to Unity Catalog tables? What met

364
marcofuchs
Contributor
john_gis4
Contributor
john_gis4Contributor
posted in Integration
Views on recent FME price changes

I’m not sure if this is the right forum or category (I couldn’t select “general”), but as I’m sure you’re aware, Safe recently changed it’s pricing for FME, which includes annual maintenance pricing. We are a small consultancy business, long term Safe customer (10+ years) and have been FME advocates amongst our customers for many years. We have just received details of pricing for our annual maintenance in 2025 and for FME Form (previously FME Desktop Professional) for us this has increased by approximately 600%.The new maintenance price for FME Form is going to make it a lot more difficult to justify for a small business like ourselves.We were also previously lookng to expand our FME use by purchasing Flow, but the new pricing has also forced us to cancel those plans.We will also find it difficult to recommend FME to our customers, especially smaller ones, as the bar to entry in terms of pricing has been set so high.I have previously raised the issue of pricing with our reseller in th

9335
harrybell123
michaels
Contributor
michaelsContributor
asked in Integration
Dynamically expose lists

I have a problem. I've built a workbench that allows me to dynamically pull in various data sources. This also pulls in lists, depending on the situation. But FME doesn't know anything about these lists. How can I expose them dynamically? I have an attribute that contains the list name. At the end I have to explode the list, edit it and reassemble it with the same name.Thanks for your supportMichael

382
takashi
Evangelist

Badge Winners

Show all badges

Community Stats

31,501
Posts
119,414
Replies
39,117
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.