Skip to main content

Integration

Connecting FME to web services. Use of APIs. Mobile Apps.

  • 1,130 Posts
  • 3,981 Replies
1130 Posts
gisgeek
Contributor
gisgeekContributor
asked in Integration
Extracting tables contents from webpage

Hi there I have been trying to extract the contents of a webpage the Facilities Masterlist which is on our internal sharepoint. I have downloaded a local copy of the page I am trying to extract contents from and attached it. I haven’t had much luck extracting the contents to replicate the table on the page. This is what I have so far.

221
todd_davis
Influencer
nielsgerrits
VIP
nielsgerrits
asked in Integration
FME wallpapers

I was wondering where the FME wallpapers are moved to? The old link does not work anymore. https://www.safe.com/support/support-resources/fme-downloads/wallpaper/

804
david_r
Celebrity
ridleyj
Contributor
ridleyjContributor
asked in Integration
Sharepoint List Reader returns unexpected NULL values when Sharepoint Column settings allow multiple selections

Is there a solution to correctly read sharepoint list attributes that are multi-select columns? When reading a sharepoint list with relevant permissions to read,write etc. the data table returned shows only <NULL> values for any column that has multi-selection enabled - adjacent columns with single select settings that hold the same data type (username) are returning the expected values - only the column settings differ. [Note the column setting for allow selection of {people only / people and groups} may also play a part in this question] The column that is returning NULL only has settings as below: List columns that return the expected values have settings:

795
emmaatsafe
Safer
philippeb
Enthusiast
philippebEnthusiast
asked in Integration
Why FME uses a deprecated WKID version ?

Hi, For the writer ArcGIS Portal Feature Service why using by default a deprecated WKID (102100) ? It’s even written in the FME doc : here Accordingly to the Spatial Reference organization, this WKID has been deprecated for quite a while now (before covid!) We need to use 3857 instead. So I don’t understand why FME continues to use the old one by default. Why don’t we see his replacement : 3857 ? Thanks !

411
hkingsbury
Celebrity
amber369
Contributor
amber369Contributor
asked in Integration
Create feature service from URL in ArcGIS Portal

Hi All, I'm still somewhat new to FME and am hoping someone can advise me. Through another workbench I have been able to gather a a list of service URLs from an AGOL. I would now like to automate the process of creating a new item in ArcGIS Portal via the New Item > URL workflow. I have looked through the Esri ArcGIS Portal Feature Service Reader/Writer and a few other transformers but none seem to accommodate for creating a referenced item via URL. Google is leading me nowhere either. Any advice or pointers? Thanks very much for your time!

995
amber369
Contributor
jsdbroughton
Contributor
jsdbroughtonContributor
asked in Integration
All attempts to create a web service authentication fail on redirect

I have followed the documentation on setting a custom OAuth2.0 web service connection and all steps work within the Test… flow until it comes to redirecting to https://localhost . Is FME listening to a specific port on the localhost or should it be registering itself as a temporary server? This is the returned screen. Following the same flow within a external browser window also ends up here but the returned access_code is present in the URL. How is this being retrieved by FME - I’m kinda stuck here.

71
todd_davis
Influencer
guygur
Participant
guygurParticipant
asked in Integration
Utility Network

Hi, I want to migrate my data from geometric network to utility network. Can someone help me?

351
hkingsbury
Celebrity
svante9
Participant
svante9Participant
asked in Integration
How to make a 3D building in FME

HelloI have 8 building surfaces with z-value. I also have a ground model. I wonder how to get the building surface to go down to the ground model so that there are sides, 4 sides that go down to the ground model. Now the building surface floats above the ground model in arcgis pro. I want to take the result into arcgis pro.What transformers do I need to process my 8 building surfaces so that they become blocks that correspond to a building.Now it looks like this in arcgis pro:

1843
vadis
Contributor
lifalin2016
Contributor
lifalin2016Contributor
asked in Integration
SharepointOnlineConnector and web connection woes

Hi all. I’ve tried to setup a connection to a list of files on a (customer) Sharepoint service without much success. I’ve read multiple other questions about it here, and some provided useful help (prompt=login), but most does not address my issues. The customer has created the site, and provided me with tenant and client IDs, and client secret. And he has created an “app” with an approval of my client (FME Form). First I tried to create a web service, but never got the “Test...” to work. First it erred insisting on getting an approval, but “prompt=login” solved that, but not it errs with a “refresh token” error. The same happens when I try to create a new web connection using the web service in a SharepointOnlineConnector. I then saw that there was an alternative use, using FeatureReader with “Microsoft Sharepoint List”, and here I was able to create a web connection using the previous web service unaltered. Sofar it can only access root douments, but the connection works, it seems. B

813
lifalin2016
Contributor
evoteck
Enthusiast
evoteckEnthusiast
asked in Integration
Geodatabase writer error

Hi folks, how can I resolve the error below;2024-09-06 07:06:19| 1.5| 0.0|ERROR |BADNEWS: No MULTI_WRITER dataset name was specified (couldn't find a value for `PRIMARY_DEST_DATASET' or `MULTI_WRITER_DATASET')2024-09-06 07:06:19| 1.5| 0.0|ERROR |(D:\code\fme\source\engine\core\engine\writrimp.cpp:672) class StatusInfo __cdecl STFWriterImp::getDataset(class stk::ex::UString<0> &) const

1346
evoteck
Enthusiast
femo
Contributor
femoContributor
asked in Integration
Python Start Up Script results used within User Parameter

Hello, i am facing the following task. csv-files that have different headers (different columns) are to be processed. In other words, file1 has a set of attributes, file2 has a different set of attributes, etc. In a Python start up script, the different columns are determined whenever the workbench is started. Now i would like to use these attributes within published parameters. The idea: A published parameter “p_city” asks for the column which corresponds to “p_city” (name of the city). The user can select among the columns that have previously been determined by the start up script. How can i pass the determined columns from the start up script to a fme parameter? Or do you have a better idea? Best wishes

272
femo
Contributor
robotix
Contributor
robotixContributor
asked in Integration
How do I get FME to select the right cert for Client Cert Authentication to server?

Part of the handshake is described as: Upon receiving the Server Hello containing the Client Certificate request & list of Distinguished CA names, the client will perform the following steps: The client uses the CA list available in the SERVER HELLO to determine the mutually trusted CA certificates. The client will then determine the Client Certificates that have been issued by the mutually trusted Certification Authorities. The client will then present the client certificate list to the user so that they can select a certificate to be sent to the Server. So the last part of this states the cert list is provided to the user so they can select the cert to sent to the server. In this case the user is FME. How does it select which cert to pass to the server?

1466
martinkoch
Supporter
User17042260974539197207
Participant
User17042260974539197207Participant
asked in Integration
RAPIDS conda environment for FME Form and Flow under Linux?

I have a need to access some advanced graph algorithms in the RAPIDS (rapids.ai) package from a PythonCaller, which is normally installed as a Conda environment. I have found a few references on selecting the Conda-environment-specific Python interpreter, but unfortunately, they all assume we are running under Windows. We are running Ubuntu Linux, and the Linux installation of FME Form (as well as the macOS installation) doesn’t support custom interpreters. Any ideas on how I can get around this? I’ve previously managed to install pip packages into the standard FME interpreter environment with no issues, but it’s very difficult to successfully install RAPIDS using pip due to its many binary dependencies.

502
User17042260974539197207
Participant
_jacques_
Supporter
_jacques_Supporter
asked in Integration
Extracting workspace metadata

Hi, I’m working on automating our FME workspace deployment on Azure Devops using the functionality in pipelines. One thing I would like to automate is to extract metadata about every workspace pushed to the repository and write it to a README.md file. With such a file placed next to every workspace it would be easier to navigate our repo. I would like to see basic information like workspace name, description, number of transformers etc. What’s the best way to extract this data? I have tried using python to read the .fmw text directly and using the FME workspace reader with partial success. Has anyone else done something similar or have ideas?

383
redgeographics
Celebrity
marias
Contributor
mariasContributor
asked in Integration
Run "dynamic" SQL queries

Hello, Could you please help with ideas how to implement the following: I run SQL query by SQL Executor that checks something in PostgreSQL DB and as a result provides set of SQL queries that should be executed in the database afterward. How to execute those newly generated queries? How can I run all those resulted queries after SQL Executor?

1017
ebygomm
Influencer
losanca
Contributor
losancaContributor
asked in Integration
Esri ArcGIS Server Feature Service

A month ago, I generated an fmw (Build 24202) that read from Esri ArcGIS Server Feature Service, (url, user, pwd) correctly.today when opening the fmw gives error and is not able to read, I do not know why it can be, if everything is the same as a month ago.Thank you so much!

293
hkingsbury
Celebrity
lifalin2016
Contributor
lifalin2016Contributor
asked in Integration
Where has the FMX file documentation gone to ?

Hi all. Today I needed to build a custom Python based transformer from scratch, after a two year hiatus, and needed to explore some new things in the FMX file part. So as always I opened https://support.safe.com/hc/en-us/p/documentation But apart from the Format GUI Type documentation, I can only find a new “.fmxj” documentation, but not the proper FMX file ditto. And fmxj looks nothing like FMX, it seems. Why has this crucial piece of documentation been removed ? Can I find it somewhere else ? Cheers

413
jovitaatsafe
Safer
fmelizard
Contributor
fmelizardContributor
asked in Integration
HTTPCaller and Twitter API authentication problems

I am currently starting a project requiring me to pull images and videos from a Twitter page. Originally, I was using the TwitterStatusFetcher transformer to pull the individual JSON object of every tweet, and extract the corresponding image and/or video. While this was working to an extent, I noticed that the JSON extracted from the TwitterStatusFetcher at times did not contain an image and/or video when there should've been one. I believe this is due to a recent change in Twitter's API requiring an extra parameter (tweet_mode=extended) to retrieve a full tweet. As such, I've been trying to access the Twitter API directly with this extra parameter, using the HTTPCaller transformer. However, Twitter requires the use of Oauth 1.0 for me to pull tweets. I'm unsure of how to set up the web connection for Twitter to use Oauth 1.0, as FME 2016.1 uses Oauth 2.0 to establish a web service. I have all the required consumer and access tokens already, I'm just unsure of how to go about setting u

1045
wisdomisaac541
Participant
marta.podsiad
Supporter
marta.podsiadSupporter
asked in Integration
DYNAMIC plugin

Hi, I’m experiencing issues with searching for a path for a PDF. Unfortunately, the process is extremely slow and seems to be stuck at this message. Could you please advise on how to proceed?

251
hkingsbury
Celebrity
marta.podsiad
Supporter
marta.podsiadSupporter
asked in Integration
DYNAMIC plugin loading

Hi, I’m experiencing issues with searching for a path for a PDF. Unfortunately, the process is extremely slow and seems to be stuck at this message. Could you please advise on how to proceed?

252
marta.podsiad
Supporter
louis_boekhoudt
Contributor
louis_boekhoudtContributor
asked in Integration
Attribute convertion

Hi, I am in need to convert an attribute with “188 -195” as value (Wich means 188 up to and including 195) in “188;189;190;191;192;193;194;195”. How can this be done in FME workbench 2024.1.0.0. With a combination of transformers AttributeCreator, AtributeSplitter, ListElementCounter, ListExploder and AttributeManager I am be able to produce the 8 new features. THNX.

613
bwn
Evangelist
saravanakumar
Supporter
saravanakumarSupporter
asked in Integration
Feature reader not reading data when run from bat file ?

Hi FME Enthusiasts, I am trying to run a fmw file by running a batch file. I tried to read smallworld data then convert into some other format. I create a batch file to execute but reader does not read the data. So I passed single record as input and ran the bat file it could able to read and converted into my destination format. but if i passed 100 records it was taking long time and waiting at “Getting feature using command number: (0)” it not moving further. If I manually run the same data with same fme workbench straight , which is working fine without any struggle. if anyone faced this kind of scenario early?.

553
saravanakumar
Supporter
bpoffet
Contributor
bpoffetContributor
asked in Integration
Default background Map Authentication - Connection failed

When i try to “inspect feature caches” or “view sources data” it does not work and i get this error message : I am not able to use any defaut background map. When I click on “OK” then the software crash. Any suggestions ?

1204
raymondbrunner
Contributor
cfdune
Contributor
cfduneContributor
asked in Integration
FeatureReader crashes on reading ArcGIS Pro filegeodatabase

Hello, as it says in the title: FeatureReader crashes on reading ArcGIS Pro filegeodatabase. For my work I built a workbench were previously data got written to an Arcmap *.gdb which worked flawless. But now since my company is switching to ArcGIS Pro, I'm had to update the *.gdb to the ArcGIS Pro standards to be able to work with annotations. After running it with that updated *.gdb I received errors. After some fiddling it seemed that the issue was resolved. But a few runs later I found out that there were some attributes that I had to alter to the *.gdb to streamline it for later production steps. No probs so far. After doing that, the FeatureReader i use came up with the old attributes, and not the newly inserted. So I thought, I'll repoint it to the *.gdb, after doing so, the workbench crashed… I've tried different things to find out where the problem lies: Maybe a feature had bad geometry? Maybe to many features? Maybe the *.gdb was corrupted? But nothing I did helped. As a last

1356
rogbak
Contributor
stlj
Contributor
stljContributor
asked in Integration
FME Flow Stream connection to IBM MQ 9.3

Whats is the best way to connect to an IBM MQ 9.3 message broker from a workspace running as a stream on Fme Flow 2023? We need to be able to process several hundreds of messages/sec. I’ve done quite a lot of testing with the MQTT connector transformer and Mosquitto MQTT broker. Very fast and reliable. IMB MQ only supports AMQP 1.0 protocol and the question is if there is a connector transformer I can use for that? Fme Rabbit connector supports AMQP 0-9./Stefan Ljungstedt

861
mattmatsafe
Safer

Helpful Members This Week

Badge Winners

Show all badges

Popular Tags

Community Stats

31,148
Posts
118,077
Replies
38,764
Members

Latest FME

Terms & ConditionsCookie settings

Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.