Skip to main content
  • EN

Integration

Connecting FME to web services. Use of APIs. Mobile Apps.

  • 1,137 Posts
  • 3,998 Replies
1137 Posts
lifalin2016
Contributor
lifalin2016Contributor
asked in Integration
Where has the FMX file documentation gone to ?

Hi all.Today I needed to build a custom Python based transformer from scratch, after a two year hiatus, and needed to explore some new things in the FMX file part.So as always I opened https://support.safe.com/hc/en-us/p/documentationBut apart from the Format GUI Type documentation, I can only find a new “.fmxj” documentation, but not the proper FMX file ditto. And fmxj looks nothing like FMX, it seems.Why has this crucial piece of documentation been removed ?Can I find it somewhere else ?Cheers

413
jovitaatsafe
Safer
fmelizard
Safer
fmelizardSafer
asked in Integration
HTTPCaller and Twitter API authentication problems

I am currently starting a project requiring me to pull images and videos from a Twitter page. Originally, I was using the TwitterStatusFetcher transformer to pull the individual JSON object of every tweet, and extract the corresponding image and/or video. While this was working to an extent, I noticed that the JSON extracted from the TwitterStatusFetcher at times did not contain an image and/or video when there should've been one. I believe this is due to a recent change in Twitter's API requiring an extra parameter (tweet_mode=extended) to retrieve a full tweet. As such, I've been trying to access the Twitter API directly with this extra parameter, using the HTTPCaller transformer. However, Twitter requires the use of Oauth 1.0 for me to pull tweets. I'm unsure of how to set up the web connection for Twitter to use Oauth 1.0, as FME 2016.1 uses Oauth 2.0 to establish a web service. I have all the required consumer and access tokens already, I'm just unsure of how t

1045
wisdomisaac541
Participant
marta.podsiad
Supporter
marta.podsiadSupporter
asked in Integration
DYNAMIC plugin

Hi,I’m experiencing issues with searching for a path for a PDF. Unfortunately, the process is extremely slow and seems to be stuck at this message. Could you please advise on how to proceed? 

251
hkingsbury
Celebrity
marta.podsiad
Supporter
marta.podsiadSupporter
asked in Integration
DYNAMIC plugin loading

Hi,I’m experiencing issues with searching for a path for a PDF. Unfortunately, the process is extremely slow and seems to be stuck at this message. Could you please advise on how to proceed? 

252
marta.podsiad
Supporter
louis_boekhoudt
Contributor
louis_boekhoudtContributor
asked in Integration
Attribute convertion

Hi, I am in need to convert an attribute with “188-195” as value (Wich means 188up to and including195) in “188;189;190;191;192;193;194;195”.How can this be done in FME workbench 2024.1.0.0.With a  combination of transformers AttributeCreator, AtributeSplitter, ListElementCounter, ListExploder and AttributeManager I am be able to produce the 8 new features. THNX.

613
bwn
Evangelist
saravanakumar
Supporter
saravanakumarSupporter
asked in Integration
Feature reader not reading data when run from bat file ?

Hi FME Enthusiasts,I am trying to run a fmw file by running a batch file. I tried to read smallworld data then convert into some other format. I create a batch file to execute but reader does not read the data. So I passed single record as input and ran the bat file it could able to read and converted into my destination format. but if i passed 100 records it was taking long time and waiting at “Getting feature using command number: (0)” it not moving further. If I manually run the same data with same fme workbench straight , which is working fine without any struggle. if anyone faced this kind of scenario early?.   

553
saravanakumar
Supporter
bpoffet
Contributor
bpoffetContributor
asked in Integration
Default background Map Authentication - Connection failed

When i try to “inspect feature caches” or “view sources data” it does not work and i get this error message :  I am not able to use any defaut background map. When I click on “OK” then the software crash.  Any suggestions ? 

1234
raymondbrunner
Contributor
cfdune
Contributor
cfduneContributor
asked in Integration
FeatureReader crashes on reading ArcGIS Pro filegeodatabase

Hello,as it says in the title: FeatureReader crashes on reading ArcGIS Pro filegeodatabase. For my work I built a workbench were previously data got written to an Arcmap *.gdb which worked flawless. But now since my company is switching to ArcGIS Pro, I'm had to update the *.gdb to the ArcGIS Pro standards to be able to work with annotations. After running it with that updated *.gdb I received errors. After some fiddling it seemed that the issue was resolved. But a few runs later I found out that there were some attributes that I had to alter to the *.gdb to streamline it for later production steps. No probs so far. After doing that, the FeatureReader i use came up with the old attributes, and not the newly inserted. So I thought, I'll repoint it to the *.gdb, after doing so, the workbench crashed…I've tried different things to find out where the problem lies: Maybe a feature had bad geometry? Maybe to many features? Maybe the *.gdb was corrupted? But nothing I did helped. As a last st

1356
rogbak
Contributor
stlj
Contributor
stljContributor
asked in Integration
FME Flow Stream connection to IBM MQ 9.3

Whats is the best way to connect to an IBM MQ 9.3 message broker from a workspace running as a stream on Fme Flow 2023? We need to be able to process several hundreds of messages/sec. I’ve done quite a lot of testing with the MQTT connector transformer and Mosquitto MQTT broker. Very fast and reliable. IMB MQ only supports AMQP 1.0 protocol and the question is if there is a connector transformer I can use for that? Fme Rabbit connector supports AMQP 0-9./Stefan Ljungstedt   

881
mattmatsafe
Safer
markrmunoz
Contributor
markrmunozContributor
asked in Integration
CityWorks Web Connection

While attempting to set up a web connection to cityworks via FME/ESRI’s data interoperability externsion, the connection continues to result in “Unable to authenticate using the specified connection information”.  We are on CityWorks Server 15.4.2 so the authorization token is set to be passed by query string.  Any other changes or tips that we should try?

653
debbiatsafe
Safer
A
adriaan
asked in Integration
SSL connect error

Hey all, I'm trying to do some webservice calls with the httpcaller. Unfortunately i'm getting the famous SSL connect error. I've tried setting the 'verify ssl certificate' to no but i'm still getting the error. I'm using FME 2020.1 and as an example i'm trying to do a get on the next endpoint/url:https://jira.atlassian.com/rest/api/latest/issue/JRA-9 My http caller settingsThe endpoint in the browser gets a nice Json back as response. The httpcaller however doesn't. The certificate is a wildcard certificate (could the be an issue?).Can anyone check it out if it works for them or if they get the same result? Just wondering cheers

7897
carmijo
Supporter
errin_rowan
Participant
errin_rowanParticipant
asked in Integration
FME unable to Post to Referenced Service in ArcGIS Entperise

Hello, i need some help here.I recently had my workbenches stop working. I am pushing updated into to referenced feature services in arcgis portal. I have re-created every reader, wriiter and parameter but cant get the same process to work again.I have made new workbenchs and new connection where i have just Readers and Writers (No Transformer) and i cant FME to push changes to featuer services.The error’s i am get is :ArcGIS Portal Feature Service Writer: Encountered an unexpected error. The error code from the server was '500' and the message was: 'Unable to complete operation.'. Details: 'No edits ('adds', 'updates', 'deletes', 'attachment edits', or 'asset maps edits') were specified.'BADNEWS: ARCGISPORTALFEATURES writer:Or“Could not find a layer/table matching the feature type”It Seem to JUST be a FME issues as i can access the Rest end point and use post to make edits, using fme i can update hosted serivces. It isnt a permssions issues and to my knowledge nothing has change on th

401
kailinatsafe
Safer
ridleyj
Contributor
ridleyjContributor
asked in Integration
Why does sharepointOnlineConnector show only one web connection, when multiple are installed in the connections list?

I have had success in connecting to my corporate Sharepoint with the SharePointOnlineConnector using the web connection as set up in this HowTo: How to create a Sharepoint Web Connection (safe.com). Now I want to connect to another Tenant for which I have been granted access, but the connector only presents me with the Safe Template version for my web connection - even though I have set up and succesfully tested a new connection with a new name. I tried testing on a new machine, with no previous connections, and imported the new connection via xml then tried to add the web connection from within the transformer - same issue - the dropdown list doesn't show me the newly created connection (no matter what I call it):Can anyone advise on what needs to be done to connect from a selection of web connections for sharepoint?

13614
natalieatsafe
Safer
jkr_wrk
Influencer
jkr_wrk
asked in Integration
HTTPCaller: Upload binary attribute

Is it possible to upload a file as Multipart Upload without first writing it to the filesystem?I have this working:But this requires to first write the attribute to a file and then using the filepath to upload.I tried base64 encoding the binary attribute and uploading. But I dont know what to set the mime-type to._response_body (string: UTF-8): { "args": {}, "data": {}, "files": { "temp.zip": "data:application/octet-stream;base64,AAAAAAAAAAAAAAAA=" }, "form": { "token": "tokentokentokentokentoken", "f": "json", "archive": "true" }, "headers": { "host": "postman-echo.com", "x-request-start": "t=1722253286.223", "content-length": "201671", "x-forwarded-proto": "https", "x-forwarded-port": "443", "x-amzn-trace-id": "Root=1-66a77fe5-2101668c0d99d0fd01e61cc4", "user-agent": "FME/2021.7.42.21821 libcurl/7.79.1 (OpenSSL/1.1.1n) Schannel zlib/1.2.11 WinIDN libssh2/1.9.0 nghttp2/1.44.0", "accept": "*/*", "accept-encoding": "deflate, gzip", "cont

837
jkr_wrk
Influencer
jp12212
Contributor
jp12212Contributor
asked in Integration
DWG to GeoJSON

Hi, Just was hoping for tips on Converting DWG to GeoJSON - is there any one who can lend an explanation I’m attempting the below and it’d be great if someone could offer a high level understanding / approach.  

2711
donalmateer
Safer
alsherren
Contributor
alsherrenContributor
asked in Integration
Salesforce connected web app - web service configuration issue

Hi,I am trying to configure a web service to use the Salesforce Connector.  When trying to test the connection, I keep getting error:error=redirect_uri_mismatch&error_description=redirect_uri%20must%20match%20configuration I believe this relates to the callback URI syntax, but I don’t know what it should be.. any ideas?

1669
alsherren
Contributor
capizziemanuele
Contributor
capizziemanueleContributor
asked in Integration
Publish IFC files as Scene Layers

Dear all,I have multiple IFC files in my folder and have to publish them as Scene Layers in ArcGIS using FME.Do you have any suggestions on how to proceed, and which is the best way to proceed? Many thanks. 

420
capizziemanuele
Contributor
lavanyaneeru
Observer
lavanyaneeruObserver
asked in Integration
Azure Devops integration for FME

Hi Team, Can we integrate FME flow and FME server with Azure Devops using pipelines?

1141
mark2atsafe
Safer
topotoma
Contributor
topotomaContributor
asked in Integration
Embedding an HTML Iframe in Arcgis Online Popup

Hello, I have been trying to figure out how to embed a website in ArcGis Online popups but could not get it to work.I have tried the method to have an attribute with the Iframe code as some suggested in earlier version it was interpreted correctly but it seems this is not the case anymore.I have found that there’s a way to embed video for example but nothing for integrating a website. So if you have any suggestion that would be great. Thanks.Thomas 

2743
topotoma
Contributor
marta.podsiad
Supporter
marta.podsiadSupporter
asked in Integration
Tester with Operator as a Parameter

Hi,I would like to create a workbench that will allow the user to make unique slecection from Excel document by entering not only value but also the operator. Is that functionality available?Example  

231
hkingsbury
Celebrity
ahmadrezakarim
Contributor
ahmadrezakarimContributor
asked in Integration
SharePointOnlineConnector Multiple Download FIle

Hi everyone,I have an SHP file related to some parcels. For each parcel, there is a corresponding folder and contract (with the same name). My goal is to create a workspace based on the ready SHP files (using a simple tester transformation). The SharePointOnlineConnector should then download the corresponding contract from SharePoint and place it in a local directory.My main challenge lies in how to locate each contract. Currently, I’ve set up the SharePointOnlineConnector to create a list from the directory. Then, I use another SharePointOnlineConnector to download the contracts. However, during the second SharePoint transformation, I encounter an error:SharepointOnlineConnector: Error making request to https://graph.microsoft.com/v1.0//sites/[my_share_point_name].sharepoint.com,3a2333c0-9794-425a-9978-a2eb613fc15b,c38a05da-86b2-48bd-a5b5-e80371d96e57/drives/b!nqLU0gc2Y0OJ_TIlc0aqVX_zKy7OiIFPltGPSW8STP_RoqJOec4jSbMoWXb1-7Y7/items/01MI2PLMPJAT7XK24RXZGJDFNW2D7PE4KR: The resource could

631
nielsgerrits
VIP
kersy
Contributor
kersyContributor
asked in Integration
Executing FME Workbench Using Python Script for Batch IFC Processing

Hi everyone,I'm working on a project where I need to process multiple IFC files and write the data to a PostgreSQL database using an FME workbench. I've written a Python script to automate this process, which includes getting IFC input from the user and executing the FME workbench. However, I'm encountering problems when passing multiple IFC files to the FME command line.Any ideas? Main Idea:Getting IFC Input from User: The script prompts the user to enter the path to a directory or a single IFC file. Running the FME Workbench: The script constructs and executes the FME command with the provided IFC file paths and other necessary parameters.I am using a PythonCreator at the start of my FME script to catch these arguments and read with FeatureReader. Currently, when I look at the FME log after I run the external Python script, I see that the paths are not parsed as parameters. Main error I see in the log files is the following:2024-06-21 21:52:52|   0.4|  0.0|ERROR |ISO10303-21: Unable

632
boydfme
Contributor
danpeek101
Participant
danpeek101Participant
asked in Integration
ArcGIS Online Feature Service Reader Error

Hi All,I have written a workspace that downloads features (and attachments) from an AGOL Feature Service, and everything was working fine until about 2 weeks ago. Then it suddenly, and for no reason that I can see, stopped working. The error message is as below:2024-07-12 09:38:47|   5.7|  2.1|ERROR |ArcGIS Online Feature Service Reader: Could not connect to server. Check that you are connected to the internet and that no firewall is blocking outbound connections. The error was 'HTTPSConnectionPool(host='www.arcgis.com', port=443): Max retries exceeded with url: /sharing/rest/portals/self?f=json&token=3NKHt6i2urmWtqOuugvr9Xotftc2MEsOx2iLqu8k_LPVAUrx4ptneDwWq5gGHyWsx9gLJB14s-YhL9BcQ6A71ysFhsv00tTqKaTLWA9OxAioggyddpHKGcxUfwKFMnzU-m7-SshOGN98nlYOd2uB9-LSYOpHZbnxGUhNJ_3nnRQntaumsDD__7bZqpHVciIFHkLU-of9RGgQ17FdVaDRxF6HcXcbq9Sm4XmdkzD7LqM-h_2jGsOM8HOeFBSI6iINhlNJE65A50NL1eFOJ-gGgg.. (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x000000001D666D10>, 'C

1882
danpeek101
Participant
dbryantgeo
Contributor
dbryantgeoContributor
asked in Integration
Executing vacuum in PostgreSQL via SQLExecutor

I have a workbench that imports a lot of data into PostgreSQL (~90m records across 3 tables, 1 containing spatial data) and we've identified a possible need to vacuum the tables. The data is "cleansed" post-import via a SQLExecutor that deletes data, creates data if necessary. However, we're unable to vacuum analyze (Analyze is fine) the data once that occurs as it appears that the SQLExecutor wraps commands in a Transaction Block - which means we cannot Vacuum. Any ideas on how we can perform vacuum via the SQLExecutor or have another strategy we can utilise? I am unsure whether using the writer's post-write execution of SQL in a parameter is performed before or after the VacuumAnalyze option that FME provides. I've seen some information around setting Autocommit to on/off within the SQLExecutor but this does not work in the newer versions of PostgreSQL.  We are using an Azure managed database

1033
arthur_bazin
Contributor
colejo02
Contributor
colejo02Contributor
asked in Integration
Sluggish performance with comment field

Hello, I am a first-time poster on the FME forum. My goal is to read data stored in a plain view from a non-spatial Oracle database and then write it to an Oracle SDE geo_dbtable. The issue is that my Oracle Non-Spatial Reader slows down, taking more than 30 minutes to execute the SQL Statement when I include two comment fields that are long, 2000 characters. When I run the same query in SQL Developer, the result is back in a few seconds.   The log message that gets stuck on is:  ORACLE Reader: Executing SQL Statement `SELECT…<field names> to obtain features for feature type <Oracle View Name>If I uncheck the comment fields in the User Attributes tab the reader returns quickly, within a minute.  So I’m skeptical that it is caused by network distance.  Given these challenges, I need some guidance. I’ve tried using an Oracle NCLOB to hold the comments in the view, but the result remains sluggish. I'm eager to learn how to optimize my workbench's performance when dealing with

321
colejo02
Contributor

Badge Winners

  • Student (Bronze)
    wrijshas earned the badge Student (Bronze)
  • Student (Grey)
    nick3_s75has earned the badge Student (Grey)
  • Teacher (Grey)
    nick3_s75has earned the badge Teacher (Grey)
  • Welcome Back
    nick3_s75has earned the badge Welcome Back
  • Student (Bronze)
    geo-xhas earned the badge Student (Bronze)
Show all badges

Community Stats

31,198
Posts
118,251
Replies
38,801
Members

Latest FME

Terms & ConditionsCookie settings
A product of
Safe Software respectfully acknowledges that we live, learn and work on the traditional and unceded territories of the Kwantlen, Katzie, and Semiahmoo First Nations.