Integration

Is it possible to FTP and create a binary file from attribute?I need to http pull binary files, eg pdf, xls and then FTP them elsewhere as part of a migration I don't really want to download to file so it would be better to download to attribute then FTP up. There is no option to set as 'fme-binary'  

Hello:(apologies if this is a double post. I wrote it and then signed in)I'm learning FME and APIs and have been trying to use httpcaller to retreive information from an API and convert the information into excel columns. I've figured out the httpcaller portion, but I end up with an excel file with a single column that contains all of the data for each row instead of separating each bit of data into their own columns.Any ideas on how to take the httpcaller API JSON output and convert it into a usable excel sheet? Current sample output is below.Thanks!

Workbench Flow:1. Download files from Source FTP Server to an attribute in FTPCaller.2. Upload these files from attribute to Destination FTP Server .Files in destination getting corrupted. Attached is the workbench & FME log showing more data is uploaded that downloaded for that file. File type tested are .mdb & .zipPlease advise if someone came across such issue.Thanks.

Hello,In the context of working on a GIS database I want to build the topology between existing features, for example transform some intersection points into nodes and some common segments into common edges. How this is done within FME ? I was thinking about using the topology builder but as I've seen in the documentation : ''The TopologyBuilder will not correct data - it will only find relationships and intersections that exist. ''It seems that the transformer only shows the topology and doesn't build it effectively with the data. Please correct me if I am wrong.Thank you very much. 

I am trying to use the HTTPCaller transform to access an internal web application ( mvc5) hosted on IIS8. It always returns an error 500 , regardless of the authentication method used - I suspect ho it passes the account information is the issue as if I disable authentication I get the 401. The FME desktop is on a dedicated machine with a dedicated account and this account can access the url using IE/Edge without any issues. I was wondering if the transformer supports Kerberos authentication, and if not, can someone please suggest another method I can use to read a specific web page on our authenticated web application.Note: We use 2017.1 desktop only and our network is pure Windows with no internal proxy for routing.Any suggestions at this point would be greatly appreciated, as this is driving me crazy.

I am trying to generate a report to include a static image of GIS data that one would see on an AGOL webmap\\app. It seems like this should be able to be done using the HTTPCaller transformer and having it GET the image from a URL that leads it to the ArcGIS REST Services - Export page. I can go to this page and manually enter in the bounding box parameters, map scale, and format and get the image that I want. But when I put this URL in to the HTTPCaller or the ImageFetcher, I get no image returned. Can anyone provide an answer as to why I am not seeing anything returned or has gone through this process and can share how they completed this task?Can I enter in these query parameters with the URL or do I have to enter them in through the 'Query String Parameters'? *Couldn't get that to work either*  I am fairly new to FME so my issues are most likely a lack of knowledge. 

I installed ArcGIS 10.2.2 and ArcGIS for Desktop and 64 bit Background Geoprocessing, So I can use FME 64bit to output shp or Esri Geodatabase (File Geodb) format, but even if the processing succeeds, the error message "Error running translation." will be displayed at the end at the end. I tested it with FME 2017.1.2.1 and FME 2018.0.0.0, The same problem occurs.How can I prevent this message from appearing?

Hi All,There's a website (http://www.gpsvisualizer.com/convert_input) that can convert drone GPS log file to KML by uploading a file (file extension is *.UBX) to the website and able to download the kml after the conversion.(FYI, FME cannot read/convert UBX file) Can FME upload a file to the website (for data conversion) and download the result (kml)?looks like"HPPTCaller" has the file upload capability, but how I can get the parameters info? and how can I download the data? thanks a lot!!!!!Wilson  

Hi.I've just encountered a mysterious error in a PythonCaller in a workspace :2018-11-07 20:17:02| 811.7| 3.9|WARN |Python Exception <NameError>: global name 'feature' is not defined 2018-11-07 20:17:02| 811.7| 0.0|WARN |Traceback (most recent call last):  File "<string>", line 16, in input NameError: global name 'feature' is not defined  2018-11-07 20:17:02| 811.7| 0.0|ERROR |Error encountered while calling method `input' 2018-11-07 20:17:36| 843.3| 31.5|FATAL |Delete_temp_file(PythonFactory): PythonFactory failed to process feature  The problem is, that my code in the "Delete_temp_file" PythonCaller transformer doesn't have any variable named "feature" in it (I renamed it from the template's "feature" to "ft") :import fme import fmeobjects import os  class FeatureProcessor(object):  def __init__(self):  pass  def input(self,ft):  try:  pass  pt

Hello, is there any way to run code from .Net DLL or executable from within FME Workspace? I know that we can use systemCaller and run it or use python and then execute it from that script but maybe there is any other, let's say more integrated way?It would be even better to have a possibility to write custom transformer in .Net with access to FMESession etc. Thanks for any hints.

I'm having problems running a HTTPCaller with a particular request on a terminal server with a proxy in place. No matter how long I set the transfer timeout for it always gets a transfer error when it reaches that timeout value.I know this request works because I've tried it on my local machine and it completes in about 8mins (timeout set to 15mins). The only difference I can think of is that my local machine doesn't need to go through a proxy whereas the terminal server does.I also know that a different request to the same web service on the terminal server work fine too so it doesn't appear to be an issue with the proxy server. This other request that I run completes in a matter of seconds, it is just the request that takes a long time to complete that won't work.The error in the log looks like this:HTTPCaller_3(HTTPFactory): HTTP/FTP transfer error: 'Timeout was reached'HTTPCaller_3(HTTPFactory): Please ensure that your network connection is properly set

HelloI am trying to download multiple records using HTTPCaller from a API endpoint. I need to get all records updated in last 7 days. I plan to schedule to run this on daily interval.I have used a query to get the max date and passing it to get recent data. The issue is that the API only allows 1000 records at a time. One has to set an offset start at 0,1000,2000 etc to get additional records. I dont know the number of records updated until i query all of them 1000 at a time. What is the best way to loop the Httpcaller and automate it so when i run it all records that were updated in last 7 days let's say it is 1800 are downloaded.Unfortunately I cannot share the API details.

Hi All,How to find ObjectClassID from Filegeodatabase for Featureclass and How to write with same or desired ObjectclassID.This value I need to write as attribute value.ThanksVenu

Hi all,I was trying hard to find a solution for this little issue within the HTTPCaller.I'm trying to request geoJSON data from an API, so, using the HTTPCaller works fine until the Content-type for a desired Request (POST, PUT) needs “Content-Type: application/geo+json”  As I've tried, with no luck, with this parameters: Throwing me back a 404 error...I wanted to know if there is any workaround to enable that content-type kind? I know that if I were using cUrl, I'd only need to add this Header: -H "Content-Type: application/geo+json"Btw, I'm using FME Desktop 2018.1Thanks in advance, 

Hi guys,I've tried to find any related question from this one, and no luck, so here is my doubt:I want to use HTTPCaller to send a GET, POST, UPDATE,... request to this RESTful API:APISo, authenticating the request is necessary and I'm not well related to the transformer HTTPCaller, so, I'm not sure if there is any particular option/way to insert the Token within the requests. Should be put the Token value within a the Header? I'm totally lost.If I plainly send the request , throws me back a http error:HTTP/1.1 401 Unauthorized - https://xyz.api.here.com/hub/spaces?includeRights=false&owner;=meCould you give any hint?Thanks in advance,

I'm trying to download a file from a site that requires a password and a button press. I'm using HTTPCaller, with POST as method. The Body option is Multipart/Form Data, the Multipart Upload is password, String Upload, (the password) and btn-open-file, String Upload, OpenUnfortunately, I'm only receiving the following error:<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN"><html><head><title>502 Proxy Error</title></head><body><h1>Proxy Error</h1><p>The proxy server received an invalidresponse from an upstream server.<br />The proxy server could not handle the request <em><a href="/public/file/1TcNS1xp_kyoFY4B3JiaUA/SSF-GIS-Daten.CSV">POST /public/file/1TcNS1xp_kyoFY4B3JiaUA/SSF-GIS-Daten.CSV</a></em>.<p>Reason: <strong>Error reading from remote server</strong></p></p></body></html> Also, this is the login form and source:What's the issue here? I found thi

When I do this api request using an HTTPCaller:https://ckan.dataplatform.nl/api/3/action/tag_show?id=enquêteI get this error:HTTPCaller_7(HTTPFactory): Received HTTP response header: 'HTTP/1.0 400 Bad request' from 'https://ckan.dataplatform.nl/api/3/action/tag_show?id=enquête'When I do the same request from within my browser (Chrome and Firefox), I don't get an error.I tried adding header parameters to my request:Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8 Accept-Encoding: gzip, deflate, br Accept-Language: nl,en-US;q=0.7,en;q=0.3But this didn't work.Something is going wrong when HTTPCaller encodes diacritics. How do I fix this?

Dear All and peopleAtSafe,I have reviewed few threads in community on migration to ESRI UN data model.There are 2 ideas postedFor Reader: https://knowledge.safe.com/idea/53502/read-the-esri-utility-netowrk.htmlFor Writer: https://knowledge.safe.com/content/idea/53497/write-to-esri-utility-network.htmlReply from @MarkAtSafe says "We are still in the process of developing a UN feature service reader and writer".Further @trentatsafe posted workbenches for both Gas and Waterhttps://knowledge.safe.com/articles/72048/utility-network-migration-tools.html I want know few things…1. I’m a beginner in UN model, when FME is capable of reading/writing to GDB/SDE then what is the need of additional reader/writer? Currently, Does FME don’t have capability to read or write of UN model or in other words UN model is not present in GDB/SDE?2. With the help of workspaces provided in the links, can I use them as-is and migration of data can be achieved from UPDM model to UN model without any us

HiSo before anything I've been browsing this topics for a week now, with no solution in sight.An error occurred while attempting to open an insert cursor on the table 'XXXX'. The error number from ArcObjects is: '-2147216556'. The error message from ArcObjects is: {Objects in this class cannot be updated outside an edit session [XXXX]}A fatal error has occurred. Check the logfile above for details What i've been trying:Change Transaction type to: 1: Versioned Edist Session, 2:Non- versioned Edit Session, 3: Transactions, 4:NoneDelete all attributes on a given feature to see if some was causing troubleOverride username, password with the sde userChecking that there are no locks on the featureAsserting correct FeatureClass or table NameAsserting correct FeatureClass or table QualifierAsserting correct Feature DatasetAsserting correct geometry typeDrop Table (yes and no)Truncate table (yes and no)Tried setting the attribute geodb_feature_dataset manually with correct valuesAnd lastly togg

Hi,  I have made a workflow that connects to a web API using the HTTP caller. I authenticated with Oauth2 and everything worked fine with my own account on the API service. I then went on to make separate web connections for the accounts of my colleagues. But now I got "access denied".   It turns out when retrieving the user info with the HTTP caller it logs on to my account no matter what web connection I set in the HTTP caller. I even removed the web connection with my own credentials completely but still I get a json response with my account details.  How is this even possible and is it a bug in the HTTP caller or the API I'm logging on to?   Thanks! 

Hello,I'm new to FME and I'm trying to write a PythonCaller in a Custom Transformer. I have a working standalone python program that uses the following code to load a DLL:  SourceFolder = os.path.dirname(__file__) giqdll = WinDLL(os.path.join(SourceFolder, "LibGIQ.dll"))  When I try to use this in my PythonCaller I get the following error:  Python Exception <NameError>: global name '__file__' is not defined  Is there an FME way of finding the full path of the fmx file?  Thanks,  Paul Michell

Hi,As far as I can see, it's not possible to open a FTP based dataset directly in a reader (MapInfo TAB) ?And FTPCaller only allows a single file to be downloaded at any time ?I have multiple folders with multiple datasets (consisting of multiple files) to import, and doesn't want to do this one file at a time.The optimal solution would be to open the datasets with a wildcard directly in a reader. Just like how you can within a ZIP.How to proceed ?Cheers.

Hi There, I am reading data from a 10.4 Geodatabase (on SQL server) using Microsoft SQL Server Spatial writer. I am also writing this data to 10.4 Geodatabase (on SQL server) using MS SQL Server spatial writer. The update process runs fine but when I open the features in ESRI ArcGIS, I get this error. I noticed that it happens only with lines, point datasets work fine. Underlying DBMS error [[Microsoft][ODBC Driver 13 for SQL Server][SQL Server]A .NET Framework error occurred during execution of user-defined routine or aggregate "geometry": System.ArgumentException: 24144: This operation cannot be completed because the instance is not valid. Use MakeValid to convert the instance to a valid instance. Note that MakeValid may cause the points of a geometry instance to shift slightly.System.ArgumentException:

Hi,is there a way to easily extract all the NFL stadium polygons from open street map?Thank you

Hi ,Does anyone know how could I read a web map service that contains a raster layers?Thanks,Rawan