Connecting FME to web services. Use of APIs. Mobile Apps.
Recently active
Hey all, I’m wanting to snap existing meter points in a Water Utility Network, to field-verified points collected in the field by a contractor. Currently, I am just using an anchor snapper to snap the points, however… the service lines attached to them are not moving, as I believe an “edit” has to be done on the lines to get the network topology to stay intact. I have tried using the anchor snapper on the lines to snap the endpoint to the meter location… but I am not getting the same results I am getting with the points. Is there something I am missing/a better way to ensure the line attached to the meter also moves its endpoint to the new meter location? CS is State Plane, 100 feet is the setting I am using for now. The endpoint of the service line is coincident with the meter location, if that information helps at all.
I am researching options for a GIS data catalog and data lineage system. There are some GIS data catalog tools out there (Ex. Voyager) but they lack a method to store the ETL lineage information. For example, I'd want to map that the Streets feature class in my Oracle geodatabase is sync'd to an AGOL feature layer named "City Streets" every night at 3AM. Some of the data lineage tools on the market can connect to ETL applications (Informatica, Azure Data Factory, etc.) and scan them to get source/target information from all the tasks configured in the system. I haven't seen Safe/FME show up as being supported by any of these products. So I'm curious if anyone's come across a product that can scan for this stuff. Alternatively there's always manually populating these systems by reviewing all the FME Server job logs and investigating source/targets in the workspaces.
Hello dear communityI am a real beginner when it comes to PythonCaller. I need the syntax to create a group processing with this transformer. My problem: Persons on an address belong to a group. A new attribute should be created based on another attribute in the group.I have already generated a basic program with Copilot, but I always get an errorPython Exception <TypeError>: process_group() missing 1 required positional argument: 'group'The code reads:import fmeobjectsclass FME_PythonCaller: def __init__(self): self.data = [] self.log = fmeobjects.FMELogFile() self.log.logMessageString("FME_PythonCaller initialisiert", fmeobjects.FME_INFORM) def input(self, feature): self.data.append(feature) self.log.logMessageString(f"Feature eingelesen", fmeobjects.FME_INFORM) def close(self): try: self.log.logMessageString("Start der close() Methode", fmeobjects.FME_INFORM) address_groups = self.group_by_attribute(self.
Postman connects easily to Veoci (emergency management software) via a two-step process:1) Get a private token;2) Submit query using the private token. These is done in two separate steps:Step 1 (https) returns five new or updated Veoci cookies in the headers, two of which are APIALB and APIALBCORS. Their values are identicalStep 2 (https) returns two more new or updated Veoci cookies: APIWALB and APIWALBCORS. These two values are identical (to each other).These four cookies appear to be related to Amazon.I want FME to combine the two steps into one (and let me store the results in a relational database).Step 1 works fine in FME. In fact, the pattern of packets matches exactly.Step 2 unfortunately returns the message “Authsession not found in cookie” no matter what I try. I know conversation contains a permanent redirect (looks like Amazon) and I think this is the problem.Even running Step 2 alone in FME always fails.I’ve tried configuring the HTTPCaller in Step 1 and the HTTPCalle
Hi everyone,We have floating licenses and installed FME Form in a server, and the users will login to that server to use FME. So, my question is How many users can run the same workspace using FME Form in a same server at the same time? My user has different username and password to access the server. Please advise. Thank you.
Hey everyone, I’m currently trying to get a workspace on FME Flow that makes use of the AutodeskDocsConnector. This single transformer would make my worksapace a lot smaller and easier to manage. Problem is that it just won’t work FME Flow! On Form it works without a hitch. On Flow accessing the same project and folder on Autodesk Construction Cloud also works when using the HTTPCaller. It’s only the AutodeskDocsConnector on Flow combo that seems to be failing me. This is the error message I get on Flow: Anyone have experience with this or know how to help me out on this one?
Hi FME Community!Does anyone know how to create a web service in FME form to connect to ArcGIS Portal?i see this article (https://support.safe.com/hc/en-us/articles/25407635174285-Web-Connections-and-FME#h_01J0S3JP9A7W1TX5B2GG56ZX8S) but could not figure how to properly fill all the parameters to get it working. my goal is to create a token based web connection to authenticate requests to endpoints stored in ArcGIS portal.Thanks in advance!
Does anyone have a sample Workbench (WB) for creating a replica using the ArcGIS REST API?
Hi,I’m wondering if it’s possible to create a list of layers included in an online application like Geoportal Map. I tried using the HTTP Caller, but I’m only getting general information about the webpage and no details about its content.Do you have any suggestions for extracting this data?
Hi all,I’m working with a Feature Service containing approximately 1,000,000 sensors stored in a spatiotemporal big data store. I need to update 10,000 of these sensors based on their unique string ID, like sensors-0x21222.Currently, I'm using the FeatureWriter for the 'Esri ArcGIS Portal Feature Service' with the 'Use Global IDs' option enabled and 'Upsert' set as the 'Feature Operation' in the Feature Type. However, 'Upsert' requires a global ID.This approach feels very constrained, as it requires importing all 1 million records, merging them, and finding the global ID for each update.Is there a way to update a Feature Service using a primary key or unique field (such as upserting with a where clause) rather than relying on global IDs? This current method doesn’t seem ETL-friendly, as it requires importing parts of the dataset just to make updates.Thanks in advance for any guidance! Edit:Maybe I don't understand it. But for every featureservice/layer/featuretype I need to add, to fi
Hi everyone,I am brand new to FME and created my first workbench. In a nut shell it does this:Brings in 6 different enterprise geodatabase feature classes using 6 ESRI Geodatabase (ArcSDE Geodb) readers Each reader is connected to a tester to only select ‘active’ values in a status field Because I selected ‘resolve domains’ in the reader, an additional field for every field that had a domain was created. It was suffixed with “_resolved”, so I used 6 bulk attribute renamer transformers to rename the fields without the ‘_resolved” I then did 6 attribute removers and removed any fields I did not need when it came to exporting (note, many of the fields between each feature class were the same, but there were some differences) Finally, I used 6 different feature writers to export each feature class into a single geodatabaseAs you can see, I repeated the process 6 different times for every reader/feature class that I had. I was thinking to myself while doing this, ‘this cannot be the right w
Hi, I am trying to connect to Amazon RDS Microsoft SQL and I couldn’t find any documentation, connection or connector avaiable for FME Form. Is this only available on FME Flow?
I am having a simple workspace; just a reader and writer (see screenshot below).The FeatureReader reads from a Microsoft SQL Server Non-Spatial and the FeatureWriter writes to Microsoft SQL Server Non-Spatial. The datamodel in both databases is the same and in the target database the table already exists.When writing it to the database there are warnings about the field type. For example (see also screenshot below)Microsoft SQL Server Non-Spatial Writer: Attribute `.....' of feature type `.....' has specified type `varchar(1)', but existing database table field has type `varchar(2)'. Information may be lost during conversionIt seems to double all the varchars; and also getting messages about bigint vs numeric. The data is correctly written in target but I want to get rid of all the warnings. I have tried various thing with reading the schema from both the source and the target table. Also tried with 'normal' readers and writers. And also tried with JDBC reader and writer.Does anyone ha
Hi,Some parameters of the coordinate system on the screen are not compatible with Türkiye. I know what the values are and I want to edit this file. Especially, it seems that just changing the delta x y z section in the datum parameters section will be enough. can you help?
I want to read PDF files as images using OpenAI's Vision API to extract information. I realized that FME's PDF reader tool has issues with PDFs containing text created by digital signatures—it cannot read them either as text or as images. Therefore, I decided to use PythonCaller to create image files from the PDF files to ensure the data is complete. Below is my code: import pdf2imageimport fmeimport fmeobjectsimport osclass FeatureProcessor: def __init__(self): pass def input(self, feature): pdf_path = feature.getAttribute('path_windows') images = pdf2image.convert_from_path(pdf_path, dpi=300) for index, image in enumerate(images): image_feature = fmeobjects.FMEFeature() image_feature.setAttribute("page_number", index + 1) temp_dir = "D:/temp" if not os.path.exists(temp_dir): os.makedirs(temp_dir) image_name = f"{feature.getAttribute('path_rootname')}_{index + 1}.png"
Full error;PROJ: proj_create_from_database: crs not foundMicrosoft SQL Server Spatial Reader: Failed to read coordinate system from SQL Server because FME does not know about coordinate system `EPSG:102003'I can use 102003 in the ProjReprojector tool, but, rather than assign _FME_0 as the CRS for this table, it leaves it as unknown, which means the reprojector tool fails, and 102003 doesn’t exist for me to use in the CRSSetter transformers. How do I set the CRS in feature reader when my desired CRS is not in the catalog (note to FME: this is also a request) I tried defining a custom projection here; demos-safe-software.fmecloud.com/fmedatastreaming/Coordsys/Start.fmw?&token=01655ff804fe3b23f29a7b65568c51e81cd09691but this workbench failed in translation / does not create .prj file I can use.
Looking for a workbench that updates an SDE attachment layer from a sync enabled HFL with attachments on AGO. The SDE layer with attachments is not archive enabled.
Hi folks, I’m trying to execute a python script using Python Creator. The flow is running as expected also with expected outcome, but its giving this error - I have checked the updates is FME package but still not working.Not getting why this error is occuring. If anyone has any idea about it, kindly help. Thanks in advance.
FME Desktop version: FME 2021.2I was trying to follow this article on How to Create an ArcGIS Enterprise Portal Web Connection (OAuth 2.0) (https://support.safe.com/hc/en-us/articles/25407772142733-How-to-Create-an-ArcGIS-Enterprise-Portal-Web-Connection-OAuth-2-0)It was going well until I tried to 'test' before moving on to Step 3 and I got the following error (see also attached):Unable to Retrieve access tokenRequest to update access token failed. HTTP Error HTTP/1.1 401 Unauthorized Does anyone know what this error in referring to?
hello,Despite reading all post about my problem i could not succed in solving my problem.error message is : “Python Exception <ModuleNotFoundError>: No module named 'qgis'”
Hi all,I have been informed by our IT department about the requirement to ensure that the publisher of our Azure app is verified by Microsoft. You can find more information on the publisher verification process here: Publisher Verification Overview.Could anyone from the confirm if this verification process is already being arranged, or if there are any steps that we need to follow to initiate this process?
Currently we are using FME work bench to connect to S/4 via OData, however there are performance issues with using Odata, Is there any threshold limit uptil which FME can support the data extract using Odata without any performance issue. Any document or any recommendation from SAFE.What are the other options to connect to S/4 Rise if we do not want to use OData, our FME will be in AWS .What all config options we have other than OData to get rid of the performance issues. If at all there are other options available what all are the components needed to have the same Please help urgent
I have coordinate list. I want to draw a dodecagon with a known radius.example
Hi there, I have a workbench published to FME Flow. In the workbench I have a SharepointOnlineConnector which reads in an Excel Sharepoint spreadsheet, and downloads it to my shared data source in Flow server. The workbench runs successfully and the output (a table in ArcGIS Online) says it has updated, however the values are all old data. When I run the workbench manually from Form, the SharepointOnlineConnector reads the current data in the Excel. Any pointers on how to get Flow to read the current Excel Sharepoint?
Hello! I'm working with one of our legacy systems built in Microsoft Access, and I need to extract data from a query. So far, the only method I’ve found involves using the system caller and command prompt. Are there any alternative ways to achieve this?I've tried using the system caller, but I’m encountering security issues with the runtime version. It appears that I need to set the location as trusted, but I can't do that with the runtime alone. We're aiming to avoid installing the full version of Access, so we're limited to using just the runtime.