Data Virtualization

We are working through the setup of a service user for a project, intended to only be able to create and run its own Data Virtualization APIs and nothing else.  The aim is to avoid excessive permissions. I have been searching for a list of recommended or minimum permissions but have not yet established that, so I’m putting the question out here.We have granted:Create/manage for data virtualization Run jobs Access Resources/DataWe’re looking into other permissions.We’ll work through it but I am definitely thinking that documentation of this would be handy from the Safe point of view to save time, if possible.  Possibly as an addition to https://support.safe.com/hc/en-us/articles/36098228739469-Secure-Data-Virtualization-Endpoints-with-Authentication 

Quick question; if I want to use a token to authenticate my Data Virtualization, rather than a FME Flow user, I need to build it myself, correct? (and then do that for all endpoints of course)

Hi FME’ers,Recently I wanted to set up FME Flow to receive notifications from a notification service. My initial thought was to use an Automation with a Webhook trigger. Unfortunately this didn't work, because I couldn't register the Webhook URL in the external notification service, because it resulted in a validation error. After further investigation, it turned out that the notification service was set up using the Guidelines for NL-GOV profile CloudEvents 1.0. In 3.1.3 Abuse protection it's indicated thatThe validation request uses the HTTP OPTIONS methodFor this purpose, I thought about using the new Data Virtualization functionality of FME Flow, and found this article Webhook Verification Using Data Virtualization that looks very promising for my usecase. When I had a further look though, it seemed to me that the the HTTP OPTIONS method isn't supported for Data Virtualization endPoints (it appears that only GET, POST, PUT and DELETE are supported).See also this page on the Web Use

 Using $ref in FME Flow Data Virtualization APIs for Deduplication This might be an imprecise post, but my question is whether FME Data Virtualization follows the exported API specification or the visual editor’s interpretation - and why. I need guidance on restructuring my specifications: Data Virtualization seems to accept arrays of schema references but silently drops them, replacing them with blank references in properties but losing the json-type array in endpoint responses.This inconsistent handling of $ref makes it unclear how Data Virtualization processes schema references — especially for arrays, since the visual editor only supports $ref for objects. Thanks for taking the time in advance!EDIT: Im am currently using FME 2025.2.4 Build 25835 The Use Case of Arrays with $refHere is an example usage of Arrays of Referenced Objects from the OpenAPI spec. I use the schema /pet a lot for Deduplication. Also having Arrays of type pet. How would one achieve this in FME? 4.7.8.3 Paths

For one of the first versions of Data Virtualization, it is required to create a work-around for IIS. Unfortunately it is not possible to react on the knowledge article directly anymore.I just updated to build 25835 and after a quick test I see the work-around is still required. From which version onwards is this not necessary any more?

Hi,I’m relatively new to FME and currently doing some self-teaching for my company. At the moment, I’m trying to use an Excel Writer with a fanout expression to create hierarchical folders and files. The challenge is that I’m working with a bathymetric raster layer, and my workflow is primarily in CARIS, so the output files must be compatible with CARIS.I’ve tested several export options and found that .csv and .shp files work, but other formats do not. Does anyone have suggestions on alternative ways to create these folders and files while ensuring compatibility with .csar or caris compatible point cloud files?I also wonder if I am able to export contours as anything other than a shapefile/ can it be a .hob?My fanout expression is currently: @Value(ObjectName)Raw_Data\@Value(ObjectName)_BathymetricData.csv

I was following this article where i tried to create a WMS service. Everything works as expected in FME form. Using the OGC WMS (Web Map Service) reader i am able to trigger both workspaces and get the result as expected , in my fme server jobs i also see that 2 GetCapabilities.fmw workspaces are ran and 1 getPNG.fmw workspace. I tried importing the same WMS url into ArcGIS Online but i see that only the GetCapabilities.fmw workspace is ran and not the getPNG.fmw workspace. Does anyone have some idea over why the getPNG.fmw workspace is not triggerd by the ArcGIS Online client? Thanks in advance,Keller.

Hello everyone,I hope you are doing well.I encountered an issue when trying to polygonize text in DWG data that contains Japanese characters using the Transformer: TextStroker. The text was displayed as tofu (blank squares).When I tested the same process on FME Form 2025.1.1 (Windows 11), the text was polygonized correctly without any problem.If anyone has insight into possible misconfigurations or additional steps needed for proper handling on Linux, I would greatly appreciate your advice.Environment: OS: Linux Ubuntu FME Flow: 2025.1.1 Target language: Japanese Desired font: Noto Sans CJK JP Notes:Font recognition status on OS:>(base) ubuntu:/usr/share/fonts/opentype/$ fc-list>/usr/share/fonts/opentype/noto/NotoSansCJK-Regular.ttc: Noto Sans CJK JP:style=Regular>/usr/share/fonts/truetype/noto/NotoSansCJK-Regular.ttc: Noto Sans Mono CJK JP:style=RegularI’ve attached a sample workspace and test files for reference.Thank you in advance for your time and assistance. 

My response coming back from the DV endpoint is different to the order of key value pairs in my JSON templater, why is this?  Is this expected? i.e we have no control?  

I’m having a problem with my API endpoint (both PUT and POST). It’s supposed to insert or update records in a PostgreSQL database. The database encoding is set to UTF-8, but unfortunately, any text data I send ends up stored with garbled characters (e.g. Polish letters are replaced by strange symbols).It doesn’t matter whether I call the endpoint from postman or directly from a browser the result is the same.Has anyone run into a similar issue? payload: {  "lok_miejscowosc": "Poznań"}Content-Type application/json; charset=UTF-8db result:lok_miejscowosc|---------------+PoznaÅ„        |

Hi I’m currently trying to acces the documentation of the API I'm making using data virtualization. The Swagger documentation page loads, but it seems to fail to get the correct server on which I have made the API. Due to this I can’t test any of the API calls. This is the link to the swagger documentation: https://fme-acc.nordend.eu/fmeserver/swagger-ui/?api=2fd53796-610d-4fb6-8a92-5c05335568e7#/default/getCollectionsThis is the error that chrome runs into when loading the web page.  Does somebody now what the issue could be? I have no reverse proxy on the server so I don’t think it is the same as what is described here: https://support.safe.com/hc/en-us/articles/37949819750541-Known-Issue-Data-Virtualization-API-docs-don-t-load-with-IIS-Reverse-Proxy Thank you in advance for your time, and if anything is unclear I can always explain more.

I would like to add the following folder, named "moi”, to my top level resource folders, and add it to the list in the picture below. I couldnt find that much information about it online, and i tried something, but it didnt work. I located the folder in the FME Flow program files, and added the folder, but that didnt work. It doesnt show up in the top level resources list, Does anyone know if it is possible to do this? And how?  Thanks in advance!  

I’m working through the Create a Manual Endpoint in Data Virtualization – FME Support Center however when it comes to the Make a Request from the Documentation section and clicking the ‘try it out’ button in the Swagger page, I get the following 401 response:Is this related to the time which the error lists as 15:48 GMT, however we’re on BST in the UK at the moment so it’s actually 16:48?  If so, how can I resolve it? Otherwise is it a simple authentication issue? - the tutorial says “the EnvionData API is authenticated by default” so I’m a little confused by this.

I’m experimenting with Data Virtualization, and has encountered a built-in error, it seems.Whenever I use a variable value with non-ascii characters (ÆØÅ in question), I get a nasty error:{ "message": "Error running Data Virtualization Workspace \"DV_LER 2.0_GET_schemas_table_data.fmw\" for API \"ler2\": An error has occurred. Check the logfile above for details"}The value in question is “Afløbsledning”, and the url swagger is using is:http://localhost:8080/api/ler2/schemas/myschema/table/afl%C3%B8bsledning/dataThe error in the Flow log file is:JSONTemplater_TABLE (XMLTemplaterFactory): The following error occurred near line 1, column 148 of the query:JSONTemplater_TABLE (XMLTemplaterFactory): "context item": undeclared variableJSONTemplater_TABLE (XMLTemplaterFactory): An error occurred while executing the 'ROW' queryJSONTemplater_TABLE (XMLTemplaterFactory): The following error occurred near line 4, column 15 of the query:JSONTemplater_TABLE (XMLTemplaterFactory): An error occurred

Is there any plan to support receiving data in application/x-www-form-urlencoded with FME Data Data Virtualization endpoints? Currently, when creating an endpoint, the request body only allows application/json as the content type. In some cases, external applications or services can only send form-encoded data rather than JSON. Is support for form data planned in upcoming versions?

Is there a way to import the schema you’ve set up for an endpoint into your workspace? As I understand it, right now (build 25572) the schema that you define in Flow is only used to generate the documentation and you can copy and paste from there of course, but that still feels a bit unpolished.