A space to discuss FME Form
Recently active
I have a workbench that imports a lot of data into PostgreSQL (~90m records across 3 tables, 1 containing spatial data) and we've identified a possible need to vacuum the tables. The data is "cleansed" post-import via a SQLExecutor that deletes data, creates data if necessary. However, we're unable to vacuum analyze (Analyze is fine) the data once that occurs as it appears that the SQLExecutor wraps commands in a Transaction Block - which means we cannot Vacuum. Any ideas on how we can perform vacuum via the SQLExecutor or have another strategy we can utilise? I am unsure whether using the writer's post-write execution of SQL in a parameter is performed before or after the VacuumAnalyze option that FME provides. I've seen some information around setting Autocommit to on/off within the SQLExecutor but this does not work in the newer versions of PostgreSQL. We are using an Azure managed database
Hi there.I was wondering which type of parameter is used when enableing vaccum analyze tabel in a Postgis writer feature type (https://www.postgresql.org/docs/current/sql-vacuum.html) . Is it a FULL vacuum? all I see in the logfile is: Vacuuming and analyzing table ....Any tips on how to query that information from the database?Thanks in advance. Itay
I am using inspection point before and after the CoordinateRounder transformer to notice that only few coordinates are rounded while others are left untouched. Is it something others have noticed?
Hi,It’s been several times I can’t achive to do this, but I’m sure there is a way.I have the following table :And I want to get the following result : The thing is : I don’t know in advance what will be the name of IndA and IndB (and there can be more than 2 values, so more than 2 columns in the result table). I achieved to get my result table with an inlineQuerier, but I need to enter a fixed value for the Indicateur values.select "Zone", max(CASE WHEN "Indicateur"='IndA' THEN Valeur ELSE 0 END) as 'IndA', max(CASE WHEN "Indicateur"='IndB' THEN Valeur ELSE 0 END) as 'IndB'from "Input"GROUP BY "Zone" Any idea ?
I have an XML file generated by a specific SW, and there is an issue with one element, which content I cannot influence as I would like to. So I decided to try to update it with XMLUpdater, but I am just walking in the circles.The (very simplified) file looks like this:<?xml version="1.0" encoding="UTF-8"?><gdb:Utilities xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:atr="atr"... etc.> <gdb:Data> <gdb:BiogasStations> <bgs:Records> <bgs:Record> ... <atr:IDZone>58KVK-96</atr:IDZone> <atr:IDSpecific>0</atr:IDSPecific> ... </bgs:Record> <bgs:Record> ... <atr:IDZone>58KVK-07</atr:IDZone> <atr:IDSpecific>0</atr:IDSPecific> ... </bgs:Record> <bgs:Record> ... <atr:IDZone>18LIK-15</atr:IDZone&
The images are successfully uploaded, but the server assigns the incorrect mime type. This causes the images to download, and not display in browser. I have tried setting the 'content_type' manually to 'image/jpeg' - but the server seems to assign the mime type to 'application/octet-stream' every time. my config is below. am I using the wrong syntax/config? thanks.... Multipart upload is as follows:
I am currently trying to migrate my Geometric Network (GN) system data to the Utility Network (UN) and would like to include attachments in the FME workbench. Currently, I have a workbench that successfully migrates the points, lines and polygons (Assets, domains, and attributes) to target UN features but I am not sure how to handle attachments. Should attachments be handled in a separate bench?The attachments would be mapped from the source tables to the new UN attachment tables. For example, hydrant attachment table would be migrated to Device attachment tableCan attachments be migrated using FME? What type of transformers and workflow needs to be utilized to move this type of data?
I have a script that is supposed to run some .bat files base on calling defined SystemCallers. I have 3 System caller as each for DEV, HUB, and PROD environments. and I want to control which to run with User Parameters as belowCan you please let me know how I can control which SystemCaller to run based on user selection (For example: if user select the DEV then only the SystemCaller-DEV)
Hello there, I feel like this should be incredible simple, but I feel like I am banging my head against a wall. I am trying to update the name value in this JSON, ‘cp2regions’ to ‘new_name’ for example: { "featureType": { "name": "cp2regions", "nativeName": "cp2regions"}} Using this this workbench;Set up like this : I can’t seem to find a good tutorial/example workbench on how this Transform works. Many Thanks!
I have set up a dynamic workbech with the follwoing setup. Its from SQL Server to geopackage. It has been working fine daily for months until today when i noticed one record was missing geometry (geometry was null in the target geopackage databse). Why does this single record fail to write? Checking the geometry types in the source database (STGeometryType ( ) ) for the feature type they areGeometryCollection LineStringI dont understand why it is failing when I am using a dynamic workflow in the first place?Where should i start to look for errors, is there anything i can do? I have been poking around for a long time to try to make sense of it. One thing i have found is if i look at the feature with the Feature information window there is a “fme_geometry” attribute with a value of fme_aggregate. The attribute fme_type is of fme_collection.The failing feature is the only one whch is a fme_aggregate, so i am assuming that has something to do with the problem? But why would it be an issue
Hello everyone,I'm looking to place the maximum number of points within an irregular polygon, ensuring a minimum distance of 250 meters between each point. Initially, I considered using a grid, but I've realized that this method doesn't optimize the space within the polygon very well.Do you have any suggestions or more effective methods for solving this problem?Thanks in advance for your help!
I am trying to write polygon features into a Esri Geodatabase writer where the layer name is NV_NATURRESERVAT. But, the writer is trying to add a suffix “surface” so the output name will instead be NV_NATURRESERVAT_surface. This is not correct.First of all I dont want the a layer with a name like that. And second, before it reaches the writer the script filters out if theres a need to create a layer or not in Esri Geodatabase.If theres a need to create a layer it will create on in another writer. If there exist a layer with that name the flow will continue to the second writer. In this case the layer exist, I just want to update it with new data. So, up until writer(s) the layer name is set to NV_NATURRESERVAT. But when it reches the writer it gives me error messages saying that no such layer exist:“Esri Geodatabase Writer: Feature Class or Table 'NV_NATURRESERVAT_surface' must exist when Table Handling is set to 'Use Existing'GEODATABASE_SDE writer: An error has occurred. Check the lo
Hi list.I'm tasked with importing a lot of feature sets, each with its own set of fields/attributes. So I'm using dynamic output mode, utilizing the schema features read.Unfortunately the request is to add a "job ID", so I tried to append an entry to the attribute list of the schema features, but suddenly the proces fails, not recognizing the schema features anymore. And this without changing anything in the data features flow nor the writer.An example of the error message is:Microsoft SQL Server Spatial Writer: A feature has arrived with 'fme_feature_type' of DAF_DAGI.afstemningsomraade_908308, but the feature type is not recognized. Halting translationMy writer setup is shown in the attached image. Why does the writer suddenly confuse the fme_feature_type with the requested table name ?Or is the error message false/misleading ?The "fme_feature_type" of the data features are the exact same, I just manipulated the schema features in a parallel "stream".Any insights are appreciated.Chee
Hi guys,I am trying to automate a process which requires to write into a new file-geodatabase everytime I run a translastion. Essentially I am reading data from 1 database trying to stage it in a new geodatabase and then moving it to its final destination. I am using FeatureWriter to continue the translation but i am getting a geodatabase is locked error. That is why I am trying to create a new file geodatabase for the staging part of the process as this is where the error keeps on occurring. Is there a way that FME workbench can create a new file geodatabase for my feature classes in a same workbench?Thanks!
A small follow-up question, the prompt button on the toolbar has vanished for me since FME 2024.0. It also disappeared from the Toolbar options. Same goes for the Stop at breakpoint button.Any ideas how to get it back?
I'm reading in ECW file to get the Filename, X Y Min, X Y Max. Write to excel, I do not want the image/raster in my excel file.How do I get rid of the image?
Good morning,I am trying to do a spatial join between two polygon files. One is the property boundaries and the second is conservation easements. The goal is to combine the parcel id from the property boundaries to the conservation easement polygon, where a new polygon will be created for each intersection. I am trying to recreate a model I built in ArcGIS Pro. Screen shots below.
I'm using a path in an Esri geodatabase writer that contains a space in the path name - \\\\xxxxx\\gis\\SheriffsOffice\\Camera Information\\SO_Camera_Info.gdb. The workbench completes successfully (2019.1). When the workbench is published to FME Server and run, the path is truncated at the space form '\\\\xxxxx\\gis\\SheriffsOffice\\Camera.gdb' Is there a way to fix this?
Hello,I am new to FME but have some overall experience with coding and I know there has to be a simple way to solve the issue of automatically creating the file name based on an attribute. I am trying to create an excel file with multiple sheets and I have tried using the fan out parameter (along with anything else I can find online) but its been making multiple files or crashing, instead of just one file with multiple sheets. I have been researching this issue for far too long with absolutely no head way so any help will be greatly appreciated. I will also need to create a kmz/kml file with the same naming parameters if that changes anything.Thank you in advance,Sam
I have an ETL workbench and would like to create a text file where I can write some information while running the workbench. The information I would like to write includes:The path to individual readers The feature counts of each reader The coordinate system of the each reader How many objects have been written to the databaseI don't want to use logging per se because it writes basically all information.What alternatives do I have? Can I only do it with python`?
Hello, I am a first-time poster on the FME forum. My goal is to read data stored in a plain view from a non-spatial Oracle database and then write it to an Oracle SDE geo_dbtable. The issue is that my Oracle Non-Spatial Reader slows down, taking more than 30 minutes to execute the SQL Statement when I include two comment fields that are long, 2000 characters. When I run the same query in SQL Developer, the result is back in a few seconds. The log message that gets stuck on is: ORACLE Reader: Executing SQL Statement `SELECT…<field names> to obtain features for feature type <Oracle View Name>If I uncheck the comment fields in the User Attributes tab the reader returns quickly, within a minute. So I’m skeptical that it is caused by network distance. Given these challenges, I need some guidance. I’ve tried using an Oracle NCLOB to hold the comments in the view, but the result remains sluggish. I'm eager to learn how to optimize my workbench's performance when dealing with
Hi, This subject is discussed already quite some times but I don't get it working. I have a loop where a feature enters with 3 fields (field_name, field_value). I want to use the AttributeCreator to make a field that is named after the value in "field_name" and gets the attribute value from "field_value". As there is an option inside the AttributeCreator "Attribute Name from Attribute Value" is supposed this would do the trick. But this does not create a new attribute. If I type the actual field name in the "Attribute Name" field in the transformer it just works fine. The attribute names are like this: net_elements{0}.xlink_href net_elements{1}.xlink_href net_elements{2}.xlink_href net_elements{3}.xlink_href ...
I am trying to set up a TCPIP Receiver to read raw data from a specific port on another host machine. On the box I am authoring the workspace with I can use Windows PowerShell to ping that location and have another technician confirm with Wireshark that data is being sent through this port. So in using the TCP\IP Receiver transformer I can ‘Successfully connect to host’ per the log but the translation immediately shuts down per the attached snip. Why is it doing this? It should be streaming data and to do so needs that transporter open. Thanks for any help.
I have a Microsoft SQL Server database and need to mirror/copy some tablez to another Microsoft SQL Server.For most attributes it is working, but not for numeric(width, precision) values it is not. The numbers after the decimal do not show in the new database. This might has to do with the decimal / language setting; I am not sure what the problem is. I read about the use of 'native_data_type'https://docs.safe.com/fme/html/FME-Form-Documentation/FME-Form/Workbench/Deriving-Destination-Schema-from-Schema-Feature.htm'To instruct the dynamic writer to apply the native_data_type to the schema feature, instead of the fme_data_type, specify attribute fme_format_short_name and set the value to the Format Type Identifier ("short name") of the format. For example, fme_format_short_name = “GEODATABASE_FILE”.'But do not know how to implement this. Where do I need to put this 'fme_format_short_name'?Hope someone can provide some insights.ThanksStefan