General

I'm able to setup and use "OpenAICompletionsConnector" succesfully with text-davinci-003, but since the completions API models will be deprecated at the begging of the year 2024 I wanted to try Chat completions with gpt-3.5-turbo as described here.I understood that is hould use another transformer called "OpenAIChatGPTConnector". I use role "user " and as "content" I use the same prompt as for Completion to resolve not well-structured addresses. With this setup the Connector somehow aggregates all the features from input port an

When I read data from a PostgreSQL/PostGIS database and I inspect the features using the Inspector, all attributes seems to be of data type "string: (UTF-8)" when looking at the "Feature information" panel. But when I look at the "Table view" panel, the id column (defined as serial4 in the database) is formatted as a number (the value is aligned to the right). Boolean values are read as either "t" or "f" (still "string: (UTF-8)") while when reading boolean values from a GeoPackage they appear as "Yes" or "No" (and the data type says boolean). If I look at the debug logging I see that a boolean postgres attribute has an entry like:Attribute(string: UTF-8): `my-field' has value `bool,BTREE' While a GeoPackage attribute has an entry like:Attribute(string: UTF-8): `my-field' has value `boolean' Is this really the expected o

Hi, I would like to use FME in order to retrieve some data by sending HTTP request to a REST API.  A GET request can only retrieve 1000 entries per call and follow the FIFO method (First In, First Out). So I need to GET 1000 entries, process the data and then DELETE 1000 entries and start the cycle again until there is no data left. I setup a loop in FME:I've read on this forum that a blocking transformer can not be used in a loop without beeing exported, so I've exported the custom transformer GET_API that contains (.FMX): So each loop should produce 1000 features.Outside the loop it works well when I only send 1 request. But inside the loop I get this error messa

Hi everyone!I'm new to FME and I have a question on how to group entries of a table based on two columns. This is the table:Now I want a new column with the group ID. It should look like this:Explanation:If the fruit is the same, they should belong to the same group --> Apples are in group 1.If the Buyer of group 1 also buys other fruits, then these fruits should also belong to group 1. -->Anna also buys Bananas, therefore Bananas belong to group 1 I tried different transformers, but did not find a solution. Can someone help?

In Portal for ArcGIS 10.6.1 in the backups folder there is a walarchive folder. The files in this folder accumulate daily. Annually 14,000 files are created. Each year these 14,000 files together equal approximately 143GB. There is no setting to change this in 10.6.1.   Every January, for example, in order maintain a reasonable amount of disk space, I manually delete the 14,000 files from the prior year. It is a fairly straightforward task to delete these files, but I am starting to wonder if I could create a workbench and let FME do this.   The file names are random digits and sometimes a letter is included in the name. There does not seem to be a pattern to the file names. I cannot reference the file names in a workbench because of this.   The only way to identify which files to delete is by the Data Modified column in Windows File Explorer, example, delete all files between 1/1/2022 and 12/31/2022 would be a single year.   H

Hello ,  i got 6 lines at rejected port from network topology calculator transformer .the reason is invalid line geometry .How could I fix it ? What does the reason and what should I check ?FME 2021 thanks in advance .

Hello.I have some data like this:123 m32 m56 m...and I want to keep the numeric part and ommit the unit (m). Which way is the best?

I have self interaction in line .line has id but it make circle and intersect itself .how could I remove the intersection point at same line ? my problem : after using intersection lines ,I found this line divide to 3 lines ,because it intersect itself in point .will be possible to let intersector Transformator to create find intersection lines but between different id and ignore the intersection lines for line that has specific id .Could I specific it in parameter ,to find intersection lines only for different id ?

Hiwhich is the correct css to extratc only the first div  this not work #tabella > tbody > tr:nth-child(-n+30) > td.text-left > div:first-child thxFrancesco

Is there a way to dynamically set the "Attributes to Expose" option in the Feature Reader Parameters dialog box.  I've set a variable equal to the attributes I want, and I've created a user parameter pointing to a .csv file containing the attributes (one on each line), figuring I could update the .csv each time through a loop with the attributes I want from the next file.... but neither of these worked (at least in the form I tried them): I apologize for asking so many questions. I promise to answer some when I get better at this.

I'm using the CSV Reader to import a file that contains all of our AD users information so that they can be imported into other systems.  I've noticed a strange thing on the nightly Job I set up on the FME server with my workflow, that the output file doesn't have newly added rows from the day before (new employees). Though running the workflow manually seems to pick up the users, hence some of the confusion. I've refreshed the reader with a new one, that sets the datasource as a parameter and have tried tweaking some of the advance setting with issues still continuing.  I did try the AD Reader, but it was extremely cumbersome with my lack of knowledge of AD structure and required me to map multitudes of OU's to just get the users, and even then I was still missing some. Thoughts on how to get this thing to "re-read the file for each job run on the FME server?

Have anyone managed to correctly set up FME Desktop (not FME Server - this is OK) to use Azure AD when logging in to an FME Server with Azure AD? I have changed the template and the TENANT_ID and OAUTH_SCOPE and set the redirect url to http://localhost . However I get an error. Not sure where to go from here The scope set is: scope=openid+profile+offline_access

I made a workbench which takes a .zip folder as a source, which contains .csv files, and sometimes an 'attachment' folder which contains images or videos. The output is an xlsx file, a dxf file and if there is an 'attachment' folder, this 'attachment' folder. This workbench will be used through a workbench app in FME Server, the xlsx and th dxf data can be retrieved from the 2 featurewriters via the data downlaod service, but I have no idea of how to read and write a folder with file extensions I can't know. The only solution I see is to move the folder. So I made a python script which unzip the entry file, check if there is a 'attachment' folder, and if so, move it to 'FME_SERVER_DEST_DIR', so it can be downloaded from the url with the xlsx and the dxf. Here's my problem. With a .zip file with only .csv file and no 'attachments' folder, there is no problem, I get my url to download the data and I ge

I seem to be running into the same problem again and again. That problem is how do I pass a series of attributes to a transformer using what would be considered a variable in a scripting language. I can generate an attribute or variable containing a list or string containing the attributes, but I can't seem to figure out how to pass that value into a transformer and have it produce the desired result. I know it has to be possible (you can't know every attribute you want to keep/expose/use in every workflow every time, so passing them dynamically has to be a thing), I just can't figure it out. Plus, I can see having to use dynamic inputs in a hundred different ways I can't imagine yet, so I have to get this bit. Can anyone point me to a resource where I can learn the technique? Thank you.

I'm trying to have a distributed deployment of my standard engine & the dynamic engines in azure kubernetes. I created 2 nodepools and referenced the tag of the 2nd nodepool in the values.yaml file. The dynamic engine has a nodeSelector: {agentpool: nodepooldynamic} field that says this engine has to go on a specific nodepool. However, when I update my deployment it says the pods affinity rules are not met since it only wants to schedule engine pods on the same nodepool as there is a core pod available. Although, the engine pod immediately launches even before the core pod is available. Is the presence of the core pod hard coded or is it possible to change this?

I have previously downloaded (using SharePointOnlineConnector)a file to my local PC storage, and I know that it is possible to use an S3Connector to upload attributes or files, but, how can I directly upload a file from Sharepoint to FME Server folder in the same Workspace without storing it at C:/?

My keyboard input to FME has suddenly changed. If I use another application I get my normal response, but when I try to type in FME, it seems the keyboard layout has changed (probably to another language somehow). I cannot find anything in the settings that fixes this. Has anyone got an idea what might have caused this and how to fix it?

I am in process of migrating FME to a new windows machine and to run in the latest version (FME 2023.1). I have found that the workbenches run faster in the version we have upgraded from (FME 2018.1) Checking the log files for some of the processes, the SQL creator processes take longer in FME2023.  FME 2023 takes 2:06 minutes to connect and run a query ODBC Driver 17 for SQL server installed on new machine Version 2017.1710.03.01 2023-07-27 12:10:05 Microsoft SQL Server Non-Spatial Reader: Trying to connect using Microsoft OLE DB Driver 19 for SQL Server... 2023-07-27 12:12:11| 105.0|103.3|INFORM|140521: Database read complete. Retrieved <default parameter> feature(s) FME2018 takes 38 seconds for the same query2023-07-28 02:17:26 |Microsoft SQL Server Non-Spatial Reader: Trying to connect using SQL Server 2012 Native Client... 2023-07-28 02:18:04| 40.7| 36.9|INFORM|Microso

We are connecting to an SDE database via and SDE file in server, we would like to use Windows Authentication and the service account the server runs under. But when I load an SDE connection file with Windows Authentication selected it does not pick up the windows credtiasl of the service account. Error Message:Could not open the Enterprise Geodatabase. The error number from ArcObjects is: '-2147216118'. The error message from ArcObjects is: {Bad login user}Please ensure the connection parameters are correct (server=`egisdev-db.tnad.tasnetworks.com.au', instance=`sde:sqlserver:egisdev-db.tnad.tasnetworks.com.au', user=`', password=`***', database=`EGIS_UNMaster', version=`sde.DEFAULT') I have tried reading from the DB using a database connection set to Windows Authentication, but we need to to use SDE connection as these are esri geodatabases. Any thoughts?

One of the main pain points I've been having so far with using Python with FME is getting datetime attributes from features as datetimes in Python. FME datetimes normally have a sub-second precision of 7 digits, up to 9, but Python stops parsing after 6. "When used with the strptime() method, the %f directive accepts from one to six digits and zero pads on the right. %f is an extension to the set of format characters in the C standard (but implemented separately in datetime objects, and therefore always available)."        #        # Unzoned        #                a_timestamp = feature.getAttribute('a_

Hello All, I'm working on a workbench to convert IFC to CityGML. Before writing out CityGML, I'm trying to add some CityGML attributes, e.g. class, function, usage, etc.. According the section "Setting CityGML attributes and properties in FME" from Writing CityGML from FME (safe.com), I used these two transfermors "AttributeCreator" and "GeometryPropertySetter" to add the attributes. However, the output CityGML cannot identify the attributes as the ones in CityGML schema. Foe example, I opened the CityGML with notepad, the attribute

I have two point datasets, GPoints (~100 points) and OPoints (~1000 points), and I want to find the nearest neighbor for each GPoints entry. However, the nearest neighbor from OPoints must have an ID that matches the values from 2 possible columns in GPoints. In this case the column names are id1 and id2. E.g.The first entry in GPoints has values of id1 = 9001 and id2 = 9005. Therefore the nearest neighbor from OPoints must have an id of 9001 or 9005 (whichever is closest to the entry in GPoints current being analyzed). In SQL this would be WHERE OPoints.id = GPoints.id1 OR OPoints.id = GPoints.id2.

After it begins running, I have this message: Error: The log file for job ID "19099" does not exist.However, I can see it (only the job id and the workspace number) in the running jobs section.

I have workspaces looking a data quality which are automated on fme server. I am looking to record the monthly number updates from the workspaces and was wondering is there a way a writer can create a new file with a new name (e.g jan 2023 or Feb 2023) instead of just overwriting the current one?

I recently upgraded from FME Server 2022.1.3 to 2022.2.7.  Since the upgrade, the JobHistoryStatisticsGathering.fmw workspace (which runs on a daily schedule as part of the built-in FME Server Dashboards) is failing.  The error message is:+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++Feature Type: `JobHistoryReader_LoopHere'Attribute(32 bit integer)      : `Loop to JobHistoryReader_LoopHere1691186519 Input Splitter.BranchingFactory.Count' has value `1'Attribute(string: UTF-8)       : `_min_job_age' has value `20230803000000'Attribute(64 bit integer)      : `_offset' has value `0'Attribute(string: windows-1252): `fme_feature_type' has value `Creator'Attribute(string: windows-1252): `fme_geometry' has value `fme_undefined'Attribute(string: windows-1252): `fme_type' has value `fme_no_geom'Coordinate System: `'Geometry Type: IFMENullCoordinate Dimension: 2=======================