A read-only category for lost FME Form topics. We hope to move them shortly.
Recently active
Hello , How to split the content of one column to two columns ?my output of aggregator looks like string12-string56 at same cell in one column and all rows similar . i would like to have two attributes one called base include string12 and other attribute called next include string56 and implement the method for all rows Which transformer should i use ?how to use it ?fme 2021 thanks in advance
Reading/writing files(e.g .xlsx) from /into local drive not working in FME Flow 2023.0 (b23332) but FME Form does read/write the same files from local drive.
The files are ziped .shp files broken up by state. I need to merge them into one nation wide dataset and safe to a geodatabase. A general workflow would be very helful. Or a list of Readers, Transformers and Writers and things to pay attention to.
I am trying to access each row of the excel data I read with pythoncaller. How can I do that coulumnData = feature.getAttribute('Column1') data = str(coulumnData).split() for row in data: print(row)and how do I read FLOAT values as well? I do not understand what kind of object is returned by feature.getAttribute. If I print coulumnData, it is printed nicely row by row. But, how do I access those row of data? I want to do something like coulumnData = feature.getAttribute('Column1') data = str(coulumnData).split() print(data[10])
I'm able to setup and use "OpenAICompletionsConnector" succesfully with text-davinci-003, but since the completions API models will be deprecated at the begging of the year 2024 I wanted to try Chat completions with gpt-3.5-turbo as described here.I understood that is hould use another transformer called "OpenAIChatGPTConnector". I use role "user " and as "content" I use the same prompt as for Completion to resolve not well-structured addresses. With this setup the Connector somehow aggregates all the features from input port and sends them as one prompt with only one result. I would need to resolve each row separately, i.e. send the whole prompt for every feature or if the chat works with history, send just one prompt and the deatils for every row (feature). Important is that I need result for every row (feature).Any ideas for the setup?Thanks
When I read data from a PostgreSQL/PostGIS database and I inspect the features using the Inspector, all attributes seems to be of data type "string: (UTF-8)" when looking at the "Feature information" panel. But when I look at the "Table view" panel, the id column (defined as serial4 in the database) is formatted as a number (the value is aligned to the right). Boolean values are read as either "t" or "f" (still "string: (UTF-8)") while when reading boolean values from a GeoPackage they appear as "Yes" or "No" (and the data type says boolean). If I look at the debug logging I see that a boolean postgres attribute has an entry like:Attribute(string: UTF-8): `my-field' has value `bool,BTREE' While a GeoPackage attribute has an entry like:Attribute(string: UTF-8): `my-field' has value `boolean' Is this really the expected outcome? I would expect FME to correctly identify the data types and treat
Hi, I would like to use FME in order to retrieve some data by sending HTTP request to a REST API. A GET request can only retrieve 1000 entries per call and follow the FIFO method (First In, First Out). So I need to GET 1000 entries, process the data and then DELETE 1000 entries and start the cycle again until there is no data left. I setup a loop in FME:I've read on this forum that a blocking transformer can not be used in a loop without beeing exported, so I've exported the custom transformer GET_API that contains (.FMX): So each loop should produce 1000 features.Outside the loop it works well when I only send 1 request. But inside the loop I get this error message: HTTPCaller is blocking and cannot be used in a loop I can not use a CLONER or something like that since I don't know how many cycle is needed. Do you have another solution ? Is that even possible ?
Hi everyone!I'm new to FME and I have a question on how to group entries of a table based on two columns. This is the table:Now I want a new column with the group ID. It should look like this:Explanation:If the fruit is the same, they should belong to the same group --> Apples are in group 1.If the Buyer of group 1 also buys other fruits, then these fruits should also belong to group 1. -->Anna also buys Bananas, therefore Bananas belong to group 1 I tried different transformers, but did not find a solution. Can someone help?
In Portal for ArcGIS 10.6.1 in the backups folder there is a walarchive folder. The files in this folder accumulate daily. Annually 14,000 files are created. Each year these 14,000 files together equal approximately 143GB. There is no setting to change this in 10.6.1. Every January, for example, in order maintain a reasonable amount of disk space, I manually delete the 14,000 files from the prior year. It is a fairly straightforward task to delete these files, but I am starting to wonder if I could create a workbench and let FME do this. The file names are random digits and sometimes a letter is included in the name. There does not seem to be a pattern to the file names. I cannot reference the file names in a workbench because of this. The only way to identify which files to delete is by the Data Modified column in Windows File Explorer, example, delete all files between 1/1/2022 and 12/31/2022 would be a single year. Here is what I would like to do in FME: 1) Select all files
Hello , i got 6 lines at rejected port from network topology calculator transformer .the reason is invalid line geometry .How could I fix it ? What does the reason and what should I check ?FME 2021 thanks in advance .
Hello.I have some data like this:123 m32 m56 m...and I want to keep the numeric part and ommit the unit (m). Which way is the best?
I have self interaction in line .line has id but it make circle and intersect itself .how could I remove the intersection point at same line ? my problem : after using intersection lines ,I found this line divide to 3 lines ,because it intersect itself in point .will be possible to let intersector Transformator to create find intersection lines but between different id and ignore the intersection lines for line that has specific id .Could I specific it in parameter ,to find intersection lines only for different id ?
Hiwhich is the correct css to extratc only the first div this not work #tabella > tbody > tr:nth-child(-n+30) > td.text-left > div:first-child thxFrancesco
Is there a way to dynamically set the "Attributes to Expose" option in the Feature Reader Parameters dialog box. I've set a variable equal to the attributes I want, and I've created a user parameter pointing to a .csv file containing the attributes (one on each line), figuring I could update the .csv each time through a loop with the attributes I want from the next file.... but neither of these worked (at least in the form I tried them): I apologize for asking so many questions. I promise to answer some when I get better at this.
I'm using the CSV Reader to import a file that contains all of our AD users information so that they can be imported into other systems. I've noticed a strange thing on the nightly Job I set up on the FME server with my workflow, that the output file doesn't have newly added rows from the day before (new employees). Though running the workflow manually seems to pick up the users, hence some of the confusion. I've refreshed the reader with a new one, that sets the datasource as a parameter and have tried tweaking some of the advance setting with issues still continuing. I did try the AD Reader, but it was extremely cumbersome with my lack of knowledge of AD structure and required me to map multitudes of OU's to just get the users, and even then I was still missing some. Thoughts on how to get this thing to "re-read the file for each job run on the FME server?
Have anyone managed to correctly set up FME Desktop (not FME Server - this is OK) to use Azure AD when logging in to an FME Server with Azure AD? I have changed the template and the TENANT_ID and OAUTH_SCOPE and set the redirect url to http://localhost . However I get an error. Not sure where to go from here The scope set is: scope=openid+profile+offline_access
I made a workbench which takes a .zip folder as a source, which contains .csv files, and sometimes an 'attachment' folder which contains images or videos. The output is an xlsx file, a dxf file and if there is an 'attachment' folder, this 'attachment' folder. This workbench will be used through a workbench app in FME Server, the xlsx and th dxf data can be retrieved from the 2 featurewriters via the data downlaod service, but I have no idea of how to read and write a folder with file extensions I can't know. The only solution I see is to move the folder. So I made a python script which unzip the entry file, check if there is a 'attachment' folder, and if so, move it to 'FME_SERVER_DEST_DIR', so it can be downloaded from the url with the xlsx and the dxf. Here's my problem. With a .zip file with only .csv file and no 'attachments' folder, there is no problem, I get my url to download the data and I get the xlsx and the dxf. But if
I seem to be running into the same problem again and again. That problem is how do I pass a series of attributes to a transformer using what would be considered a variable in a scripting language. I can generate an attribute or variable containing a list or string containing the attributes, but I can't seem to figure out how to pass that value into a transformer and have it produce the desired result. I know it has to be possible (you can't know every attribute you want to keep/expose/use in every workflow every time, so passing them dynamically has to be a thing), I just can't figure it out. Plus, I can see having to use dynamic inputs in a hundred different ways I can't imagine yet, so I have to get this bit. Can anyone point me to a resource where I can learn the technique? Thank you.
I'm trying to have a distributed deployment of my standard engine & the dynamic engines in azure kubernetes. I created 2 nodepools and referenced the tag of the 2nd nodepool in the values.yaml file. The dynamic engine has a nodeSelector: {agentpool: nodepooldynamic} field that says this engine has to go on a specific nodepool. However, when I update my deployment it says the pods affinity rules are not met since it only wants to schedule engine pods on the same nodepool as there is a core pod available. Although, the engine pod immediately launches even before the core pod is available. Is the presence of the core pod hard coded or is it possible to change this?
I have previously downloaded (using SharePointOnlineConnector)a file to my local PC storage, and I know that it is possible to use an S3Connector to upload attributes or files, but, how can I directly upload a file from Sharepoint to FME Server folder in the same Workspace without storing it at C:/?
My keyboard input to FME has suddenly changed. If I use another application I get my normal response, but when I try to type in FME, it seems the keyboard layout has changed (probably to another language somehow). I cannot find anything in the settings that fixes this. Has anyone got an idea what might have caused this and how to fix it?
I am in process of migrating FME to a new windows machine and to run in the latest version (FME 2023.1). I have found that the workbenches run faster in the version we have upgraded from (FME 2018.1) Checking the log files for some of the processes, the SQL creator processes take longer in FME2023. FME 2023 takes 2:06 minutes to connect and run a query ODBC Driver 17 for SQL server installed on new machine Version 2017.1710.03.01 2023-07-27 12:10:05 Microsoft SQL Server Non-Spatial Reader: Trying to connect using Microsoft OLE DB Driver 19 for SQL Server... 2023-07-27 12:12:11| 105.0|103.3|INFORM|140521: Database read complete. Retrieved <default parameter> feature(s) FME2018 takes 38 seconds for the same query2023-07-28 02:17:26 |Microsoft SQL Server Non-Spatial Reader: Trying to connect using SQL Server 2012 Native Client... 2023-07-28 02:18:04| 40.7| 36.9|INFORM|Microsoft SQL Server Non-Spatial Reader: Database read complete. Retrieved 140521 feature(s) Note, I also tested th
We are connecting to an SDE database via and SDE file in server, we would like to use Windows Authentication and the service account the server runs under. But when I load an SDE connection file with Windows Authentication selected it does not pick up the windows credtiasl of the service account. Error Message:Could not open the Enterprise Geodatabase. The error number from ArcObjects is: '-2147216118'. The error message from ArcObjects is: {Bad login user}Please ensure the connection parameters are correct (server=`egisdev-db.tnad.tasnetworks.com.au', instance=`sde:sqlserver:egisdev-db.tnad.tasnetworks.com.au', user=`', password=`***', database=`EGIS_UNMaster', version=`sde.DEFAULT') I have tried reading from the DB using a database connection set to Windows Authentication, but we need to to use SDE connection as these are esri geodatabases. Any thoughts?
One of the main pain points I've been having so far with using Python with FME is getting datetime attributes from features as datetimes in Python. FME datetimes normally have a sub-second precision of 7 digits, up to 9, but Python stops parsing after 6. "When used with the strptime() method, the %f directive accepts from one to six digits and zero pads on the right. %f is an extension to the set of format characters in the C standard (but implemented separately in datetime objects, and therefore always available)." # # Unzoned # a_timestamp = feature.getAttribute('a_timestamp') print(repr(a_timestamp)) # '20230620161403.0020449' # ValueError: unconverted data remains: 9 # (Python's strptime stops at 6 decimals) # (This will randomly work once out of 10 because trailing zeroes are trimmed) # datetime.strptime(a_timestamp, '%Y%m%d%H%M%S.%f') # This shouldn't be that complicated! # Also,
Hello All, I'm working on a workbench to convert IFC to CityGML. Before writing out CityGML, I'm trying to add some CityGML attributes, e.g. class, function, usage, etc.. According the section "Setting CityGML attributes and properties in FME" from Writing CityGML from FME (safe.com), I used these two transfermors "AttributeCreator" and "GeometryPropertySetter" to add the attributes. However, the output CityGML cannot identify the attributes as the ones in CityGML schema. Foe example, I opened the CityGML with notepad, the attributes are look like this:Only "class" can be showed as "<bldg:class>", others are showed as "<gen:stringAttribute name="citygml_...">". What I want is this:May I know is this possible to do in FME Workbench? If so, how? Many thanks.PS. This is my version of FME Desktop. Regards,Qubbie