Using transformers to modify data.
Recently active
import os def get_excel_file_paths(folder_path): excel_file_paths = [] for root, dirs, files in os.walk(folder_path): for file in files: if file.endswith(".xlsx"): excel_file_paths.append(os.path.join(root, file)) return excel_file_paths folder_path = "/path/to/my/folder" ----I have a list of folders in a csv file which i read into the workspace so i plan to use that attribute hereexcel_paths = get_excel_file_paths(folder_path) for path in excel_paths: print(path) Having troubles converting this to run in fme Thanks!
I have an Excel spreadsheet that contains 2 columns, 1st column is called Terms, 2nd column is called Definitions. What I want to do is convert each flashcard pair (4 rows) into multiple choice questions via GPT3.5Turbo. The problem I'm running into is that while OpenAIChatGPTConnector takes in the data just fine, it is only outputting 1 pair (The last row). How can I work around this?
I encountered something a bit weird. In a bit larger workspace I wanted to apply parallel processing for part of the workspace, so I embedded that part of the workspace (which already contained some custom transformers) in a new custom transformer. Then however I obtained some issues with the parameters, it seemed that they were not passed on correctly. Attached is a workspace where I replicated the issue. It's just a dummy workspace that connects to an Oracle DB, and (aims to) return the static result; 'Greeting' = 'Hello'. Main;CT_0;CT_1;If I run the workspace with a database connection named 'My_DB_Schema (1-O) @ dev', I obtain an error;Error connecting to Oracle database: message was `ORA-12154: TNS:could not resolve the connect identifier specified'. (serverType=`<serverType>', serverName=`My_DB_Schema', userName=`', password=`***', dbname=`') Although this issue occurs with a Database connection parameter, in my main works
Hello, I am using the sqlexecutor and I am populating the attributes to expose from sql query. It correctly displays them but there is a (ok) button missing to add them successfully. When I close the window (x), they won't be added.
Hey FME Users, There is a lot of information in and around OSM on the forum, but can we add OSM as the background map in Data Inspector?
I have been tasked to set up an automation that will FTP a file from a State-supported site to our network.I have been advised to use the FTPCaller transformation to achieve this. I have the specifics to the State-supported site and, using WINSCP, can manually download the file. In order to do this, In WinSCP, I supply the host name, the port, and a username supplied by the State. Additionally, I have to click on the Advanced button, then under SSH click on the Authentication text, click on the ellipsis (...) under Private Key File I enter the name of a Putty file (that was given to me by the FME Administrator) The file is sent by FTP using this manual method. At this point I am trying to automate the process so that the FME, using FTPCaller as advised, will achieve the same transfer. However, I am not clear how-to setup the FTPCaller to incorporate all of the parameters (host name, port, username, Putty file) that I have been given for the manual transfer. Can I get some advice on
I have a workspace app that accepts a kmz dropped on it. The result is a postgres/postgis spatial overlay with the kmz. When there is no resulting feature I need to send a message to the app instead of the resulting data. I have added NoFeature testers into my workspace to capture any streams that do not have output. Just not sure how to generate a report and get that to the app when the workspace completes. I am thinking now it would be nice to have a count from each of the input data streams whether there is a spatial relate or not.Thanks for any direction.
I have a file geodatabase where backups are stored with a date in the name that gives the backupdate, BU_20230724, BU_20230731 etc. How can I select that only the latest will be read for further analysis? Normally, a feature class is selected under Constraints > Tables and you can select the one you need but, the latest Backup will not stay the same during the year. In a automated proces I would like to select the one with the latest date without changing it manually.
HI. Do I still have to manually input using the AttributeExposer transformer, like the answer to the question below? https://community.safe.com/s/question/0D54Q000080hcshSAA/problem-ifc-reading-user-attributes What should I do when a user-defined property exists for each IFC file in the way that the fmw file runs FME Application in the shell and operates? please answer about my question. Regards,Bongsup Kim
Hi, I am trying to get CAD data into Smallworld GIS. I did get one dataset in, one layer from the Cad drawing into Smallworld. I tried it with another layer from CAD file and I got the message "insert operation failed" which resulted no data being inserted into Smallworld GIS. I am able to see all data in Universal Viewer so I am thinking that there must be something wrong with the writer. Is there anyone that can help me with this problem? Thank you gamze
Hello,I am currently working with FME Desktop 2022 and I have encountered an issue while trying to generate sequential numbers in a column based on attribute values. I have two tables, "Dokumenti" and "KatOperat," and I need to create a connected table called "ListKatPlana." In the "ListKatPlana" table, I have two columns: "ID_KatOperat", "ID_List" and "creationDate".The challenge I'm facing is generating the values for the "ID_List" column based on the "Koliko" attribute in the "Dokumenti" table. The "Koliko" attribute represents the number of records that should be associated with each "ID_KatOperat." For example, if I have an "ID_KatOperat" of 2304 and the "Koliko" attribute is 9, I need to generate numbers from 1 to 9 in the "ID_List" column for that specific "ID_KatOperat."I have tried using an aggregator to separate th
I am receiving a JSON file that's around 85 MB. The file contains a large around of elements in a single nesting. I want to extract a given value by looking at the neighbor key. In the example below it could be that I want to extract the value "2.000" from the section where "field" has the value "Frontside heights interval". "field" : "Frontside heights interval", "value" : "2.000",Can this be done using the built in JSON transformers?{ "stackId" : "d9a5ba5e2a00407ca52b68f902e43393", "departmentId" : "5f4adeebe93b46368e6451f8b43ba914", "registrationPosition" : null, "measurementPosition" : { "longitude" : 9.6567316353411, "latitude" : 56.30290238191994, "height" : 29.993129805661738, "accuracy" : 6.213567568298807 }, "stackNumber" : 0, "polterId" : null, "registrator" : null, "surveyor" : "ipadreg@hdlogsystems.com", "state" : "Measured", "registrationDateTime" : "2023-08-18T07:33:01.735+00:00", "measurementDateTime" : "2023-0
Hi, I have features about vegetation observations with many attributes like Date, ObservationId, Latitude, Longitude, IdTaxon and IdTaxCompl.I did the following workflow obtaining successful results: 1) buffer features to a specific distance; 2) Dissolve buffered features grouped by IdTaxon (obtaining what I call "stations"); 3) Renamed IdTaxon to sIdTaxon on the Dissolver resultant table; 4) Add a UniqueID for each station; 5) using a combination of PointOnAreaOverlayer, ListExploder and TestFilter I manage to join the corresponding StationId to the original observations table. To do this I set up PointOnAreadOverlayer to produce a list On Output 'Point' with the selected attributes "_ulid" and "sIdTaxon". I need the exploded list because observations of one species may also intersect stations from other species (so my TestFilter select the overlayed data using the condition "IdTaxon like sIdTaxon".My problem is that alternatively, I'
Hello , i have 2 dataset with different geometry points has the same id (points id at dataset 1 is the same points id at dataset 2 (same color as picture) but each point has different geometry and lines also has different geometry. probably , there are few points Id at the middle of network at dataset 1 are not the same point Id at dataset 2 . Lines in each dataset has different id , but they connect with same id point in different dataset but with different geometry .i would like to compare between two dataset and find which line id from dataset 1 equal line id from dataset 2 .my target to get specific attribute from lines at dataset 1 to provide for each lines equally at dataset 2 . FME 2021
Hello, I have a client who just installed the latest version of FME Form 2023.0.2.1 Build 23339 WIN 64 and when he runs a workspace, nothing shows up AT ALL in the translation log window. It remains completely blank. We tried using the Log File in the logging section of the Workspace Parameters and when we open this file in a text editor, it is not empty and shows the translation log as expected. I am starting to think it might be just a weird visual bug with FME Form 2023.0.2.1. Did anyone else experienced this bug in the past with 2023.x or any other version of FME Form? I added pictures to show what I mean by a "blank" translation log window and also my client's log settings and log file. Thank you.
Hello , i would like to understand in detail more about anchored snapper segment type .what is difference in segment type instead of others ? my case : I have end points but there are a little bit far away from lines and they should intersect with lines .when i use vertex point type ,with specific distance (0.2) nothing happened but when I use segment type with same distance (0.2)I found the lines changed the position and the points to let the point intersected with lines .i am only afraid if using segment type ,May be let some lines intersect with wrong nodes.what is the best method to Snap some end points to vertex of lines without problems ?i have used points as anchors and lines as candidates (Anchored snapper transformer )2.will be possible to let end point intersect with vertex of lines with out changing the position of lines ? Bcs segment types cause changing of position of lines i am thinking ,in case of no closet vertex from line to end point of another line . Could I force i
I need to convert: { "keys": [ <ordered list of field names>], "values": [ "<ordered list of field values, matching the keys field order> ]} What is the best way to do this in FME? Input example: see attachment
Hi! I have a big Workbench which does a slope and aspect calculation on roofs to evaluate the potential of solar panels. I have solved everything except setting different colours on my faces based on the calculated effect by a colour-range. I want to export the extruded 3D polygons to Cesium ION as Cesium 3D tileset to minimize loading time. See print screens on my workspace below, i have tried maybe 100 different settings on AppearanceSetter and AppearanceStyler without result the only colour visible in the Inspector is the default grey.
HelloI am converting .gdb files to dwg format and want to add autocad object data from the gdb file.Can you help me to get there?
I am reading in 89 TAB files (geology polygons) doing a bunch of stuff, combining them and writing them out as TAB, GDB & SHP. I'm extracting both HEX and RGB values and adding them as attributes to the datasets to facilitate attribute based styling. The output RGB, HEX values match the input values. Unfortunately, the MapInfo writer(s) are outputting the incorrect colours i.e. mapinfo_brush_background and mapinfo_brush_foreground values. An inspector just before the writer has the correct values, but the final TAB file does not. The strange thing is that when I filter out 3 polygons for testing they output with the correct colours. It just goes wrong with 158,000 polygons. Any ideas?
I have the excel reader and have imported the data, but I dont know how to split the columns and say something like: (GPT4 Prompt)I have a flashcard with the term {TERM} with the definition {DEFINITION}. I want to convert this flashcard into a multiple choice question. The definition will be the question and the terms with be the answers. You will generate the question and 4 answer choices. The correct answer choice will be prefixed with a '*' character and you will generate the other 3 incorrect answer choices. When generated the incorrect answer choices, make a selection to where the user will not be able to easily use process of elimination to conclude the correct answer. For example: Uppers, stimulants. Legitimate and useful medical applications, but often abused. Example Ritalin for ADHD. Adderall for obesity, ADHD and narcolepsy are called what? *AmphetaminesGPT generated incorrect answer choiceGPT generated incorrect answer choiceGPT generated incorrect answer choice Tha
Hi community, I've many postgres table in source, with differents structures. I would like to send them in Big Query, with, for each table, the same structure, so I thank to regroup source and regroup target to do that. But, I would like, transform the date format for each postgres field. In fact I know to do that with DateTimeConverter but I've to declare all field one by one. It is possible to do that with "all date fields" ? Thank you for your help.
HiI drew a simple shape with google my map and export it to kml in my browser then i convert it to dwg/dxf with FME quick translator to modify the shape with Autocad, but the original map stretches out and shows a wrong map, it also happens when i convert dwg/dxf files to kml or gpx.how can i fix it?
HI, I get error above when i write to Feature Class in SDE. i have no issue if I write into GDB.( i also attached the log file here).would you let me know what the issue is and how to solve it. Appreciated for your help.
How do I automatically delete both the parenthesis and the content in them from my reader file? Is String Replacer the transformer to use? If so, can you help me with the code needed to find and replace any () and the numbers inside them with a blank. in other words, I want to delete them. This will probably be easy to a lot of you so I really appreciate your help.