A space to discuss FME Form
Recently active
Good eveningI produce a worbench wich create a file gdb and different features class (table, polyligne, polygon) from a excel file wich describe :fme_feature_type_name fme_feature_type_alias name alias fme_data_type geometry native_data_typeIs it possible in the same excel file :to create domain value (domain code and domain describe) to apply Global Id to apply editor trackor Thank you
Hey all, I am very new to FME and this may be a basic question, But I currently can’t find the answer elsewhere so I figured I would post and see if anyone can point me in the right direction. Currently, I am exporting from a GE small world database and moving the data to a FGDB for data analytics in other software. This is a complete export of all available data. That much I have been able to figure out with a few minor transformations. What I can’t yet figure out is how do I export only a small portion of the database. Say by a predefined polygon within the existing data set. For example My DB crosses a number of contiguous cities all having a defined boundary within the drawing. How do I tell FME to select and export only the lines and other objects within the city boundary of interest and excluded the data within the other city boundaries? Ultimately I need this breakdown so I Can export this to AutoCAD since the full DB is entirely too large for one drawing. Any help is apprec
HelloI find this workbench on this website and i try to use it with FME 2024. It doesn’t work with the new version and i would like to know what is the issue. Could you please explain ?Thanks a lot
I’m trying to retrieve data from a nested JSON response of an ODATA Feed.For testing, I try to access the “Emails” property of this ODATA example service: https://services.odata.org/V4/(S(hg4u5ox0x0r2rjva5qwwra05))/TripPinServiceRW/PeopleThe JSON structure is as follows:{ "@odata.id": "http://services.odata.org/V4/(S(hg4u5ox0x0r2rjva5qwwra05))/TripPinServiceRW/People('russellwhyte')", "@odata.etag": "W/\"08DC9753B5381A6D\"", "@odata.editLink": "http://services.odata.org/V4/(S(hg4u5ox0x0r2rjva5qwwra05))/TripPinServiceRW/People('russellwhyte')", "UserName": "russellwhyte", "FirstName": "Russell", "LastName": "Whyte", "Emails": [ "Russell@example.com", "Russell@contoso.com" ], "AddressInfo": [ { "Address": "187 Suffolk Ln.", "City": { "CountryRegion": "United States", "Name": "Boise", "Region": "ID" } } ], "Gender": "Male", "Concurrency": 6385516329
Hi,I'm working with Sentinel-2 images. I would like to know if it's possible to use FME to remove or clip clouds from images. Does anyone have any ideas? Is it possible to use Google Earth Engine (GEE) with FME?Thank you.
Hi.Could I please ask for a little assistance. I have about 1700 GeoTIFF files that I need to convert to 1700 JPG2000 files. So it is a 1:1 conversion for each file.I am familiar with converting GeoTIFF to JPG2000, but how do I do this en masse?FME Workbench 2020.Yours sincerely.James Blythe.
Hi. I have the JSON data below and I have managed to expose attributes from this using the JSONFragmenter but am stuck with trying the extract the thirdparty.names from this record. As there are multiple names in this nested array I need to extract them either as a comma separated attribute. i.e. Leicestershire County Council, Mr J Tomms. Or as a list that I can work from. I cant seem to expose this attribute due to it’s nesting. Any help with the correct transformer and configuration would be great. Currently using FME Form 2023.2.2 but can update to 2024 if it is easier. { "_index" : "xxx", "_type" : "_doc", "_id" : "667951b042fcaa46307d1935", "_score" : null, "_source" : { "coi_num" : 68902, "engagement" : { "mail" : "Bob@home.com", "objectguid" : "8dc75819103e4e408684a75f87fd320b", "dn" : "CN=Bob Smith,OU=Rural,OU=Worcester,OU=FGUsers,DC=fg
Hello, GML always writes a hyperlink at the beginning of the output, how can I fix this?
I have been trying to automate uploading/deleting from a Google Drive Shared file using a GoogleDriveConnector, which I thought was recently changed to support shared drives. The first issue is that the files do no automatically overwrite if they have the same name, they create duplicates, whereas if you upload manually the files will become versioned. To get around this, I assumed I would be able to identify and delete the older file first before uploading the new file, however when trying to delete the older file I get:"2021-10-20 15:19:39| 21.6| 0.0|INFORM|Delete_existing_file: Object with id "File ID" does not exist on Google Drive. Nothing to delete". (I have removed the ID for this post). I have permissions to delete from the drive, and I have created the shareable link manually as a check to confirm that the file ID is correct and exists. I can successfully upload new files to the said folder, but I'm trying to avoid a scenario where I have a load of outd
Hello all,Since I wasn’t able to find anything in the FME documentation about this and despite reading hundreds of community posts, I wanted to share what I’ve learned about using the GoogleDriveConnector transformer to delete files in Google Drive Shared Drives and Shared Folders.When using the GoogleDriveConnector in FME to delete files you need to make sure you have the right access. Shared Folders and Shared Drives have different types of access levels. For Shared Folders you have "Editor", "Commenter", "Viewer". If you want to be able to "Delete" files from these folders you will have to have an "Editor" level access right to the folder and the files.For Shared Drives, the access levels are "Manager", "Content Manager", "Contributor", "Commenter" and "Viewer".Due to the restrictions on the Shared Drive, its folders, and the difference in the actions each access levels can have, if you want to delete files from a Folder in a Share Drive folder you will need to have "Manager" level
I have a lot of excel spreadsheets that all have the same attribute schema. However, there are a varying number of header lines that precede the data in each. In FeatureReaders & Readers, we define the start point for data by line number. Given the consistency of the attribute schema and the inconsistency of the header spiel, I’m trying to think of a way to only read in the ssheets from the start of the data/attribute names, i.e. dynamically, defined by the first attribute name rather than the line number (I guess). Any ideas?
Hello Forum, I need to start uploading data to a MS Azure Blob Storage account set up by our IT service providers.I have a Creator connected to a FeatureReader which is reading in the source file. The FeatureReader is connected to an AzureBlobStorageConnector transformer.But I first need to set up a new Web Connection through FME Options… I asked our IT provider for the Access Key ID and Secret Access Key of the Azure Blob Storage. They responded by saying that I should just use my standard network username (for the Access Key ID) and my standard network password (for the Secret Access Key). This really doesn’t sound right to me. I was expecting Access Key ID and Secret Access Key for the Azure Blob Storage. As I’ve not used Azure Blob before I don’t know what an Access Key ID and Secret Access Key would look like, but I’m sure it’s not my network username and password! Has anyone had successful experience with using the AzureBlobStorageConnector? If so, what did the Access Key ID and
Hi, I’m fairly new to FME and having some issues with the PointOnRasterValueExtractor.All datasets are in EPSG:7850 (GDA2020, zone50) and the PointOnRasterValueExtractor seems to be working as I can see the correct values when I interrogate the points.The issue is when I try to write the output to a Shapefile. The Q__band values are all zeros.What am I doing wrong here?
Hello experts,My question is simple.when using the Directory and File Pathnames to access a directory, can I then read files from that directory?I would like to be able to view and query the data in those 1042 filepaths passing the testfilter.see my current workbench: any help would be much appreciated,thank you.fb
Hello all, I am a beginner with CityGML and am currently trying to convert a dataset to CityGML 3 with generics extensions using FME Workbench.I re-organized the features in TrafficArea and added some new generic attributes. Then, I want to map these new features back to TrafficSpace to build the child-parent relation. But I always failed. I am not sure whether I used the wrong way to create the new TrafficSpace, and I didn’t find the tutorial online either. My workflow for the TrafficSpace is shown below. I extracted the boundaries from the TrafficArea and set them with lod2MultiCurve as the TrafficSpace back. Welcome for any suggestions or assistance! Thank you very much.
Hi all,I am looking for a transformer that does the opposite of the ListKeyValuePairExtractor.It needs to create a list with FIELD_NAME and FIELD_VALUE pairs for all the attributes on a feature.I checked the transformer gallery and the FME Hub, but could not find such a transformer.Has anybody a solution?Could be a Python script. Thanks in advance.Erik
I have a bunch of ZIP files which we download the contain data in 3 formats, shape, csv and file gdb. The zips also contain numerous other files such as pdf and xml, which we don't need to read. Now the tricky bit, I am using a PATH reader to check a directory to see what ZIPs are there and to only load the ones that have arrived in the last 24hrs. The load is triggered in a Sub workbench where the Path is passed to a FeatureReader set to Generic. I can add I file type filter to the path that is passed by adding [**\\*.shp], for example to the path of the zip found by the PATH reader and can read the ZIP 3 times with a different filter each time by building this string""@Value(path_windows)[**\\*.shp]" "@Value(path_windows)[**\\*.csv]" "@Value(path_windows)[**\\*.shp]"" but can't work out how to add filters for csv and gdb to read the file once and look for shp, csv or gdb. The above works, but I get error messages for the iterations th
Hello togetherI am currently working with two watercourse datasets from different sources, which unfortunately do not take the same course depending on the region, although in reality there is clearly only one watercourse. For this reason, I would like to merge the datasets or assign the attributes of one dataset to the line segment of the nearest neighbour of the other dataset.I've already tried a bit myself in ArcGIS Pro, but haven't come up with a clever solution. Do any of you have an idea for this?Thanks in advance for an answerBest regardsDani
I have one FME workbench running on application server to export all the GIS sql tables into MapInfo tab files. It was running fine before but recently failed a couple times, its failed to export tab files after running 50 minutes or so, and each time its failed at export different sql table. I checked disk space and sql tables and they are fine to me. Any suggestions are greatly appreciated, the log file is attached.
I have a somewhat large (~180k lines, 100 cols) set of features coming out of a database reader that I'm loading into a PythonCaller to run some heavy processing on. I've been doing some profiling and it's a big contributor to slowdown in my workbench. To my surprise, though, the number crunching only represents about 10-20 seconds of the 90 seconds runtime for that node. Most of it is actually spent in the hot loops that run feature.getAttribute (another 25-30s) and feature.setAttribute (about 50s). Meanwhile, using a FeatureWriter and a FeatureReader, all these features can be written to and read from Parquet files in seemingly less than a second. It's not exactly easy due to how FeatureReaders don't output the path of the file they've written to, and PythonCallers only have one input node, making it difficult to handle passing a temporary output file name, but it cuts down my translation time from 90 seconds down to 9 seconds. Are these the only two ways of d
Hello everybodyI am currently working with a watercourse network dataset (lines), which is divided into a new segment each time a new watercourse branch branches off or is integrated. Unfortunately, the dataset contains very obvious "errors" as the width of the watercourse between two consecutive segments is much too large and the orthophoto also clearly shows that there must be an error here.I am not that experienced in FME yet and so far I have simply determined the points between the segments and was able to assign the different values of the touching watercourse arms to them. My main task is actually to provide the person responsible with an extensive data set that quickly shows where the difference between two watercourse widths is greater than XX metres (parameterisable). I have currently arrived at the status in the screenshot below, where the intermediate points with the water widths are listed for each line. Ideally, however, I would like to have only one line per point with t
I have a line feature (electrical wire) and a polygon feature (containing buildings). I want to get the distance from the wire to all buildings, along with the parameters (angle etc.) when using the tool “near” in ArcGIS Pro.Is there a way to do this in FME? Either with a similar tool, or maybe create some sort of connection and use that specific tool in FME. Im working with FME workbench 2022.2
HiI need to update several Excel files within a zip file. I have contacted support and they have created a problem report for the development team (FMEENGINE-83267, I have reproduced the problem with updating multiple Excel files within a zip file). FME Form 2023.2.1.0Build number: Build 23774Meanwhile I need a work around, any ideas?BrFelipe Verdú
I’m trying to load a csv that is saved in sharepoint. I want to convert this to Excel as well as process the data and export to other formats. I can access the data in a browser. Nothing is returned by the httpCaller or the SharePointOnlineConnector.
Hi,I have some utility pipes that have been modelled by a sub contractor. When I bring them into FME they are surfaces. This doesn’t surprise me, though they area actually shapes. Can anyone thing of a way to build these surfaces into solids? Say I have a cylinder for a pipe. It comes in as a surface but should topologically be a shape. I wish to convert itI also wish to find the centre line of these solids, and their diameters which I haven’t been able to do eitherAny help would be appreciated. I have the 2023 versionThanks