A space to discuss FME Form
Recently active
Hello,I am loading citygml data with the OGC Citygml Reader and afterwards I want to calculate the normal vector of each roof surface.How can this be done in FME for a big data set? Using the SurfaceNormalExtractor I get some errors that result in stopping the calculation. After sorting out that surface I have to restart the reader and the surface normal extractor. Is there a better workaround?Thank you for your help in advance!
I have a dataset with 29m polygons some of which have the same attribute (say Key ID). I need to aggregate them by the Key ID but the dataset is not ordered. After nearly 12 hours of run time it has only aggregated 1.1m features. I need to find a better way of aggregating. Any ideas? The data is being read from about 10 shapefiles as the source data. I have access to Postgis if that would help.
I am trying to find out if there is a way to label some line features (lets say some streets or rivers) so that when I write HTML file to see directly these labels (like we label features in any GIS Platform e.g. ArcGIS). My solution so far (look the image below but I am not very happy with it): I used "Labeller" Transformer and then "TextStroker" but not very hapy since text stroker gives text outlines which is not very nice to see and therefore I dont have a lot of control over font style, font size etc. Any Idea ? I am using FME 2022.0.0.1.
I want to simply add a folder with 3 subfolders to an S3 bucket. I'm using the S3Connector transformer and it seems you need a file to Upload to an S3 folder to create a folder, whereas, it seems to me that you can't only add a folder w/o having a file to upload it. I tried adding a csv file to each subfolder to setup my folder structure in S3 and that works to get the main folder w/ 3 subfolders each containing an empty csv file. I then added 3 more S3Connector transformers w/ the Delete option to remove the csv files from each subfolder thinking then I would have the desired folder setup without any files in them. This doesn't work because when you delete the only csv file from the subfolder, it also removes subfolder leaving nothing left in S3. Is there a way to create the desired s3 folder structure without adding a file? Or is it possible to delete the file from the subfolder without removing the subfolder?
I've search quite a bit and can't seem to find an answer. Why would a log file not get created? If anyone has any ideas, I'd appreciate it. -Kurt
Hi When my published workspace on the FME Server makes a call against Sharepoint (graph.microsoft.com...) in order to download or upload files, it always results into a SharepointRESTAPIException and needs to republish the workspace with a reauthenticated web connection again and again and again in order to make it work: 2022-7-12 16:17:49 | Python Exception <SharepointRESTAPIException>: SharepointOnlineConnector: Error making request to https://graph.microsoft.com/v1.0/sites/[TENANT].sharepoint.com,[MYSHAREPOINTSITE] Access token has expired or is not yet valid. This way, an automation is absolutely impossible since manual actions are required. Our admins tell that the registered app on the Azure AD cannot be changed regarding the refresh token timeout:https://docs.microsoft.com/en-us/azure/active-directory/develop/refresh-tokens#refresh-token-lifetime The request parameters in the web connection definition looks like this:client_id=[CLIENT_ID]&client_secret=[CLIENT_SECRET]&
I have a process I need to automate.Let me describe what is usually done manually 1) I go to this website. I download a zip file. This is not a true FTP as it was suggested to be. So the automated download does not work. What is the way to figure out the javascript behind this? Or is there any other way to do this?2) I extract the zip file, but it's in the .tsv format. All I do is rename it to .csv The job cannot read that .tsv file. Perhaps it's not a good representation of the .tsv file. It's very clunky .csv, however usually works3) Once it's ready for csv the FME job updates the parcel data based on this csv Where to start with this? I was suggested to look into selenium, but I am open to anything
Hello, It seems this has happened more than once, so I feel like I'm missing something. I will create a Writer and it will show up in the Navigator Pane but not the workspace, which begs a couple of questions. 1) What did I do wrong or what should I do to avoid the ghost creation? and 2) How can I add the Writer to the Workspace from the Navigator Pane. Any pointers? Thank you. TylerFME WorkBench 2021.0
Hi folks,I am getting some obscure errors (Dropbox API I assume) using the DropboxConnector with bigish files >300 mb.Looking at the error and the Dropbox community I am assuming FME is using the /2/files/upload endpoint which is limited to 300 mb. Can anyone confirm there is an upload size limit with the DropBoxConnector? Workaround?
Hi,I need to update geospatial data in Geopackage format from a Google Sheet file that contains addresses to geocode that are updated regularly. The process of creating points via geocoding works very well. However, I need to create buffers around points based on an attribute of a field and use the existing Geopackage output file to add the update news. I also have to update the output file of the points in order to add the new entities to the Geopackage file by specifying in my output file the table to update. Unfortunately, when I run my workspace I get the following error message:OGCGEOPACKAGE writer: Requested feature type 'zone_buffer_300m' does not exist. OGCGEOPACKAGE writer does not have the ability to create new feature types. Create the feature type on the dataset before writingOGCGEOPACKAGE writer: A fatal error has occurred. Check the logfile above for details.Attached is a screenshot of the output file configuration settings window and the entire FME workspace.Tha
Hi guys......i have a workflow where i source .xls files out from 3 different folders e.g. C:\\temp\\PA8\\Lists, C:\\temp\\PA9\\Lists, C:\\temp\\PA7\\Lists and split them (about an specified attribute) into many .xls files into another foldere.g C:\\temp\\PA8\\splits, C:\\temp\\PA9\\splits, C:\\temp\\PA9\\splits and additionaly i copy the source files with the filecopy writer into another foldere.g C:\\temp\\PA8\\done, C:\\temp\\PA9\\done, C:\\temp\\PA9\\done all that is working well!!! BUT i want to empty the source folder after this processing in the same workflow......is this possible.....i have tried the Custom transformer File Deleter but i didnt get it how it works....any solutions or workarounds? Cheers and GreetzFranco
FME Server 2022.0.0.2 702022-7-13 11:59:29 | Could not load module 'F:\\Program Files\\FMEServer\\Server\\fme\\plugins/that_func.dll' : 'The specified module could not be found'712022-7-13 11:59:29 | Could not load module 'F:\\Program Files\\FMEServer\\Server\\fme\\that_func.dll' : 'The specified module could not be found'722022-7-13 11:59:29 | Could not load module 'F:\\Program Files\\FMEServer\\Server\\fme\\plugins/that.dll' : 'The specified module could not be found'732022-7-13 11:59:29 | Could not load module 'F:\\Program Files\\FMEServer\\Server\\fme\\that.dll' : 'The specified module could not be found'https://community.safe.com/s/article/Known-Issue-Instability-Running-Python-on-FME-2022-0-for-Windows-10-and-Windows-Server-2019-Version-1909-or-Older
Hi, A question closely related to this older post: https://community.safe.com/s/question/0D54Q000080hE6vSAE/workspacerunner-how-to-catch-all-items-created?t=1657893646062 I have placed a WorkspaceRunner in a Custom Transformer. The WorkspaceRunner is set to Wait for Job to Complete. With the suggestion from the older post, I have placed it in a custom transformer so it can run multiple jobs in parallel but still is able to wait untill jobs are completed. Parallellism is set to Moderate, so 7 threads can be used on my machine. I can see the first 'batch' of 7 results being send out of the custom transformer. Later I can see the next 7 results being send out. But immediately after, it's not longer waiting for the other 115 Jobs to finish and continues. I have tried to prevent this by using a FeatureHolder and a Sampler (Last), but no result. Flow should only continue after finishing all 129 features. Any ideas? In the older post there was a Python suggestion of @Takashi Iiji
Hi all,I'm encountering an issue while reading from a PostgreSQL DB and trying to write into a AGOL Feature Service. If I run using the FME Desktop 2021.2, the process run perfectly, reading and writing the Feature Service. When uploading the Workspace into FME Server (FME Server 2021.2.3 Build 21812 - linux-x64), and running it, the message is this one: ""2022-7-15 14:15:44 | ArcGIS Online Feature Service Writer: Feature Service 'xxx_layer' does not support writer mode ''. Its owner may have disabled inserting or editing features. Writes may fail if the current user is not the owner or administrator""Although telling me the correct of the Features were written. From AGOL, I've checked that is ENABLED the edition on features. Also, the FME Server has correctly Authorized. Is there something that I'm not having into account?Thanks,
Folks, I have a huge number of access databases the include the '{' character. FME is clearly trying to treat this as a wild card character instead of a part of the file name. Is there a way to get FME to READ them as names not wild cards from the reader? Otherwise im going to have to bulk rename a lot of files... thanks.
I have DGN file. In Microstation I can see that it had a defined GCS (ETRS89 / UTM zone 32N) When I read the file with FME the coordinate system is not recognised. How do I get FME to read the GCS details?
I'm trying to sum a series of values by an ID in the StatisticsCalculator (using the group by function) and the summed values keep returning as scientific format (5.9e-6) but I want the decimal number (0.00000599). How do I do this? P.s it only seems to happen when I set to group by.
Hi,I have a shapefile with municipality polygons and I am using the SpatialRelator with the option "Requestor Touches Supplier" to count the number of neighbours of each polygon. However, I need to know the lenght of each common border for all polygons. Is there a way to output that information? In QGIS is posible (as explained on this link https://spatialthoughts.com/2020/04/08/calculating-shared-border-lengths/#more-962 ) but it's not very fast to run, therefore I would like to do the same in FME.Thanks and best regardsOscar
I want to mosaick 188 netCDF files into a single netCDF file. I get the errorNetCDF writer: Failed to end definition. The error was 'NetCDF: One or more variable sizes violate format constraints'The data is a DEM, so only one band which is elevation.I have attempted both "Classic" and "64-bit Offset" ParameterWhat am I doing wrong?
Hi there, Thanks in advance for your help. It's my first time using FME server and setting up an app. I want the end user to be able to upload a folder full of shapefiles or gpx files. In Desktop, I have the parameters set up so the user can upload folders and the subfolders within it. I can't find this option in server. I see I can upload one file at a time, but that's not what I want. Can anyone point me in the right direction? I want to capture all this info in the folder structure:OperationName>Fieldworkername1>All the gpx and shapefilesOperationName>Fieldworkername2>All the gpx and shapefilesOperationName>Fieldworkername3>All the gpx and shapefiles
Hi,I want to run some Rscript and so installed an R-interpreter and installed some Libraries. As a test case I downloaded the workspace from a rather old article "RCaller: Ins and outs of using R in FME". The workspace is from 2020 though so i ran it on both 2019 and 2021 versions but it returned the same error in both cases. Actually the exact same error as mentioned in the article itself: "Failed with exit code 1 when executing R script. Output was: Loading required package: gsubfn.......". Now the article mentions to check spelling but as the workspace is an exact copy from safe I expect that to be tested and ok and furthermore that is just not the issue as the line "fmeOutput<-data.frame(meanEst,meanAct, r2, m, k)" in the Rcaller works just fine if I just pick one of the columns for output, irrespective which one. e.g. "fmeOutput<-data.frame(r2)" But the moment I comma separate a few data frame columns for output I get the error.Any hel
Hello FME'ers,This is a slightly late and slightly shorter version of What's Up Wednesday this week. Voting for WebinarsAt Safe, we're just planning the webinar lineup for the final quarter of this year (October to December). We'd previously asked users for suggestions, which we reviewed, and now we want to put that list to a vote. The simplest way we could think of was to add them to the Ideas section of the community. So that's what we did: Please do log into the community, browse the list, and vote for your favourite webinar suggestions. Just like FME functionality, the more upvotes a webinar gets, the more we are likely to present it. If you want to isolate all the webinar ideas, then be sure to click the Webinar tag on the Ideas page: On the subject of Ideas, write down your best ones and bring them to the FME User Conference with you, where the User Experience team is waiting to discuss FME with you! Our Webinar HistoryThere was an interesting tweet from Geo
I would like my workspace to start with nothing filled in the user parameters. I tried creating presets but that doesn't work as the workspace is being used in a Gallery app and there is no access to the presets there. Is there a way to have the workspace saved so it opens with no values in it whenever the user opens the form?
Hi, I am creating contour lines and contour polygons from a raster geotiff file with 50m intervals. In lowland areas near the sea a lot of tiny lines/polygons are created wherever the elevation fluctuates around value 0-m. GDAL has a parameter (Offset from zero relative to which to interpret intervals) which allows setting an offset so as to reflect only significant low elevations (by setting it to -5 for instance). However this parameter is not present in the ContourGenerator transformer of FME.Can you think of a workaround for simulating such behavior? Otherwise is it easy to call the GDAL function from within FME?Thank you! Best regards, Olivier
Which transformer can I use to convert text from a dgn to points or cells? The origin of the coordinates should be retained and the actual text should become the new cell name. Example: Text: "House" --> cell name: "House"