A space to discuss FME Form
Recently active
Hello,Ourorganization has a server specifically set up to run FME desktop workbenches. Wehave made the GIS connections public and have made every effort to have thesame user that saved the workbench also be the user that is triggering thewindows task scheduler. There is an excel file that is located on anotherserver that FME can access when the workbench is run manually. However, when itis run with window task scheduler there are two errors. 2021-07-3012:01:24| 7.9| 0.0|ERROR |Excel Reader: Failed to open thedataset '\\\\vmcognos\\GIS\\COT Inter Department Meters Consumption Accts-en-us.xlsx'. Errormessage was 'Permission denied.' 2021-07-3012:01:24| 7.9| 0.0|STATS |Stored 1007 feature(s) to FME featurestore file`C:\\Users\\COTAGS~1\\AppData\\Local\\Temp\\CIS_GIS_Bridge_EDITSDE_GISFCTableCreation_PROD_120104\\inspector.ffs'2021-07-3012:01:24| 7.9| 0.0|INFORM|Saving spatial index into file'C:\\Users\\COTAGS~1\\AppData\\Local\\Temp\\CIS_GIS_Bridge_EDITSDE_GISFC
I want to delete the input data in my script with the help of the Featurereade and the hub FileDeleter , but only when all features have been beforehand wrtitten to an export map in the FeatureWriter (see image below). So I don't want featurereader and the FileDeleter already running when not yet all files have been exported . I was wondering how that can be achieved in FME desktop? In case my question is a bit vague, just let know.
I am reading data from a file geodatabase in my workspace. The data is huge and takes time to process data. I have set up a query to only filter data that ends with .2022 but the workspaces are still slow. Therefore, I intend to set up a query on a Date Modified column and a Create date column in the file geodatabase. This will filter only data modified and created within the last seven days. I can't figure out how to set up a query and filter data from the last seven days in FME. Any help and advice would be greatly appreciated. Thank you,
FME 2021.2.2 on Windows 11 To use the win32com module with a PythonCaller, I have installed the module with this command.fme.exe python -m pip install pywin32 --target C:\\Users\\<user>\\Documents\\FME\\Plugins\\Python cf. Installing Python Packages to FME Desktop In the PythonCaller script, use the module with this code.from win32com.client import Dispatch This error message appears when run the workspace.Python Exception <ModuleNotFoundError>: No module named 'win32api' I believe that the script is not wrong, since the workspace can be run if I install the module into an external Python interpreter and use it as Custom Python Interpreter for FME. Can you use win32com into with the Python interpreter bundled in FME Desktop?
I have one shapefile with polygons representing a cartographic sheets at some scale. Each polygon has an unique identifier (IDn). I have used SpatialRelator transformer (see attached image) to look for neighbor sheets for each of them, and ListConcatenator to save for each polygon the list of neighbor polygons identifiers. The attached example shows that selected polygon (ID0) has 3 neighbor polygons (ID1,ID2,ID3). The IDn is the identifier included in the shapefile name located in some directory following this pattern: .\\IDn\\*IDn*.shpI have to merge the 4 shp corresponding to ID0, ID1, ID2, ID3 to output only one shapefile. I have used Directory and File Pathnames READER in other context but here I don't know how to look for these files. Maybe using WorkspaceRunner or PythonCaller? Please, could you give some advice? Thank you in advance!
Is there a way to set-up an email notification if our FME engines have been running a job longer than 24 hours? All of our other FME jobs have not run since 7-11 due to our 2 Engines being clogged up by 2 hanging jobs (I cancelled these just now).
Hi Community, does anybody know a way to force FeatureWriter to wait for completion of a writing task of a feature type before the next writing is triggered? I'm trying to delete features on a database (Oracle Non Spatial) with constraints on the affected tables. So I must enforce a specific delete order. Currently I use a rather complex mechanism with mutiple FeatureWriter transformers in chain and would like to tie them down into one FetureWriter. If a FeatureWriter could be configured in that way it would also be great to do the action within a single transaction. Is this possible too?
We have an automation that runs and outputs a report result as a HMTL page using the data streaming service. Our testing did not have any issues, but in our production system, it appears if the job is queued, the web client times out, although eventually the job completes on server. If there are not jobs in the queue, or the job is a quick job it completes without error. Does anyone have any ideas on why this is occurring?FME server 2019 with 3 engines.
Hey community! I made a script that creates 3D DWG blocks for me but the elevation information does not match the 3D position of the blocks, why? Look at the picture!
We're experiencing issues accessing raster data through WMTS from a particular provider. After discussing with the provider what the issue could be they said that seeing FME is downloading all the tiles rather than streaming them, it places a massive request so it is blocked.Is there a way to make FME stream rather than download?
I have a ESRI SDE Geodatabase that was created using an identity field. So, to update the table I am using the Microsoft SQL Server Non-Spatial Writer. For some reason though it won't update the table. The table parameters I have are as follows:Feature Operation: UpdateTable Handling: Use ExistingWhere Clause: **Set to the unique fields necessary**Insert into identity column: Yes Is there anything else that needs to be set to update a record?
Hello,I am loading citygml data with the OGC Citygml Reader and afterwards I want to calculate the normal vector of each roof surface.How can this be done in FME for a big data set? Using the SurfaceNormalExtractor I get some errors that result in stopping the calculation. After sorting out that surface I have to restart the reader and the surface normal extractor. Is there a better workaround?Thank you for your help in advance!
I have a dataset with 29m polygons some of which have the same attribute (say Key ID). I need to aggregate them by the Key ID but the dataset is not ordered. After nearly 12 hours of run time it has only aggregated 1.1m features. I need to find a better way of aggregating. Any ideas? The data is being read from about 10 shapefiles as the source data. I have access to Postgis if that would help.
I am trying to find out if there is a way to label some line features (lets say some streets or rivers) so that when I write HTML file to see directly these labels (like we label features in any GIS Platform e.g. ArcGIS). My solution so far (look the image below but I am not very happy with it): I used "Labeller" Transformer and then "TextStroker" but not very hapy since text stroker gives text outlines which is not very nice to see and therefore I dont have a lot of control over font style, font size etc. Any Idea ? I am using FME 2022.0.0.1.
I want to simply add a folder with 3 subfolders to an S3 bucket. I'm using the S3Connector transformer and it seems you need a file to Upload to an S3 folder to create a folder, whereas, it seems to me that you can't only add a folder w/o having a file to upload it. I tried adding a csv file to each subfolder to setup my folder structure in S3 and that works to get the main folder w/ 3 subfolders each containing an empty csv file. I then added 3 more S3Connector transformers w/ the Delete option to remove the csv files from each subfolder thinking then I would have the desired folder setup without any files in them. This doesn't work because when you delete the only csv file from the subfolder, it also removes subfolder leaving nothing left in S3. Is there a way to create the desired s3 folder structure without adding a file? Or is it possible to delete the file from the subfolder without removing the subfolder?
I've search quite a bit and can't seem to find an answer. Why would a log file not get created? If anyone has any ideas, I'd appreciate it. -Kurt
Hi When my published workspace on the FME Server makes a call against Sharepoint (graph.microsoft.com...) in order to download or upload files, it always results into a SharepointRESTAPIException and needs to republish the workspace with a reauthenticated web connection again and again and again in order to make it work: 2022-7-12 16:17:49 | Python Exception <SharepointRESTAPIException>: SharepointOnlineConnector: Error making request to https://graph.microsoft.com/v1.0/sites/[TENANT].sharepoint.com,[MYSHAREPOINTSITE] Access token has expired or is not yet valid. This way, an automation is absolutely impossible since manual actions are required. Our admins tell that the registered app on the Azure AD cannot be changed regarding the refresh token timeout:https://docs.microsoft.com/en-us/azure/active-directory/develop/refresh-tokens#refresh-token-lifetime The request parameters in the web connection definition looks like this:client_id=[CLIENT_ID]&client_secret=[CLIENT_SECRET]&
I have a process I need to automate.Let me describe what is usually done manually 1) I go to this website. I download a zip file. This is not a true FTP as it was suggested to be. So the automated download does not work. What is the way to figure out the javascript behind this? Or is there any other way to do this?2) I extract the zip file, but it's in the .tsv format. All I do is rename it to .csv The job cannot read that .tsv file. Perhaps it's not a good representation of the .tsv file. It's very clunky .csv, however usually works3) Once it's ready for csv the FME job updates the parcel data based on this csv Where to start with this? I was suggested to look into selenium, but I am open to anything
Hello, It seems this has happened more than once, so I feel like I'm missing something. I will create a Writer and it will show up in the Navigator Pane but not the workspace, which begs a couple of questions. 1) What did I do wrong or what should I do to avoid the ghost creation? and 2) How can I add the Writer to the Workspace from the Navigator Pane. Any pointers? Thank you. TylerFME WorkBench 2021.0
Hi folks,I am getting some obscure errors (Dropbox API I assume) using the DropboxConnector with bigish files >300 mb.Looking at the error and the Dropbox community I am assuming FME is using the /2/files/upload endpoint which is limited to 300 mb. Can anyone confirm there is an upload size limit with the DropBoxConnector? Workaround?
Hi,I need to update geospatial data in Geopackage format from a Google Sheet file that contains addresses to geocode that are updated regularly. The process of creating points via geocoding works very well. However, I need to create buffers around points based on an attribute of a field and use the existing Geopackage output file to add the update news. I also have to update the output file of the points in order to add the new entities to the Geopackage file by specifying in my output file the table to update. Unfortunately, when I run my workspace I get the following error message:OGCGEOPACKAGE writer: Requested feature type 'zone_buffer_300m' does not exist. OGCGEOPACKAGE writer does not have the ability to create new feature types. Create the feature type on the dataset before writingOGCGEOPACKAGE writer: A fatal error has occurred. Check the logfile above for details.Attached is a screenshot of the output file configuration settings window and the entire FME workspace.Tha
Hi guys......i have a workflow where i source .xls files out from 3 different folders e.g. C:\\temp\\PA8\\Lists, C:\\temp\\PA9\\Lists, C:\\temp\\PA7\\Lists and split them (about an specified attribute) into many .xls files into another foldere.g C:\\temp\\PA8\\splits, C:\\temp\\PA9\\splits, C:\\temp\\PA9\\splits and additionaly i copy the source files with the filecopy writer into another foldere.g C:\\temp\\PA8\\done, C:\\temp\\PA9\\done, C:\\temp\\PA9\\done all that is working well!!! BUT i want to empty the source folder after this processing in the same workflow......is this possible.....i have tried the Custom transformer File Deleter but i didnt get it how it works....any solutions or workarounds? Cheers and GreetzFranco
FME Server 2022.0.0.2 702022-7-13 11:59:29 | Could not load module 'F:\\Program Files\\FMEServer\\Server\\fme\\plugins/that_func.dll' : 'The specified module could not be found'712022-7-13 11:59:29 | Could not load module 'F:\\Program Files\\FMEServer\\Server\\fme\\that_func.dll' : 'The specified module could not be found'722022-7-13 11:59:29 | Could not load module 'F:\\Program Files\\FMEServer\\Server\\fme\\plugins/that.dll' : 'The specified module could not be found'732022-7-13 11:59:29 | Could not load module 'F:\\Program Files\\FMEServer\\Server\\fme\\that.dll' : 'The specified module could not be found'https://community.safe.com/s/article/Known-Issue-Instability-Running-Python-on-FME-2022-0-for-Windows-10-and-Windows-Server-2019-Version-1909-or-Older
Hi, A question closely related to this older post: https://community.safe.com/s/question/0D54Q000080hE6vSAE/workspacerunner-how-to-catch-all-items-created?t=1657893646062 I have placed a WorkspaceRunner in a Custom Transformer. The WorkspaceRunner is set to Wait for Job to Complete. With the suggestion from the older post, I have placed it in a custom transformer so it can run multiple jobs in parallel but still is able to wait untill jobs are completed. Parallellism is set to Moderate, so 7 threads can be used on my machine. I can see the first 'batch' of 7 results being send out of the custom transformer. Later I can see the next 7 results being send out. But immediately after, it's not longer waiting for the other 115 Jobs to finish and continues. I have tried to prevent this by using a FeatureHolder and a Sampler (Last), but no result. Flow should only continue after finishing all 129 features. Any ideas? In the older post there was a Python suggestion of @Takashi Iiji
Hi all,I'm encountering an issue while reading from a PostgreSQL DB and trying to write into a AGOL Feature Service. If I run using the FME Desktop 2021.2, the process run perfectly, reading and writing the Feature Service. When uploading the Workspace into FME Server (FME Server 2021.2.3 Build 21812 - linux-x64), and running it, the message is this one: ""2022-7-15 14:15:44 | ArcGIS Online Feature Service Writer: Feature Service 'xxx_layer' does not support writer mode ''. Its owner may have disabled inserting or editing features. Writes may fail if the current user is not the owner or administrator""Although telling me the correct of the Features were written. From AGOL, I've checked that is ENABLED the edition on features. Also, the FME Server has correctly Authorized. Is there something that I'm not having into account?Thanks,