Creating and organizing workspaces. How to use Workbench.
Recently active
I currently have about 175 ETL workbenches for extracting Smallworld data for ESRI/Oracle which are being run from scheduled job on FME Server, and rarely are also manually run individually via FME Desktop if the scheduled job fails. We are moving to a new environment (new network, new hostnames etc.), so each workbench now has to be visited individually to change the Smallworld connection config. Are there any plans to allow a Smallworld database connection (i.e. under Tools/FME Options/Database Connections) to be created? If not, would anyone have any suitable method (considering I will be visiting all of these anyway) to provide a centralised parameter(s) type solution to allow one location to have the connection config information? I am even starting to look at 'config.ini' type functionality in each workbench, but obviously that is a kludge. Any ideas/possible solutions would be very welcome - thanks.
Working with FME 2021 here, trying to set up a Choice with Alias parameter and it seems the option to import format and coordinate system names has disappeared in this version. Does anybody know how we can get that back (other than setting up the workspace in 2020)
Hi list.I'm attempting to use a FeatureWriter to write som ESRI Shape files, wanting to utilize the schema features from the (WFS) input (read with FeatureReader) to enable dynamic schema based output.I have selected "Schema from schema features" for source and "fme_feature_type_name" for definition name. And both schema and data features arrive at the same port in FeatureWriter.However, the workspace fails immidiately when FeatureWriter receives the first schema feature, and long before any data features arrive.Why does FeatureWriter fail when receiving a single schema feature? I would have expected it to just keep it (them) until any data features arrive ?Is dynamic schema definition driven output at all possible with FeatureWriter ?Any help is appreciated.
I can create a list of schemas and tables, using a SQLCreatorselect schema_name(t.schema_id) as schema_name, t.name as table_namefrom sys.tables tand then i can use that in an SQLExecutorselect top 10 *from [@Value(schema_name)].[@Value(table_name)]and this is where i get stuck, as each table will have different attributes to expose. I have also tried using a dynamic reader & writer combination, but couldn't workout how to stop it reading all the records in each table (which would take way too long to run). i'd appreciate any help you can offer.
I have an FME Server App configured to run a workspace. That workspace may run an FME Job Submitter that runs another workspace. The second workspace has a data download service on it. How can I get the App to access the data that is made available from the second workspace triggered by the Data Download service?
Hi,Is it possible to set AutoCAD Lineweight and Linetype at Layer level instead of Object/Entity level? I am using DWGStyler transformer and a DWG Template. Each object is represented with the correct lineweight and linetype; however, these are set at object level instead of layer level as you can see in the below picture. Thanks,Ana
Points to Polygons: I've done file translations, have never tried points to polygons, the points are a mess, suggestions welcome! See image, can send the shapefiles if needed. My guess is AreaBuilder.
Hello, We're experiencing issues with google sheets v4 writer adding large amounts of blank rows to the bottom of google sheets. It eventually causes the writers to fail due to size. Thank you!Robyn
HiI'm trying to set-up a Scheduled task to run a workspace whilst i'm on leaveThe Scheduled Task has been set up to look at a .bat file, copy of which is attached to this post when i run the .bat file using the cmd prompt, i get the following error message; File \\\\gis\\GIS\\ITDATA\\FME\\Batch runs\\Standard Runs\\StatMap_QGIS_Addr_Cross_Refs.fmw--SourceDataset_CSV2 could not be openedProgram Terminating Could it be failing because there are 3 seperate csv files running in the Workspace?I've copied SourceDataset_CSV2 to a local drive, as well as changing the file paths back to the mapped drive locations, but am still getting the error messageHas anyone got any advice or workarounf they can provide?thanks Simon Hume
Hi list.I was under the impression, that every single transformer in a workspace had its own set of parameters.However, I now have a custom transformer in my workspace, which contains two FeatureReaders, both targeting WFS. They seems to have a shared parameter set.Whenever I change the parameters in one of the FeatureReaders, the parameters in the other FeatureReader mirrors those parameters exactly.This works both way, whenever I change one, the other changes too, which makes me suspect a shared parameter set.What gives ?Is this because they are embedded within a custom transformer ?Please advise.Cheers.
Novice question (my DOS days are very, very far behind me). I am trying to copy files (photo's) from one location to the other using system caller. The problem I encounter is that only the first photo get's copied. I use this line in the systemcaller: F: && cd F:\\folder\\photos\\ && md 10122019location && copy F:\\projects\\2019\\location\\drone\\fotos\\\\DJI_0503.JPG F:\\folder\\photos\\10122019location\\DJI_0503.JPG Of course the photo name changes for every photo I want to copy using @value(photofilename), but it only copies the first photo. How do I copy all? I do not want to copy all photo's in the source folder, else I could use *.JPG.
I am using a pythoncaller to access Zoom API to download unique meeting IDs. The code is:import ssl import http.client import zipfile import fme import fmeobjects # Template Function interface: # When using this function, make sure its name is set as the value of # the 'Class or Function to Process Features' transformer parameter def processFeature(feature): pass # Template Class Interface: # When using this class, make sure its name is set as the value of # the 'Class or Function to Process Features' transformer parameter class FeatureProcessor(object): def __init__(self): pass def input(self,feature): self.pyoutput(feature) def close(self): pass #Setting User Parameters MeetingID = "?????????" conn.request("GET", "/v2/past_meetings/"+ MeetingID +"/instances", headers=headers)What I would like to do is set MeetingID to feature.getAttribute('SCO_Zoom_Meeting_ID__c') where that is a value returned from a query from my database. I would appreciate any help. If
Is there a way to set up a workbench that would loop through an Enterprise SDE database & provide me with a list of layers without adding multiple readers? And also allow me to extract data from at least one of the attribute fields in each layer? How about using python? Thank you in advance.
If a User Parameter ends in a backslash - such as a Windows path, then accessing that value in a PythonCaller results in extra text. Example: if a User Parameter called foldername has the value: frog\\ then using fme.macroValues['foldername'] or FME_MacroValues['foldername'] in a PythonCaller returns:frog GUI OPTIONAL TEXT foldername Folder name:
The task is to migrate data from smallworld and oracle to sql-server.The data contains multiple geometry columns. So I've followed Writing to Database Tables that contain Multiple Geometry ColumnsI managed to insert the records but the geometry trait information is missing.Here is an example of Oracle:And here an example of Smallworld:The FME translation results in sql server:So the traits information is lost.Can I keep the trait information stored in Smallworld as "Text Rotation" or in Oracle called "oracle_orientation" into the sql db?Is there an sql-server equivalent?
I have a workflow that reads data from one database and puts it in another (postgres). My question, as an FME newbie, is how can I run another step after the Postgres Writer step - there seems to be no output port on the Writer module. The intent is to wait until the writing is complete, then run a GeoWebCache reseed step (though it could be any other step, really).
Hi, I have created Excel xlsx files using FME (using a Template and adding values in, for various formulae to use the inputted values to calculate others), and it works really well! My issue is then when I read that xlsx file back through FME, the formula (IF statements mainly) don't pick up the inserted values! I have them formatted as Numbers in both Excel and FME, and the statement is similar to '=IF(AB8=0,"No Maps",AB8)', which works well when opening in Excel, but every value is 'No Maps' for the above cells when opening in FME! Very frustrating! I'm running FME Desktop 2020.2.4, 64 bit. Thanks!
Trying to read from SDE but I get the following error:Unable to read from the table/feature class 'schemaName.tableName'. If 'schemaName.tableName' contains a class extension, make sure it is registered on this computer.Yes, there is a featureclass extension and it is correctly installed on the same machine. Arcmap is showing the parcels ok. The sde backend is postgres and SDE 10.6.1
Hello, I have a field in a database where KML's are uploaded and stored in Base64. Is there a way to export those and convert them to KML within FME? My end goal was to convert to KML, then covert them to shapefile for a Portal Layer. For example attached is one of the files encoded that I confirmed is a KML by manually decoding it outside of FME. I tried the BinaryDecoder transformer, but I wasn't sure what to do with the result.
Last week we upgraded FME Server to 2020.1. Since then our Data Streaming and Job Submitter Services as applied via webhooks don't work anymore. The log files indicate some AccessDenied-problems.localhost_access_log: Post call receiveddatastreaming and jobsubmitterservice logs: request received. Fatal error: Service failed: java.nio.file.AccessDeniedException: E:\\FMEServerData\\resources\\system\\temp\\requestdata\\1710266074152417324FME Server runs on a service account with admin rights to all of the server.How to solve this?
I've got a bunch of AGOL Feature Layer (hosted) created with different schemas and I'm combining them into One AGOL Feature Layer (hosted). I can see the AGOL READ is seeing the "Photo Attachments", I can fix schema/attribute variations but "Photo Attachments" are not moving across the New Feature Layer.
I have a fairly complex workspace that does a few different things. Is there a way that I can select a transformer and copy all its dependencies as well? It's able to do a similar thing when we run the left green arrow in feature cache mode. It'd be great to see an ability to select and copy the objects as well if we want to pull it out into a separate workspace.
This morning I stumbled upon the Recorder and Player. After reading the documentation I was really eager to try them out in a workspace for storing temporary files. We also tested the performance by comparing with a FeatureReader / FeatureWriter and we didn't find any big differences when the compression-level of the Recorder was low. However when increasing the compression level, the performance was increasingly worse with the Recorder in comparison with the FeatureWriter. Is the only advantage of the Recorder in stead of the FeatureWriter that it can compress the data? When do you use the one or the other?Thanks for your thoughts!
What should I do if I have an idea for improving FME? Previously I sent these to FME's support team and they filed it in their internal tracking system, but I never knew if others had the same ideas or maybe even some alternative ideas and approaches. I really wish I could see what everyone else thinks. Is there a better way?
Hi I have a table containing 2 columns StartPt and EndPt [see attached]. I would like to find all the connected nodes for each StartPt in the table. For example, the connected nodes for Startpts 107224 and 100561 are: StartPt EndPt107224 100561107224 101420107224 107197107224 107196100561 101420100561 107197100561 107196100561 103058 Any suggestion how this can be achieved in FME. Alternatively, I could look at doing this via a stored procedure.