Creating and organizing workspaces. How to use Workbench.
Recently active
Canadian Cities Open Address Data Attaching a sample FME workspace that shows how to import open address data from various Canadian municipal websites, and other authoritative sources. If there are additional Canadian open address data sources that you can find, please contribute to enhancing this.
If I leave them blank I get an empty string inserted into my database (postgis) - I really want Nulls
I'm playing around with security settings and it seems that if you password protect a custom transformer, it still spews out info in the logs from the internal guts of what's going on. Is there a way to prevent the internal guts of a custom transformer from being logged? Ie. I just want to show the input and output of the transformer. Is that possible? Seemed maybe like it was from this article https://community.safe.com/s/article/password-protection-for-fme-workspaces
Hello, I'm working with FME2020. I want to import several excel files with the same schema from one folder as different features. With a xlsx-reader (select multiple folders/files) all files are written in one feature. With a path reader I can't define a schema. Is there a way to read all the files with one reader or do I have to use one reader per file? Thanks in advance
I received a geopackage named "test.GPKG". When I set up a reader I select OGC GeoPackage as format and browse for the dataset. I select "test.GPKG" and click "Parameters" to select the tables. But then I get a error message that no such file exists. FME does not recognise the extension when written in capital. In the message FME is looking for "test.GPKG.gpkg". Solution: rename dataset to extention with lowercase letters. Like "test.gpkg". Then the tables are shown. Question: Is this behavior wanted? Or should FME also recognise the extension written in uppercase letters? Freek
Now and then I have a need to postprocess data written by a FME Server Data Download Service. In good old days (FME Server 2015) it was possible to do this in the Python Shutdown Script. Nowadays the results are obviously auto-zipped by the writers when running the Workspace on FME Server as a Data Download Service. I have not yet found any way to postprocess the results, as they are already zipped and the result filename is unknown (in the Workspace) when the writer has finished its job. My simple example substitutes some text in the file written by the FeatureWriter. This is necessary because of some limitation in the Writer itself. Everything works perfectly well in FME Desktop. In FME Server, published as a Data Download Service, the AttributeFileReader does not find the file returned by the _dataset attribute in the Summary port. Obviously because it is already zipped and removed by the Writer. Any ideas?
I have data that would need to be loaded into different tables. But I need to load them to load in a specific table order because of foreign key constraint. I have put on a connection runtime order which only controls the very next transformer. One of the data paths has a statistics calculator so i thought if i put a statistics calculator on the path that needs to be loaded last, this would give me the order I need but they are still going first.The first 2 are going in at the right order. The 3rd has the statistics calculator. It also has a tester where only the records that passed will be in the statistics calculator. The records that failed do not need to go anywhere. Also, all records can fail the tester. In that case, no related IDs are created for the 4th table so then the Foreign Key Constraint is not violated.I added 2 feature Holders and 2 statistics calculators on the 4th path hoping the 3rd path will finish first, but the statistics calculator for the 3rd path would stop, an
Right now I have several parameters accepting a single attribute selection and a published user parameter that accepts multiple attributes (basically you select all the ones you selected above). I want to use a single duplicatefilter transformer to filter out duplicates of the several user parameters that have already been provided.
Dear FME users, I have the error: Error decrypting data. Most likely this is because the encryption key is incorrect. Please contact your administrator to retrieve the correct encryption key. System;Remote environment: Windows Server 2012 R2 machines with RDP (remote desktop)The workspace is managed by RES/Ivanti v10.2. with separate autorisationEnvironment variables for Oracle on serverPath=C:\\ProgramData\\Oracle\\Java\\javapath;C:\\Windows\\system32;C:\\Windows;C:\\Windows\\System32\\Wbem;C:\\Windows\\System32\\WindowsPowerShell\\v1.0\\;I:\\APP\\Oracle\\Client11g\\X32\\Client\\binTNS_ADMIN=I:\\APP\\Oracle\\network\\admin and FME: PATH=I:\\APP\\Oracle\\client11g\\x64\\11.2.0\\client_1\\bin;%PATH% The netwokdisk "I" is mapped for every employee. Collegue:With 2 colleges we work with FME.In FME options we have the following in Default Path:Connection Data Directory : I:\\APPDATA\\FME\\FME_ConnPublic key file : I:\\APPDATA\\FME\\FME_Conn\\fme_publicKey.jceksPrivate key file :
I am struggling to read two geometry columns from this database. If I set Handle Multiple Spatial Columns to "No", it only gives me one of the two columns. If I set it to "Yes", then I get the above error. What does it mean to have a "Custom SQL SELECT statement"?Mine is nothing fancy:select building_id, floor_id, space_id, agency_code, space_type, space_category,usable_sq_ft, obj.objgeom, SDO_UTIL.interior_point (OBJ.objgeom) from esm.esmobject obj join esm.att_space ats on obj.IDOBJECT = ats.IDOBJECT where building_id = 'BD0303' and floor_id = '01' It was also difficult to retrieve data tables. I had to type in each one. Luckily there were only two. If I let FME search for tables, it errors:My connection seems fine. I am able to access all tables and do more complicated queries in SQL Developer. Any info is appreciated. Thanks, Loren
Hi all,I have an issue when I'm running my workspace. It throws a Python error relating to what I'm guessing is something with the python version: File "C:\\Program Files\\ArcGIS\\Pro\\bin\\Python\\envs\\arcgispro-py3\\lib\\site.py", line 177 file=sys.stderr) ^SyntaxError: invalid syntax Warning: not all FMESessions that were created were destroyed before shutdown. This may cause instabilityWarning: not all Stashed Objects that were registered were dropped before shutdown. This may cause instability I'm using Data Interoperability extension to ArcGIS version 2020.2 and have ArcGIS Pro 2.7.2, since I need to be able to write to an SDE and we dont have that license to our regular FME version. But I do have a regular installation of FME, so I'm wondering if the issue could be related to different python versions between the two? I do not have any individual python software installed - everything is installed via either FME or ArcGIS. Another colleague has experie
Hello Friends, I'm new to FME. How can I assign GIS Attribute field types in FME Attributes while converting.While Im converting ROAD_NAMEE given as character, after conversion its came as string in GIS. how can I get the same? PS. Converted from dgn to shp. dgn file elements are attached with tag. please help someone Thanks
I have a URL that allows me to anonymously download from Dropbox that is successful in browser but I cannot figure out how to use a non-authenticated connection to Dropbox in my DropboxConnector in my workspace. The files are not in my Dropbox account, but in another account and I only have an open URL to download them. Any ideas how to connect to Dropbox anonymously or without a authenticated web connection?
Using FME 2021.1.0.1 When trying to use an FME Server Parameter in a Scripted Parameter, I get this error: ----------------------------------------------------------------------- Starting translation...INFORM: Using Python interpreter from `C:\\Program Files\\FME2021\\fmepython38\\python38.dll' with PYTHONHOME `C:\\Program Files\\FME2021\\fmepython38'INFORM: Python version 3.8 loaded successfullyERROR : Python Exception <KeyError>: 'FME_DATA_REPOSITORY'INCLUDE -- failed to evaluate Python script `def ParamFunc(): import fme repo = fme.macroValues['BOB'] repo = fme.macroValues['FME_DATA_REPOSITORY'] if repo == "Example Name - DEV": env = "DEV" return envvalue = ParamFunc()macroName = 'ENV'if value == None: return { macroName : u'' }else: import six try: value = six.text_type(value) except UnicodeDecodeError: value = six.text_type(value, 'utf-8') return { macroName : value }'Program TerminatingTranslati
Hi All, I have a customer who is scheduling fme.exe from within Microsoft SSMS - because it has good logging functionality. The fme.exe command is taken from a desktop log file on the server machine. If they run the command in a shell it works, and scheduling with Task Scheduler works, but from inside SSMS as the sql_agent account they get 'FME license system failure: License dependency check failed. This FME suite license is dependent on another license which is not available. Program terminating. Transaction failed. Process exit code 2. The step failed. '. Does anyone have an idea what is the issue? SSMS scheduler has only the one user account available to run jobs, but I assume that could be changed. Thanks.
I am unsure as to why I'm not able to connect to NetSuite via the ODBC connector in FME. I have Windows 10 (64 bit), FME Desktop (2019.2 b 19801 64bit) with the ODBC (64bit) driver installed. I have verified that the connection works in ODBC Source Administrator and also in Excel. The error I receive in FME is: Error connecting to databaseDatabase Generated Error Information:Database Error Message: [Microsoft][ODBC Driver Manager] Data source name not found and no default driver specifiedDatabase SQL Statement Text:SQL State: IM002Variable Information:ODBC 3.x Reader: Failed to connect to databaseI have verified the data source name matches with the username and password in the reader parameters, but I am unable to connect. Any ideas as to what I could do to get it to connect?
Hi, I seldom work with rasters so my question is basic, is the canonical way to convert MrSID to MBTiles to read pyramid level 0 from the SID, pass the image through WebMapTiler (with any zoom level filtering you need, or hands-free auto mode) then write to MBTiles with fanout expression @Value(_zoom_level) and feature type Somename_@Value_quadkey)? Thanks.
I've configured the SMTP Publisher to receive emails, but when I send them to FME Server I get undelivered responses. I looked at the email.log for the FME Server Publishers and I see: "WARN Email received for unknown recipient [email address], so dropped What does this mean?
Getting back to my little project started here after a brief hiatus... I am having trouble making a file uploaded to the 'Resources' folder using the Javascript API the input for a workbench. Using ...FMEServer.dataUpload( repository, workspace, fileObject, session, callback);I can get the file to be uploaded to here:$(FME_SHAREDRESOURCE_TEMP)/upload/MyFolder/MyWorkspace.fmw/Now, I want to use:FMEServer.runWorkspaceWithData( repository, workspace, params, callback)to process the uploaded file but all attempt to feed in the correct 'params' is failing. The workspace is still going back to the default parameters that it was published with. Currently, I'm trying this:var params = { { "publishedParameters" : [{ "name" : 'SourceDataset_CSV2', "value" : <resourceFolderPath+inputFileName >},{ "name" : 'DestDataset_JSON', "value" : < ?????>}], "service" : "fmedatastreaming" };Not sure what to put for the destination value that I'm trying to capture. Javascript API docume
Hi, I'm inefficient with CSS selector statements - having no HTML authoring background. I want the CSV download links at this site and only the csv download links:https://data.sandiego.gov/datasets/parking-citations/I can get all 'a' tags and the href references no problem but have to test the result ends with '.csv'. Can anyone give me the right selector syntax for the element I'm after? Thanks all.
I have 1 table that has one column called mbipk with a number value and then another column called sales with a number in it. I want to run it against 16 other tables which also have that same mbipk column, I want it to match only the mbripk number and if that matches then I want it to inject a new column called sales_2 and put the sales number from the 1st table into sales_2 into table 2. Is this possible?
I had an issue with a workspace with a disabled junction. I then discovered that disabled junctions won't get grouped in the navigator as disabled transformers and disabled connections do. Is this on purpose or is this something that can be improved? I expected them in the "Disabled Transformers" group. The workaround is to search for "junction" in the workspace search, this will display all junctions and mark the disabled junctions grey. Tested in 2021.1.1.0 (20210730 - Build 21619 - WIN64)
Greetings,I'm running a workspace through FME Python API using FMEWorkspaceRunner, and need to ensure that the 'redirect to fme data inspector' parameter is toggled off prior to running. How can one access this workspace parameter?Thank you,TylerFME 2021.0.0.1Python 3.7
Hello, before writing a Python script, I'd like to know if there is a way to retrieve the lines between a point A and a point B using classic transofrmers?